-- Logs begin at Fri 2022-06-03 12:24:45 UTC, end at Fri 2022-06-03 13:44:13 UTC. -- Jun 03 13:01:13.145863 dv-cinder-801354-5-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 03 13:01:13.154604 dv-cinder-801354-5-iscsi devstack@keystone.service[80560]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 03 13:01:13.156602 dv-cinder-801354-5-iscsi devstack@keystone.service[80560]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 3 13:01:13 2022] *** Jun 03 13:01:13.156602 dv-cinder-801354-5-iscsi devstack@keystone.service[80560]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 03 13:01:13.156602 dv-cinder-801354-5-iscsi devstack@keystone.service[80560]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 03 13:01:13.156602 dv-cinder-801354-5-iscsi devstack@keystone.service[80560]: nodename: dv-cinder-801354-5-iscsi Jun 03 13:01:13.156602 dv-cinder-801354-5-iscsi devstack@keystone.service[80560]: machine: x86_64 Jun 03 13:01:13.156602 dv-cinder-801354-5-iscsi devstack@keystone.service[80560]: clock source: unix Jun 03 13:01:13.156602 dv-cinder-801354-5-iscsi devstack@keystone.service[80560]: pcre jit disabled Jun 03 13:01:13.156602 dv-cinder-801354-5-iscsi devstack@keystone.service[80560]: detected number of CPU cores: 4 Jun 03 13:01:13.156602 dv-cinder-801354-5-iscsi devstack@keystone.service[80560]: current working directory: / Jun 03 13:01:13.156602 dv-cinder-801354-5-iscsi devstack@keystone.service[80560]: detected binary path: /usr/bin/uwsgi-core Jun 03 13:01:13.157167 dv-cinder-801354-5-iscsi devstack@keystone.service[80560]: your processes number limit is 47680 Jun 03 13:01:13.157167 dv-cinder-801354-5-iscsi devstack@keystone.service[80560]: your memory page size is 4096 bytes Jun 03 13:01:13.157167 dv-cinder-801354-5-iscsi devstack@keystone.service[80560]: detected max file descriptor number: 2048 Jun 03 13:01:13.157167 dv-cinder-801354-5-iscsi devstack@keystone.service[80560]: lock engine: pthread robust mutexes Jun 03 13:01:13.157167 dv-cinder-801354-5-iscsi devstack@keystone.service[80560]: thunder lock: enabled Jun 03 13:01:13.157167 dv-cinder-801354-5-iscsi devstack@keystone.service[80560]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 03 13:01:13.157167 dv-cinder-801354-5-iscsi devstack@keystone.service[80560]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 03 13:01:13.201076 dv-cinder-801354-5-iscsi devstack@keystone.service[80560]: Python main interpreter initialized at 0x55c335a2d9c0 Jun 03 13:01:13.201076 dv-cinder-801354-5-iscsi devstack@keystone.service[80560]: python threads support enabled Jun 03 13:01:13.201076 dv-cinder-801354-5-iscsi devstack@keystone.service[80560]: your server socket listen backlog is limited to 100 connections Jun 03 13:01:13.201076 dv-cinder-801354-5-iscsi devstack@keystone.service[80560]: your mercy for graceful operations on workers is 90 seconds Jun 03 13:01:13.201408 dv-cinder-801354-5-iscsi devstack@keystone.service[80560]: mapped 403077 bytes (393 KB) for 2 cores Jun 03 13:01:13.201485 dv-cinder-801354-5-iscsi devstack@keystone.service[80560]: *** Operational MODE: preforking *** Jun 03 13:01:13.201764 dv-cinder-801354-5-iscsi devstack@keystone.service[80560]: *** uWSGI is running in multiple interpreter mode *** Jun 03 13:01:13.201764 dv-cinder-801354-5-iscsi devstack@keystone.service[80560]: spawned uWSGI master process (pid: 80560) Jun 03 13:01:13.201956 dv-cinder-801354-5-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 03 13:01:13.203051 dv-cinder-801354-5-iscsi devstack@keystone.service[80560]: spawned uWSGI worker 1 (pid: 80571, cores: 1) Jun 03 13:01:13.203051 dv-cinder-801354-5-iscsi devstack@keystone.service[80560]: spawned uWSGI worker 2 (pid: 80572, cores: 1) Jun 03 13:01:13.203051 dv-cinder-801354-5-iscsi devstack@keystone.service[80560]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 03 13:01:21.393758 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 13:01:21.393758 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: from cryptography.utils import int_from_bytes Jun 03 13:01:21.394534 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 13:01:21.394534 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: from cryptography.utils import int_from_bytes Jun 03 13:01:21.394534 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 13:01:21.394534 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: from cryptography.utils import int_from_bytes Jun 03 13:01:21.395042 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 13:01:21.395042 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: from cryptography.utils import int_from_bytes Jun 03 13:01:21.477414 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 03 13:01:21.477600 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 03 13:01:21.477700 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 03 13:01:21.477915 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 03 13:01:21.478004 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] command line args: [] {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 03 13:01:21.478223 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] command line args: [] {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 03 13:01:21.478404 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 03 13:01:21.478659 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 03 13:01:21.478744 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ================================================================================ {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 03 13:01:21.478943 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ================================================================================ {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 03 13:01:21.479069 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] admin_token = **** {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.479360 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] admin_token = **** {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.479448 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] config_dir = [] {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.479746 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] config_dir = [] {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.479832 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.480037 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] config_source = [] {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.480119 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.480358 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] debug = True {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.480449 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] config_source = [] {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.480672 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] debug = True {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.480772 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.481026 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.481254 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.481330 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.481501 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.481629 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.481919 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.482049 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.482331 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.482464 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.482716 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] list_limit = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.482852 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] list_limit = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.483028 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] log_config_append = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.483134 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] log_config_append = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.483315 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.483435 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.483610 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] log_dir = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.483702 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] log_dir = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.483902 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] log_file = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.483991 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] log_file = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.484328 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.484414 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.484743 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.484838 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.485152 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.485240 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.485553 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.485645 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.485845 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.485933 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.486177 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.486272 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.486609 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.486792 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.487020 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.487201 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.487417 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.487617 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.487806 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.487991 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.488228 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.488415 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.488622 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.488809 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.489038 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.489218 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.489448 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.489633 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.489912 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.490097 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.490701 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.61/identity {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.490878 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.61/identity {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.490971 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] publish_errors = False {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.491175 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] publish_errors = False {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.491363 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.491564 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.491746 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.491948 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.492036 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.492278 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.492514 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.492691 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.492920 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.493087 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.493293 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] standard_threads = False {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.493482 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] standard_threads = False {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.493679 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.493872 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.494083 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.494278 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.494360 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.494577 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.494688 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] use_journal = False {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.494877 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] use_journal = False {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.494966 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] use_json = False {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.495180 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] use_json = False {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.495262 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] use_stderr = False {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.495467 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] use_syslog = False {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.495548 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] use_stderr = False {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.495764 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] use_syslog = False {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.495851 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.496196 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:21.496290 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.496609 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.496691 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.497011 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.497094 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.497438 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.497520 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.497827 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.497969 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.498218 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.498350 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.498611 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.498744 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.499008 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.499146 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.499398 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.499536 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.499804 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.499935 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.500232 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.500376 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.500623 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.500755 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.501010 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.501144 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.501400 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.501541 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.502303 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.502443 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.502737 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.502893 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.503164 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.503297 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.503571 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.503704 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.504005 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.504137 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.504463 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.504597 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.504880 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.505020 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.505275 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.505409 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.505693 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.505833 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.506108 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.506240 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.506517 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.506654 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.506906 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.507049 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.507289 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.507420 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.507674 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.507806 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.508056 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.508214 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.508481 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.508612 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.508886 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.509109 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.509270 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.509407 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.509642 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.509774 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.510029 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.511220 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.511359 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.511502 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.511632 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.511758 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.511883 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.512007 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.512137 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.512309 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.512469 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.512604 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.512604 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.512849 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.512849 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.513105 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.513105 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.513350 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.513481 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.513611 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.513794 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.513937 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.514179 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.514317 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.514573 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.514707 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.514961 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.515108 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.515343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.515484 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.515723 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.515856 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.516103 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.516260 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.516520 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.516654 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.516912 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.517053 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.517413 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.518106 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.518297 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.518429 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.518566 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.518692 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.518827 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.518959 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.519095 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.519228 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.519354 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.519480 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.519612 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.519738 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.519873 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.520006 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.520132 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.520324 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.520452 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.520452 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.520696 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.520834 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.520962 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.521088 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.521219 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.521423 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.521563 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.521690 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.521815 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.521941 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.522077 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.522210 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.522347 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.522474 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.522599 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.522730 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.522855 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.522981 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.523114 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.523241 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.523367 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.523493 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.523618 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.523743 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.523885 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.524018 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.524169 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.524313 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.524441 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.524575 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.524710 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.524837 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.524971 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.525139 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.525272 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.525399 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.525531 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.525709 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.525854 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.525982 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.526113 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.526239 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.526366 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.526502 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.526635 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.526762 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.526888 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.527013 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.527138 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.527272 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.527400 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.527536 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.527669 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.527799 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.527930 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.528112 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.528293 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.528422 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.528557 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.528685 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.528810 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.528945 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.528945 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.529182 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.529314 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.529452 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.529579 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.529713 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.529840 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.529966 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.530092 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.530217 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.530217 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.530470 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.530599 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.530725 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.530856 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.530988 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.531123 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.531272 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.531406 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.531533 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.531660 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.531785 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] auth.external = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.531785 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.532032 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.532032 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.532301 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.532429 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] auth.external = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.532555 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.532711 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.532847 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] auth.password = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.532847 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] auth.token = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.533299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.533476 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.533615 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.533744 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.533871 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] auth.password = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.534004 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.534140 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] auth.token = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.534268 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.534401 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.534528 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.534655 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.534783 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.534917 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.535057 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.535184 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.535310 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] credential.caching = True {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.535437 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.535569 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.535704 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.535832 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.535832 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.536071 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.536223 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.536354 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] credential.caching = True {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.536561 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.536698 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.536839 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.536973 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.537102 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.537229 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.537375 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.537504 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.537653 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.537789 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.537918 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.538050 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.538190 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.538318 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.538450 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.538577 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.538722 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.538862 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.539000 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.539128 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.539254 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.539381 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.539508 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] federation.caching = True {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.539642 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.539781 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.539910 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.540037 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.540231 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.540366 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.540366 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.540634 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.540809 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.540941 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] federation.caching = True {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.541070 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.541196 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.541331 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.541459 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.541586 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.541712 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.541839 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.541966 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.542101 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.542229 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.542367 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.542494 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.542621 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] identity.caching = True {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.542753 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.542889 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.543023 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.543152 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.543279 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.543406 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.543532 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.543671 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.543799 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.543931 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.544075 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] identity.caching = True {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.544228 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.544359 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.544496 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.544625 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.544752 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.544879 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.545006 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.545132 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.545268 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.545395 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.545522 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.545649 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.545776 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.545935 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.546079 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.546208 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.546336 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.546462 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.546588 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.546722 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.546858 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.546986 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.547113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.547240 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.547368 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.547500 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.547649 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.547778 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.547905 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.548039 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.548187 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.548322 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.548461 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.549102 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.549233 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.549361 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.549489 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.549630 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.549830 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.549969 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.550108 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.550243 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.550376 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.550506 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.550642 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.550770 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.550897 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.551024 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.551151 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.551279 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.551414 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.551544 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.551672 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.551799 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.551936 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.552062 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.552233 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.552376 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.552512 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.552646 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.552779 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.552921 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.553056 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.553189 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.553322 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.553454 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.553588 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.553743 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.553878 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.553878 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.554128 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.554261 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.554399 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.554546 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.554682 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.554816 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.554816 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.555068 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.555202 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.555343 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.555343 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.555606 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.555606 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.555858 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.555991 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.556132 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.556313 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.556448 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.556582 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.user = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.556716 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.556849 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.556990 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.556990 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.557243 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.557382 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.557530 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.557665 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.557807 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.557942 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.558082 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.558216 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.558350 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.558483 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.user = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.558624 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.558758 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.558893 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.558893 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.559143 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.559290 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.559431 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.559566 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.559699 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.559831 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.559965 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.560098 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.560299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.560436 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.560570 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.560703 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.560836 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.560970 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.561111 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.561261 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.561395 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.561528 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.561661 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.561793 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.561933 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.562068 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.562201 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.562334 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.562467 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.562599 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.562803 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.562946 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.563092 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.563313 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.563455 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.563589 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.563732 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.563868 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.564001 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.564160 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.564912 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.565101 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.565250 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.565386 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.565519 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.565653 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.565800 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.565935 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.566077 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.566213 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.566346 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.566479 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.566612 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.566746 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.566887 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.567021 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.567154 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.567288 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.567432 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.567567 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] resource.caching = True {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.567719 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.567855 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.567855 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.568106 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.568310 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.568446 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.568590 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.568726 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.568859 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.568992 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.569125 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.569258 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.569258 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.569520 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.569520 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.569781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] resource.caching = True {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.569914 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.570047 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.570188 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] role.caching = True {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.570322 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.570456 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] role.driver = sql {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.570589 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.570722 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.570862 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.570996 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.571129 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.571263 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.571408 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.571542 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.571683 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.571817 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.571950 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.572083 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.572244 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.572379 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.572523 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] role.caching = True {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.572523 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] role.driver = sql {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.572775 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.572907 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.573040 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.573040 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.573308 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.573443 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.573576 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.573710 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.573844 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.573984 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.574126 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.574260 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.574393 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.574393 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.574651 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.574785 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.574927 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.575071 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.575205 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.575338 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.575471 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.575604 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.575744 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.575878 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.576012 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.576165 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.576308 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.576442 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.576586 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.576586 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.576851 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.576985 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.577118 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.577265 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.577404 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.577539 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.577671 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.577805 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.577938 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.578079 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.578219 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.578353 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.578486 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.578629 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.578764 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.578905 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.579039 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.579172 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.579305 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.579438 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.579570 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.579710 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] token.caching = True {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.579890 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.580062 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.580224 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.580362 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.580495 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.580651 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.580786 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.580927 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.581062 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.581196 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.581329 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.581471 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.581606 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.581739 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.581874 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.582008 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.582141 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] token.caching = True {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.582283 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.582428 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.582561 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.582694 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.582827 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.582961 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.583103 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.583238 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.583371 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.583504 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.583637 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.583637 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.583896 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.584032 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.584188 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.584188 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.584458 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.584592 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.584735 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] database.connection = **** {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.584879 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.585028 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.585165 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.585298 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.585431 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.585564 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.585704 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.585839 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.585971 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.586106 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.586250 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.586384 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.586525 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.586660 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.586660 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.586910 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.587043 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.587223 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] database.connection = **** {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.587443 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.587589 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.587733 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.587868 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.588001 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.588134 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.588323 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.588458 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.588602 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.588736 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.588870 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.589003 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.589136 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.589270 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.589411 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.589545 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.589678 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.589810 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.589944 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 03 13:01:21.590092 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.590092 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.590092 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.590092 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.590092 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.590092 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.590092 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.590092 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.590092 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:21.591309 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 03 13:01:21.608908 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.609165 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.609351 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.610054 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.610289 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.610517 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.618477 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.619657 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.648557 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.648729 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.649107 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.649341 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.703632 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.703787 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.753901 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.754127 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.754782 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.755016 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.821255 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.821409 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.821477 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.821593 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.821677 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.821818 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.821902 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.822039 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.822120 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.822253 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.822344 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.822467 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.845225 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.845483 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.845628 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.845765 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.845865 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.846072 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.846154 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.846289 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.846371 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.846503 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.846836 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.846967 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.847046 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.847179 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.858321 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.858678 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.871591 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.871825 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.871919 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.872047 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.872131 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.872301 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.872384 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.872518 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.872599 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.872730 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.872812 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.872939 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.873019 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.873149 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 13:01:21.890644 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.890848 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.890944 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 03 13:01:21.891059 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 03 13:01:21.891199 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.891385 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 03 13:01:21.891493 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.891573 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 03 13:01:21.891647 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.891835 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.891918 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.892090 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.892193 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.892420 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.892562 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.892693 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.903639 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.903751 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.903867 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.903952 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.904131 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.904240 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.904427 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.904512 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.912685 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 13:01:21.912801 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 13:01:21.915980 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 13:01:21.916084 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 13:01:21.916283 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.916506 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.916590 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.916787 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.916869 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.917065 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.917150 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.917346 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.917453 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.917715 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.917803 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.917985 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.918064 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.918252 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.918332 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.918520 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.918601 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.918779 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.918865 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.919047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.946917 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.947050 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.948666 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 13:01:21.948795 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 13:01:21.948948 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.949071 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.954284 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 13:01:21.954368 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 13:01:21.954572 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.954653 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.954895 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.955059 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.962392 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 13:01:21.962533 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 13:01:21.962674 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.962811 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.967229 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 13:01:21.967340 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 13:01:21.967626 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.967711 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.967909 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.967992 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.968212 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.968299 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.968489 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.968572 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.968765 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.968861 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.969031 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.969113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.969296 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.969377 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.991374 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.991546 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.991637 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.991704 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.994261 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 13:01:21.994731 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 13:01:21.998693 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.998693 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.998934 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:21.998934 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.003575 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 13:01:22.003761 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 13:01:22.007172 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 13:01:22.007543 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 13:01:22.012372 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.012671 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.012803 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.012955 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.013105 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.013239 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.013392 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.013518 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.013676 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.013796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.013961 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.014239 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.033572 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 13:01:22.033854 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.034115 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.034327 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 13:01:22.034417 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.034609 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.034872 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.035133 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.042399 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.043333 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.044161 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.044436 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.045100 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.045375 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.047459 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 13:01:22.047746 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.048026 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.048335 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.049181 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 13:01:22.049336 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.049499 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.049730 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.050007 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.050296 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.062754 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 13:01:22.063032 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.063309 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.063586 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.063863 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.063945 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 13:01:22.064174 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.064292 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.064457 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.064609 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.064750 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.065015 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.065285 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.065556 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.082942 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 13:01:22.083762 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 13:01:22.086259 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 13:01:22.087209 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 13:01:22.089613 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.090566 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.091225 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.092208 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.092917 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 13:01:22.093203 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.093484 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.093871 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 13:01:22.094145 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.094421 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.101776 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.102900 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.103412 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 13:01:22.104548 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 13:01:22.106660 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.106948 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.107231 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.107506 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.107766 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.108049 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.108351 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.108623 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.117306 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 13:01:22.117586 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.117970 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.118772 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 13:01:22.119050 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.119427 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.125959 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 13:01:22.126238 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.126514 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.126812 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.127085 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.127385 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.127564 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 13:01:22.127657 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.127841 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.127922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.128118 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.128274 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.128414 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.128498 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.128682 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.128763 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.128953 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.129033 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.129229 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.129312 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.129485 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.129566 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.129782 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.130045 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.130312 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.130585 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.130861 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.131115 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 13:01:22.168304 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: WSGI app 0 (mountpoint='') ready in 9 seconds on interpreter 0x55c335a2d9c0 pid: 80572 (default app) Jun 03 13:01:22.170101 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: WSGI app 0 (mountpoint='') ready in 9 seconds on interpreter 0x55c335a2d9c0 pid: 80571 (default app) Jun 03 13:01:22.171519 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b0365-0527-4898-ab53-b082166248a9 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:22.171813 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b0365-0527-4898-ab53-b082166248a9 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:22.172087 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b0365-0527-4898-ab53-b082166248a9 None None] PATH_INFO: `/v3` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:22.177174 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1/1] 10.222.0.61 () {50 vars in 791 bytes} [Fri Jun 3 13:01:22 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:01:30.919322 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03707e-faf6-4bb5-af13-25284293d6da None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:30.919898 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03707e-faf6-4bb5-af13-25284293d6da None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:30.919898 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03707e-faf6-4bb5-af13-25284293d6da None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:30.924426 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1/2] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:01:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:01:30.929610 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f65150-fec4-4f28-9262-fec1125dc5ed None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:30.930010 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f65150-fec4-4f28-9262-fec1125dc5ed None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:30.930164 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f65150-fec4-4f28-9262-fec1125dc5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:31.000110 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: INFO dbcounter [None req-56f65150-fec4-4f28-9262-fec1125dc5ed None None] Registered counter for database keystone Jun 03 13:01:31.021981 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG oslo_db.sqlalchemy.engines [None req-56f65150-fec4-4f28-9262-fec1125dc5ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80572) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 13:01:31.028134 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writer thread running {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 13:01:31.311044 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG passlib.handlers.bcrypt [None req-56f65150-fec4-4f28-9262-fec1125dc5ed None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80572) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 03 13:01:31.311461 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG passlib.handlers.bcrypt [None req-56f65150-fec4-4f28-9262-fec1125dc5ed None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80572) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 03 13:01:31.367626 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-56f65150-fec4-4f28-9262-fec1125dc5ed None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:01:31.369283 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-56f65150-fec4-4f28-9262-fec1125dc5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:01:31.491709 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 2/3] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:01:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 563 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 03 13:01:31.651670 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03707e-faf6-4bb5-af13-25284293d6da None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:31.721953 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: INFO dbcounter [None req-df03707e-faf6-4bb5-af13-25284293d6da None None] Registered counter for database keystone Jun 03 13:01:31.741000 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG oslo_db.sqlalchemy.engines [None req-df03707e-faf6-4bb5-af13-25284293d6da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80571) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 13:01:31.748804 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writer thread running {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 13:01:31.973902 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03707e-faf6-4bb5-af13-25284293d6da None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:31.978435 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e1d7e-5116-4e9f-ac93-09f4d74b7a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:31.979098 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e1d7e-5116-4e9f-ac93-09f4d74b7a0e admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:31.979387 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e1d7e-5116-4e9f-ac93-09f4d74b7a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:31.979669 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e1d7e-5116-4e9f-ac93-09f4d74b7a0e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:31.988530 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6e1d7e-5116-4e9f-ac93-09f4d74b7a0e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:32.039786 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5f6e1d7e-5116-4e9f-ac93-09f4d74b7a0e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 03 13:01:32.040133 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6e1d7e-5116-4e9f-ac93-09f4d74b7a0e admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:32.050570 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 2/4] 10.222.0.61 () {58 vars in 1324 bytes} [Fri Jun 3 13:01:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 13:01:32.056654 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f65150-fec4-4f28-9262-fec1125dc5ed None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:32.071617 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f65150-fec4-4f28-9262-fec1125dc5ed None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:32.076069 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26056a7e-21a7-4579-aefa-64f7d97d27e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:32.077222 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26056a7e-21a7-4579-aefa-64f7d97d27e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:32.077510 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26056a7e-21a7-4579-aefa-64f7d97d27e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:32.077786 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26056a7e-21a7-4579-aefa-64f7d97d27e2 admin admin] PATH_INFO: `/v3/projects/ade16b49bacd4a0789895b9341a45a4d` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:32.079326 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26056a7e-21a7-4579-aefa-64f7d97d27e2 admin admin] RBAC: Authorizing `identity:get_project(project_id=ade16b49bacd4a0789895b9341a45a4d)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:32.131846 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: WARNING keystone.common.rbac_enforcer.enforcer [None req-26056a7e-21a7-4579-aefa-64f7d97d27e2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 03 13:01:32.132202 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26056a7e-21a7-4579-aefa-64f7d97d27e2 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:32.136890 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 3/5] 10.222.0.61 () {56 vars in 1207 bytes} [Fri Jun 3 13:01:32 2022] GET /identity/v3/projects/ade16b49bacd4a0789895b9341a45a4d => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:01:34.359527 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1028ae-0609-466a-b0d1-dabafc674d03 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:34.360073 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1028ae-0609-466a-b0d1-dabafc674d03 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:34.360073 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1028ae-0609-466a-b0d1-dabafc674d03 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:34.364792 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 3/6] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:01:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 13:01:34.370302 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eac1d2-2164-4ea1-b3f6-d2a4932791cb None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:34.370723 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eac1d2-2164-4ea1-b3f6-d2a4932791cb None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:34.370862 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eac1d2-2164-4ea1-b3f6-d2a4932791cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:34.389534 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-04eac1d2-2164-4ea1-b3f6-d2a4932791cb None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:01:34.391050 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-04eac1d2-2164-4ea1-b3f6-d2a4932791cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:01:34.398888 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 4/7] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:01:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 03 13:01:34.421627 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1028ae-0609-466a-b0d1-dabafc674d03 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:34.434104 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1028ae-0609-466a-b0d1-dabafc674d03 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:34.438255 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee07c0-a679-40ab-bc98-f6647e8378e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:34.438878 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee07c0-a679-40ab-bc98-f6647e8378e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:34.439169 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee07c0-a679-40ab-bc98-f6647e8378e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:34.439440 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee07c0-a679-40ab-bc98-f6647e8378e4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:34.446945 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ee07c0-a679-40ab-bc98-f6647e8378e4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:34.448728 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ee07c0-a679-40ab-bc98-f6647e8378e4 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:34.457244 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 4/8] 10.222.0.61 () {58 vars in 1324 bytes} [Fri Jun 3 13:01:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 13:01:34.462632 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eac1d2-2164-4ea1-b3f6-d2a4932791cb None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:34.472414 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eac1d2-2164-4ea1-b3f6-d2a4932791cb None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:34.477041 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1435d7-87bb-4522-ad72-849b7a437720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:34.477895 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1435d7-87bb-4522-ad72-849b7a437720 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:34.478176 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1435d7-87bb-4522-ad72-849b7a437720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:34.478449 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1435d7-87bb-4522-ad72-849b7a437720 admin admin] PATH_INFO: `/v3/users/31e8e6595d7242a98c3388e4c3784e70` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:34.479823 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1435d7-87bb-4522-ad72-849b7a437720 admin admin] RBAC: Authorizing `identity:get_user(user_id=31e8e6595d7242a98c3388e4c3784e70)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:34.481682 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1435d7-87bb-4522-ad72-849b7a437720 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:34.483229 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 5/9] 10.222.0.61 () {56 vars in 1198 bytes} [Fri Jun 3 13:01:34 2022] GET /identity/v3/users/31e8e6595d7242a98c3388e4c3784e70 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:01:36.756732 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b114b0-e675-4782-8307-79dca0dd60d8 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:36.757273 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b114b0-e675-4782-8307-79dca0dd60d8 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:36.757273 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b114b0-e675-4782-8307-79dca0dd60d8 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:36.758646 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 5/10] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 13:01:36.763780 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983ea14-ed20-4e35-9958-0e76d588f10c None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:36.764245 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983ea14-ed20-4e35-9958-0e76d588f10c None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:36.764341 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983ea14-ed20-4e35-9958-0e76d588f10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:36.780874 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-4983ea14-ed20-4e35-9958-0e76d588f10c None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:01:36.782041 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-4983ea14-ed20-4e35-9958-0e76d588f10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:01:36.797422 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde73b9d-1d86-46e3-9a6d-e922296adc79 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:36.797715 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde73b9d-1d86-46e3-9a6d-e922296adc79 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:36.797997 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde73b9d-1d86-46e3-9a6d-e922296adc79 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:36.800028 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 6/11] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:01:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:01:36.805162 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b002809-d9b2-4f8a-bc95-86354ac795da None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:36.805618 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b002809-d9b2-4f8a-bc95-86354ac795da None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:36.805618 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b002809-d9b2-4f8a-bc95-86354ac795da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:36.845513 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG passlib.handlers.bcrypt [None req-0b002809-d9b2-4f8a-bc95-86354ac795da None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80571) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 03 13:01:36.845942 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG passlib.handlers.bcrypt [None req-0b002809-d9b2-4f8a-bc95-86354ac795da None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80571) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 03 13:01:36.864122 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 6/12] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:01:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:01:36.886579 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4983ea14-ed20-4e35-9958-0e76d588f10c None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:36.893087 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-0b002809-d9b2-4f8a-bc95-86354ac795da None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:01:36.894659 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-0b002809-d9b2-4f8a-bc95-86354ac795da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:01:36.911785 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:36.991803 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4983ea14-ed20-4e35-9958-0e76d588f10c None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:36.997802 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 7/13] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:01:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 13:01:37.020526 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b002809-d9b2-4f8a-bc95-86354ac795da None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:37.028765 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58610db-6b3a-42b4-b5a7-51da02918cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:37.029575 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58610db-6b3a-42b4-b5a7-51da02918cca None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:37.029858 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58610db-6b3a-42b4-b5a7-51da02918cca None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:37.030137 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58610db-6b3a-42b4-b5a7-51da02918cca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:37.041602 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58610db-6b3a-42b4-b5a7-51da02918cca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:01:37.053236 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-e58610db-6b3a-42b4-b5a7-51da02918cca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:01:37.053236 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:01:37.053236 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:01:37.053236 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:01:37.053236 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:01:37.053236 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:01:37.053236 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:01:37.053236 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:01:37.053236 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:01:37.053236 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:01:37.053236 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:01:37.053236 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:01:37.053236 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:01:37.053236 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:01:37.053236 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:01:37.053236 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:01:37.054261 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:01:37.054261 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:01:37.054261 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:01:37.054261 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:01:37.054261 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:01:37.054261 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:01:37.054261 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:01:37.054261 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:01:37.054261 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:01:37.054261 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:01:37.054261 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:01:37.054261 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:01:37.054261 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:01:37.054261 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:01:37.054261 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:01:37.054261 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:01:37.055075 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:01:37.055075 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:01:37.055075 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:01:37.055075 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:01:37.055075 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:01:37.055075 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:01:37.055075 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:01:37.055075 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:01:37.055075 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:01:37.055075 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:01:37.055075 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:01:37.055075 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:01:37.055075 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 7/14] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 13:01:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:01:37.060243 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58610db-6b3a-42b4-b5a7-51da02918cca None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:37.122853 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b002809-d9b2-4f8a-bc95-86354ac795da None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:37.125126 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:37.145702 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:37.159781 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee24482-67fb-4baa-8298-3ce73b3144b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:37.160715 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee24482-67fb-4baa-8298-3ce73b3144b4 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:37.161002 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee24482-67fb-4baa-8298-3ce73b3144b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:37.161278 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee24482-67fb-4baa-8298-3ce73b3144b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:37.163705 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58610db-6b3a-42b4-b5a7-51da02918cca None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:37.197529 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af47bb-9e7a-4d84-a880-686bda729151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:37.198191 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af47bb-9e7a-4d84-a880-686bda729151 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:37.198476 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af47bb-9e7a-4d84-a880-686bda729151 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:37.198754 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af47bb-9e7a-4d84-a880-686bda729151 None admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:37.199896 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33af47bb-9e7a-4d84-a880-686bda729151 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:01:37.200245 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33af47bb-9e7a-4d84-a880-686bda729151 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:37.201992 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33af47bb-9e7a-4d84-a880-686bda729151 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:37.214450 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 8/15] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:01:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:01:37.219981 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af47bb-9e7a-4d84-a880-686bda729151 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:37.228447 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee24482-67fb-4baa-8298-3ce73b3144b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:37.229990 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee24482-67fb-4baa-8298-3ce73b3144b4 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:37.319449 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af47bb-9e7a-4d84-a880-686bda729151 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:37.327680 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 8/16] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:01:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 03 13:01:37.333743 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee24482-67fb-4baa-8298-3ce73b3144b4 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:37.336437 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:37.354357 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4e79a-4c7f-4a59-a9b0-696468598bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:37.355224 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4e79a-4c7f-4a59-a9b0-696468598bcc None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:37.355503 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4e79a-4c7f-4a59-a9b0-696468598bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:37.355777 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4e79a-4c7f-4a59-a9b0-696468598bcc None admin] PATH_INFO: `/v3/users/31e8e6595d7242a98c3388e4c3784e70` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:37.357089 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba4e79a-4c7f-4a59-a9b0-696468598bcc None admin] RBAC: Authorizing `identity:get_user(user_id=31e8e6595d7242a98c3388e4c3784e70)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:37.358569 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba4e79a-4c7f-4a59-a9b0-696468598bcc None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:37.360241 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 9/17] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 13:01:37 2022] GET /identity/v3/users/31e8e6595d7242a98c3388e4c3784e70 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:01:37.365652 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4e79a-4c7f-4a59-a9b0-696468598bcc None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:37.381266 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:37.429776 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee24482-67fb-4baa-8298-3ce73b3144b4 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:37.462755 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4e79a-4c7f-4a59-a9b0-696468598bcc None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:37.462947 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094486be-6c00-4509-aa6d-aa22fc297104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:37.463741 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094486be-6c00-4509-aa6d-aa22fc297104 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:37.464022 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094486be-6c00-4509-aa6d-aa22fc297104 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:37.464330 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094486be-6c00-4509-aa6d-aa22fc297104 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:37.483270 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094486be-6c00-4509-aa6d-aa22fc297104 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:37.484845 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094486be-6c00-4509-aa6d-aa22fc297104 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:37.496847 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579639c-d13f-4639-ba89-c610a1d19d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:37.497631 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579639c-d13f-4639-ba89-c610a1d19d69 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:37.497911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579639c-d13f-4639-ba89-c610a1d19d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:37.498183 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579639c-d13f-4639-ba89-c610a1d19d69 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:37.499345 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3579639c-d13f-4639-ba89-c610a1d19d69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:37.501091 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3579639c-d13f-4639-ba89-c610a1d19d69 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:37.502995 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 10/18] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:01:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:01:37.506364 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-094486be-6c00-4509-aa6d-aa22fc297104 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:01:37.506364 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:01:37.506364 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:01:37.506364 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:01:37.506364 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:01:37.506364 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:01:37.506364 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:01:37.506364 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:01:37.506364 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:01:37.506364 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:01:37.506364 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:01:37.506364 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:01:37.506364 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:01:37.506364 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:01:37.506364 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:01:37.507343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:01:37.507343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:01:37.507343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:01:37.507343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:01:37.507343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:01:37.507343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:01:37.507343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:01:37.507343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:01:37.507343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:01:37.507343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:01:37.507343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:01:37.507343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:01:37.507343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:01:37.507343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:01:37.507343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:01:37.507343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:01:37.507343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:01:37.508194 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:01:37.508194 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:01:37.508194 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:01:37.508194 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:01:37.508194 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 9/19] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:01:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:01:37.508447 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579639c-d13f-4639-ba89-c610a1d19d69 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:37.513175 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094486be-6c00-4509-aa6d-aa22fc297104 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:37.567965 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:37.589198 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:37.608432 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579639c-d13f-4639-ba89-c610a1d19d69 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:37.612759 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094486be-6c00-4509-aa6d-aa22fc297104 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:37.642938 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f97ddb-a52e-44c7-9625-30e06798b3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:37.643586 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f97ddb-a52e-44c7-9625-30e06798b3b8 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:37.643872 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f97ddb-a52e-44c7-9625-30e06798b3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:37.644168 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f97ddb-a52e-44c7-9625-30e06798b3b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:37.645008 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f97ddb-a52e-44c7-9625-30e06798b3b8 None admin] RBAC: Adding query filter params (role.id=bbd5f3e0c18e4992886fcfb4a3feb426, scope.domain.id=default, user.id=31e8e6595d7242a98c3388e4c3784e70) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:01:37.645324 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f97ddb-a52e-44c7-9625-30e06798b3b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:37.645751 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d34b47-2db7-4163-bc14-a3130740abd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:37.646412 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d34b47-2db7-4163-bc14-a3130740abd2 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:37.646709 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d34b47-2db7-4163-bc14-a3130740abd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:37.646793 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f97ddb-a52e-44c7-9625-30e06798b3b8 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:37.646991 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d34b47-2db7-4163-bc14-a3130740abd2 None admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:37.647713 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d34b47-2db7-4163-bc14-a3130740abd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:01:37.648023 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d34b47-2db7-4163-bc14-a3130740abd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:37.649433 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d34b47-2db7-4163-bc14-a3130740abd2 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:37.653831 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 11/20] 10.222.0.61 () {56 vars in 1322 bytes} [Fri Jun 3 13:01:37 2022] GET /identity/v3/role_assignments?user.id=31e8e6595d7242a98c3388e4c3784e70&scope.domain.id=default&role.id=bbd5f3e0c18e4992886fcfb4a3feb426 => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:01:37.668889 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 10/21] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:01:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:01:40.176027 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a0bfc-474d-4258-b52d-93631f18285b None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:40.177066 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a0bfc-474d-4258-b52d-93631f18285b None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:40.177582 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a0bfc-474d-4258-b52d-93631f18285b None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:40.179148 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 12/22] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:01:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:01:40.184524 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3259a-b26a-42f2-9e39-4b90005572b0 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:40.184916 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3259a-b26a-42f2-9e39-4b90005572b0 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:40.185088 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3259a-b26a-42f2-9e39-4b90005572b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:40.209679 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-9be3259a-b26a-42f2-9e39-4b90005572b0 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:01:40.210928 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-9be3259a-b26a-42f2-9e39-4b90005572b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:01:40.317275 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 11/23] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:01:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:01:40.351200 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a0bfc-474d-4258-b52d-93631f18285b None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:40.509892 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a0bfc-474d-4258-b52d-93631f18285b None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:40.555229 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac2def3-4652-47e7-ab00-353a6a00d6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:40.556424 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2def3-4652-47e7-ab00-353a6a00d6e9 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:40.556905 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2def3-4652-47e7-ab00-353a6a00d6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:40.557384 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2def3-4652-47e7-ab00-353a6a00d6e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:40.569493 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac2def3-4652-47e7-ab00-353a6a00d6e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:01:40.577179 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-7ac2def3-4652-47e7-ab00-353a6a00d6e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:01:40.577179 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:01:40.577179 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:01:40.577179 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:01:40.577179 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:01:40.577179 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:01:40.577179 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:01:40.577179 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:01:40.577179 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:01:40.577179 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:01:40.577179 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:01:40.577179 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:01:40.577179 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:01:40.577179 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:01:40.577179 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:01:40.577179 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:01:40.578000 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:01:40.578000 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:01:40.578000 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:01:40.578000 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:01:40.578000 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:01:40.578000 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:01:40.578000 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:01:40.578000 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:01:40.578000 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:01:40.578000 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:01:40.578000 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:01:40.578000 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:01:40.578000 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:01:40.578000 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:01:40.578000 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:01:40.578000 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:01:40.578746 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:01:40.578746 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:01:40.578746 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:01:40.578746 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:01:40.578746 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:01:40.578746 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:01:40.578746 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:01:40.578746 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:01:40.578746 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:01:40.578746 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:01:40.578746 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:01:40.578746 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:01:40.578746 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 13/24] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 13:01:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:01:40.585223 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be3259a-b26a-42f2-9e39-4b90005572b0 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:40.648550 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f937b4-b20e-4431-a807-b427f1d73422 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:40.648872 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f937b4-b20e-4431-a807-b427f1d73422 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:40.649113 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f937b4-b20e-4431-a807-b427f1d73422 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:40.650675 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 14/25] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 13:01:40.656039 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb58a9d-2ed8-4984-8815-eee7968dbd99 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:40.656590 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb58a9d-2ed8-4984-8815-eee7968dbd99 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:40.657087 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb58a9d-2ed8-4984-8815-eee7968dbd99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:40.658591 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:40.669483 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:40.685287 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-eeb58a9d-2ed8-4984-8815-eee7968dbd99 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:01:40.686522 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-eeb58a9d-2ed8-4984-8815-eee7968dbd99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:01:40.771152 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be3259a-b26a-42f2-9e39-4b90005572b0 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:40.841674 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043048b-c1c2-4c5f-bbd4-8763e15bf46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:40.842286 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043048b-c1c2-4c5f-bbd4-8763e15bf46e None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:40.842578 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043048b-c1c2-4c5f-bbd4-8763e15bf46e None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:40.842861 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043048b-c1c2-4c5f-bbd4-8763e15bf46e None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:40.843939 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9043048b-c1c2-4c5f-bbd4-8763e15bf46e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:01:40.844293 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9043048b-c1c2-4c5f-bbd4-8763e15bf46e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:40.847183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9043048b-c1c2-4c5f-bbd4-8763e15bf46e None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:40.863171 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 15/26] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:01:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 13:01:40.869320 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 12/27] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:01:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:01:40.875251 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb58a9d-2ed8-4984-8815-eee7968dbd99 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:40.904253 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043048b-c1c2-4c5f-bbd4-8763e15bf46e None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:41.033982 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043048b-c1c2-4c5f-bbd4-8763e15bf46e None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:41.044377 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:41.073985 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a13bde1-2fc4-4eac-be3d-c1d51d82457e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:41.074941 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13bde1-2fc4-4eac-be3d-c1d51d82457e None admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:41.075391 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13bde1-2fc4-4eac-be3d-c1d51d82457e None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:41.075823 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13bde1-2fc4-4eac-be3d-c1d51d82457e None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:41.076769 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a13bde1-2fc4-4eac-be3d-c1d51d82457e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:41.078360 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb58a9d-2ed8-4984-8815-eee7968dbd99 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:41.078499 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a13bde1-2fc4-4eac-be3d-c1d51d82457e None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:41.142106 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97510114-99d7-4557-88e6-fc69e6a77471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:41.142631 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97510114-99d7-4557-88e6-fc69e6a77471 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:41.142929 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97510114-99d7-4557-88e6-fc69e6a77471 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:41.143210 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97510114-99d7-4557-88e6-fc69e6a77471 None admin] PATH_INFO: `/v3/users/31e8e6595d7242a98c3388e4c3784e70` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:41.144446 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97510114-99d7-4557-88e6-fc69e6a77471 None admin] RBAC: Authorizing `identity:get_user(user_id=31e8e6595d7242a98c3388e4c3784e70)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:41.145915 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97510114-99d7-4557-88e6-fc69e6a77471 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:41.147983 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 16/28] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 13:01:40 2022] GET /identity/v3/users/31e8e6595d7242a98c3388e4c3784e70 => generated 247 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:01:41.153126 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97510114-99d7-4557-88e6-fc69e6a77471 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:41.156000 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:41.282035 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97510114-99d7-4557-88e6-fc69e6a77471 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:41.333023 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652a7c4-4093-4235-b846-841984c54dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:41.333832 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652a7c4-4093-4235-b846-841984c54dea None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:41.334114 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652a7c4-4093-4235-b846-841984c54dea None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:41.334390 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652a7c4-4093-4235-b846-841984c54dea None admin] PATH_INFO: `/v3/domains/default` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:41.335657 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652a7c4-4093-4235-b846-841984c54dea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:41.337196 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652a7c4-4093-4235-b846-841984c54dea None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:41.338917 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 17/29] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:01:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:01:41.340326 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74056e3d-e58a-41c0-99a6-2a06f14a4fdb None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:41.340615 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74056e3d-e58a-41c0-99a6-2a06f14a4fdb None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:41.340890 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74056e3d-e58a-41c0-99a6-2a06f14a4fdb None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:41.342203 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 18/30] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:01:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:01:41.343311 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4495eed-7264-45cc-9e4a-438a7acc67d8 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:41.343598 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4495eed-7264-45cc-9e4a-438a7acc67d8 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:41.344260 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4495eed-7264-45cc-9e4a-438a7acc67d8 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:41.346472 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 19/31] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:01:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:01:41.347428 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4495eed-7264-45cc-9e4a-438a7acc67d8 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:41.371655 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 13/32] 10.222.0.61 () {60 vars in 1131 bytes} [Fri Jun 3 13:01:40 2022] POST /identity/v3/roles => generated 219 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:01:41.373750 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c156c-af21-4fd5-ab92-442e109be91a None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:41.374047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c156c-af21-4fd5-ab92-442e109be91a None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:41.374331 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c156c-af21-4fd5-ab92-442e109be91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:41.409254 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-a43c156c-af21-4fd5-ab92-442e109be91a None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:01:41.411920 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-a43c156c-af21-4fd5-ab92-442e109be91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:01:41.488043 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:41.562938 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4495eed-7264-45cc-9e4a-438a7acc67d8 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:41.567008 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 14/33] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:01:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:01:41.569445 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f1f61-2254-439f-b5d5-dfe02f9db6d1 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:41.569738 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f1f61-2254-439f-b5d5-dfe02f9db6d1 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:41.570018 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f1f61-2254-439f-b5d5-dfe02f9db6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:41.589230 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-350f1f61-2254-439f-b5d5-dfe02f9db6d1 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:01:41.590430 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-350f1f61-2254-439f-b5d5-dfe02f9db6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:01:41.629620 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bcc047-6d94-4d9b-a01c-c67833ac3545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:41.630533 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bcc047-6d94-4d9b-a01c-c67833ac3545 None admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:41.630817 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bcc047-6d94-4d9b-a01c-c67833ac3545 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:41.631097 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bcc047-6d94-4d9b-a01c-c67833ac3545 None admin] PATH_INFO: `/v3/domains/default/users/31e8e6595d7242a98c3388e4c3784e70/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:41.633764 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bcc047-6d94-4d9b-a01c-c67833ac3545 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=31e8e6595d7242a98c3388e4c3784e70, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:41.635280 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bcc047-6d94-4d9b-a01c-c67833ac3545 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:41.688328 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 15/34] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:01:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:01:41.688328 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f1f61-2254-439f-b5d5-dfe02f9db6d1 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:41.727354 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:41.803720 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f1f61-2254-439f-b5d5-dfe02f9db6d1 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:41.834556 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 20/35] 10.222.0.61 () {58 vars in 1361 bytes} [Fri Jun 3 13:01:41 2022] PUT /identity/v3/domains/default/users/31e8e6595d7242a98c3388e4c3784e70/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:01:41.835870 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bcc047-6d94-4d9b-a01c-c67833ac3545 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:41.849726 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7408f9f4-228b-410b-8740-f926ed90e269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:41.850556 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408f9f4-228b-410b-8740-f926ed90e269 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:41.850843 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408f9f4-228b-410b-8740-f926ed90e269 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:41.851226 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408f9f4-228b-410b-8740-f926ed90e269 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:41.863985 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7408f9f4-228b-410b-8740-f926ed90e269 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:41.868374 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7408f9f4-228b-410b-8740-f926ed90e269 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:41.895389 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-7408f9f4-228b-410b-8740-f926ed90e269 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:01:41.895389 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:01:41.895389 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:01:41.895389 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:01:41.895389 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:01:41.895389 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:01:41.895389 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:01:41.895389 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:01:41.895389 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:01:41.895389 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:01:41.895389 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:01:41.895389 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:01:41.895389 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:01:41.895389 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:01:41.895389 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:01:41.896469 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:01:41.896469 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:01:41.896469 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:01:41.896469 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:01:41.896469 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:01:41.896469 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:01:41.896469 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:01:41.896469 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:01:41.896469 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:01:41.896469 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:01:41.896469 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:01:41.896469 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:01:41.896469 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:01:41.896469 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:01:41.896469 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:01:41.896469 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:01:41.896469 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:01:41.897327 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:01:41.897327 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:01:41.897327 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:01:41.897327 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:01:41.897327 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 16/36] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:01:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:01:41.898283 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847df670-a0d7-45f4-96c0-43e3f7aa80ca None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:41.898551 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847df670-a0d7-45f4-96c0-43e3f7aa80ca None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:41.898832 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847df670-a0d7-45f4-96c0-43e3f7aa80ca None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:41.900181 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 17/37] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:01:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:01:41.905289 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847df670-a0d7-45f4-96c0-43e3f7aa80ca None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:41.978975 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bcc047-6d94-4d9b-a01c-c67833ac3545 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:42.010586 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:42.020482 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:42.027455 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976b30a-9164-43e2-80a6-cf7aa5e51ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:42.028092 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976b30a-9164-43e2-80a6-cf7aa5e51ea0 None admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:42.028419 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976b30a-9164-43e2-80a6-cf7aa5e51ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:42.028707 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976b30a-9164-43e2-80a6-cf7aa5e51ea0 None admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:42.029552 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5976b30a-9164-43e2-80a6-cf7aa5e51ea0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:42.031216 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5976b30a-9164-43e2-80a6-cf7aa5e51ea0 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:42.033799 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847df670-a0d7-45f4-96c0-43e3f7aa80ca None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:42.073392 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb42564-ab3c-415a-aedc-3b352254780e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:42.074062 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb42564-ab3c-415a-aedc-3b352254780e None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:42.074349 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb42564-ab3c-415a-aedc-3b352254780e None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:42.074629 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb42564-ab3c-415a-aedc-3b352254780e None admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:42.075360 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb42564-ab3c-415a-aedc-3b352254780e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:01:42.075665 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb42564-ab3c-415a-aedc-3b352254780e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:42.077085 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb42564-ab3c-415a-aedc-3b352254780e None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:42.090721 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 18/38] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:01:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:01:42.091805 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ccd80-5a09-4cd5-95ef-956e132faf7e None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:42.092096 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ccd80-5a09-4cd5-95ef-956e132faf7e None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:42.092403 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ccd80-5a09-4cd5-95ef-956e132faf7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:42.097131 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 21/39] 10.222.0.61 () {60 vars in 1131 bytes} [Fri Jun 3 13:01:41 2022] POST /identity/v3/roles => generated 225 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:01:42.098830 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46679eb5-9597-43c0-ad7c-25d267b284e7 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:42.104099 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46679eb5-9597-43c0-ad7c-25d267b284e7 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:42.104099 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46679eb5-9597-43c0-ad7c-25d267b284e7 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:42.104099 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 22/40] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:01:42.105787 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46679eb5-9597-43c0-ad7c-25d267b284e7 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:42.111121 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-831ccd80-5a09-4cd5-95ef-956e132faf7e None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:01:42.112524 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-831ccd80-5a09-4cd5-95ef-956e132faf7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:01:42.193186 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 19/41] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:01:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:01:42.194643 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7f5b7-187b-4257-adfd-4043c56a18de None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:42.194932 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7f5b7-187b-4257-adfd-4043c56a18de None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:42.195212 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7f5b7-187b-4257-adfd-4043c56a18de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:42.213773 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-b6e7f5b7-187b-4257-adfd-4043c56a18de None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:01:42.214983 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-b6e7f5b7-187b-4257-adfd-4043c56a18de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:01:42.252909 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46679eb5-9597-43c0-ad7c-25d267b284e7 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:42.294093 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:42.295251 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639997e-90ac-4d1c-b8cb-f8a03f458d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:42.295982 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639997e-90ac-4d1c-b8cb-f8a03f458d28 None admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:42.296292 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639997e-90ac-4d1c-b8cb-f8a03f458d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:42.296627 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639997e-90ac-4d1c-b8cb-f8a03f458d28 None admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:42.297352 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b639997e-90ac-4d1c-b8cb-f8a03f458d28 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:42.299885 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b639997e-90ac-4d1c-b8cb-f8a03f458d28 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:42.300831 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 20/42] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:01:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:01:42.301614 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7f5b7-187b-4257-adfd-4043c56a18de None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:42.417062 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 23/43] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Jun 3 13:01:42 2022] POST /identity/v3/projects => generated 301 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:01:42.424418 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639997e-90ac-4d1c-b8cb-f8a03f458d28 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:42.426808 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7f5b7-187b-4257-adfd-4043c56a18de None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:42.484860 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd5ca7-0c38-4e3a-8d95-af44c6b723aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:42.485674 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd5ca7-0c38-4e3a-8d95-af44c6b723aa None admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:42.486054 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd5ca7-0c38-4e3a-8d95-af44c6b723aa None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:42.486288 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:42.486400 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd5ca7-0c38-4e3a-8d95-af44c6b723aa None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:42.487280 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd5ca7-0c38-4e3a-8d95-af44c6b723aa None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:42.489622 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd5ca7-0c38-4e3a-8d95-af44c6b723aa None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:42.552221 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639997e-90ac-4d1c-b8cb-f8a03f458d28 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:42.575049 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 21/44] 10.222.0.61 () {60 vars in 1131 bytes} [Fri Jun 3 13:01:42 2022] POST /identity/v3/roles => generated 223 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:01:42.598749 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4135a52-e82a-4157-97e0-c840c2afbc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:42.600057 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4135a52-e82a-4157-97e0-c840c2afbc39 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:42.600645 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4135a52-e82a-4157-97e0-c840c2afbc39 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:42.601118 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4135a52-e82a-4157-97e0-c840c2afbc39 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:42.602791 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4135a52-e82a-4157-97e0-c840c2afbc39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:42.604662 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4135a52-e82a-4157-97e0-c840c2afbc39 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:42.606909 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 24/45] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:01:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:01:42.617409 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd5ca7-0c38-4e3a-8d95-af44c6b723aa None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:42.698783 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:42.746248 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd5ca7-0c38-4e3a-8d95-af44c6b723aa None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:42.782813 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca4a99-0f1f-43e5-b89d-ba9497959051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:42.783431 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca4a99-0f1f-43e5-b89d-ba9497959051 None admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:42.783720 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca4a99-0f1f-43e5-b89d-ba9497959051 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:42.783990 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca4a99-0f1f-43e5-b89d-ba9497959051 None admin] PATH_INFO: `/v3/projects` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:42.784991 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca4a99-0f1f-43e5-b89d-ba9497959051 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:42.786433 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca4a99-0f1f-43e5-b89d-ba9497959051 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:42.875575 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 22/46] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Jun 3 13:01:42 2022] POST /identity/v3/projects => generated 312 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:01:44.146712 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3a8f1-c924-44f3-bdfa-b239f95bbb94 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:44.147228 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3a8f1-c924-44f3-bdfa-b239f95bbb94 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:44.147333 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3a8f1-c924-44f3-bdfa-b239f95bbb94 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:44.148683 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 25/47] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:01:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:01:44.154132 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01556f3-e125-4bee-a6ba-66ef2afff7d1 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:44.154555 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01556f3-e125-4bee-a6ba-66ef2afff7d1 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:44.154700 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01556f3-e125-4bee-a6ba-66ef2afff7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:44.171135 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-a01556f3-e125-4bee-a6ba-66ef2afff7d1 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:01:44.172378 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-a01556f3-e125-4bee-a6ba-66ef2afff7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:01:44.238960 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 23/48] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:01:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:01:44.262261 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3a8f1-c924-44f3-bdfa-b239f95bbb94 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:44.362660 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3a8f1-c924-44f3-bdfa-b239f95bbb94 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:44.373010 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:44.395720 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b87354-a2fc-4c42-bf3c-fbcf8a8e6bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:44.396546 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b87354-a2fc-4c42-bf3c-fbcf8a8e6bed None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:44.396834 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b87354-a2fc-4c42-bf3c-fbcf8a8e6bed None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:44.397112 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b87354-a2fc-4c42-bf3c-fbcf8a8e6bed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:44.407548 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b87354-a2fc-4c42-bf3c-fbcf8a8e6bed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:01:44.415199 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-44b87354-a2fc-4c42-bf3c-fbcf8a8e6bed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:01:44.415199 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:01:44.415199 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:01:44.415199 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:01:44.415199 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:01:44.415199 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:01:44.415199 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:01:44.415199 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:01:44.415199 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:01:44.415199 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:01:44.415199 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:01:44.415199 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:01:44.415199 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:01:44.415199 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:01:44.415199 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:01:44.415199 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:01:44.416236 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:01:44.416236 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:01:44.416236 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:01:44.416236 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:01:44.416236 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:01:44.416236 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:01:44.416236 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:01:44.416236 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:01:44.416236 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:01:44.416236 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:01:44.416236 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:01:44.416236 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:01:44.416236 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:01:44.416236 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:01:44.416236 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:01:44.416236 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:01:44.417050 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:01:44.417050 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:01:44.417050 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:01:44.417050 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:01:44.417050 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:01:44.417050 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:01:44.417050 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:01:44.417050 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:01:44.417050 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:01:44.417050 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:01:44.417050 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:01:44.417050 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:01:44.417050 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 26/49] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 13:01:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:01:44.422300 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01556f3-e125-4bee-a6ba-66ef2afff7d1 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:44.465266 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:44.521344 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01556f3-e125-4bee-a6ba-66ef2afff7d1 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:44.555749 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb15a2-8077-4355-a9f3-6b0593e76f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:44.556445 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb15a2-8077-4355-a9f3-6b0593e76f37 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:44.556727 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb15a2-8077-4355-a9f3-6b0593e76f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:44.557005 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb15a2-8077-4355-a9f3-6b0593e76f37 None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:44.557751 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb15a2-8077-4355-a9f3-6b0593e76f37 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:01:44.558057 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb15a2-8077-4355-a9f3-6b0593e76f37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:44.559427 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb15a2-8077-4355-a9f3-6b0593e76f37 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:44.567772 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 24/50] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:01:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:01:44.573230 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b87354-a2fc-4c42-bf3c-fbcf8a8e6bed None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:44.670509 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b87354-a2fc-4c42-bf3c-fbcf8a8e6bed None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:44.703662 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50128028-b7e6-457c-85c8-cdfcdb52f4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:44.704615 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50128028-b7e6-457c-85c8-cdfcdb52f4bf None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:44.704900 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50128028-b7e6-457c-85c8-cdfcdb52f4bf None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:44.705181 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50128028-b7e6-457c-85c8-cdfcdb52f4bf None admin] PATH_INFO: `/v3/users/31e8e6595d7242a98c3388e4c3784e70` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:44.706375 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50128028-b7e6-457c-85c8-cdfcdb52f4bf None admin] RBAC: Authorizing `identity:get_user(user_id=31e8e6595d7242a98c3388e4c3784e70)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:44.707842 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50128028-b7e6-457c-85c8-cdfcdb52f4bf None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:44.709546 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 27/51] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 13:01:44 2022] GET /identity/v3/users/31e8e6595d7242a98c3388e4c3784e70 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:01:44.714879 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb15a2-8077-4355-a9f3-6b0593e76f37 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:44.816648 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb15a2-8077-4355-a9f3-6b0593e76f37 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:44.819250 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:44.852936 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebbc37-daaa-48c4-b70e-d80305f9cd11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:44.853731 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebbc37-daaa-48c4-b70e-d80305f9cd11 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:44.854015 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebbc37-daaa-48c4-b70e-d80305f9cd11 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:44.854290 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebbc37-daaa-48c4-b70e-d80305f9cd11 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:44.855472 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ebbc37-daaa-48c4-b70e-d80305f9cd11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:44.856944 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ebbc37-daaa-48c4-b70e-d80305f9cd11 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:44.858559 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 25/52] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:01:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:01:44.864246 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50128028-b7e6-457c-85c8-cdfcdb52f4bf None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:44.905997 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:44.964916 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50128028-b7e6-457c-85c8-cdfcdb52f4bf None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:45.002426 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b4eb11-5c59-4849-9f6c-3ee08ac98c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:45.003091 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4eb11-5c59-4849-9f6c-3ee08ac98c4d None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:45.003380 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4eb11-5c59-4849-9f6c-3ee08ac98c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:45.003660 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4eb11-5c59-4849-9f6c-3ee08ac98c4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:45.004524 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b4eb11-5c59-4849-9f6c-3ee08ac98c4d None admin] RBAC: Adding query filter params (role.id=bbd5f3e0c18e4992886fcfb4a3feb426, scope.domain.id=default, user.id=31e8e6595d7242a98c3388e4c3784e70) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:01:45.004843 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b4eb11-5c59-4849-9f6c-3ee08ac98c4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:45.006310 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b4eb11-5c59-4849-9f6c-3ee08ac98c4d None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:45.012363 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 28/53] 10.222.0.61 () {56 vars in 1322 bytes} [Fri Jun 3 13:01:44 2022] GET /identity/v3/role_assignments?user.id=31e8e6595d7242a98c3388e4c3784e70&scope.domain.id=default&role.id=bbd5f3e0c18e4992886fcfb4a3feb426 => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:01:45.149724 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e6ef4-1c64-4928-846b-b9abc31b8951 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:45.149923 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e6ef4-1c64-4928-846b-b9abc31b8951 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:45.150205 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e6ef4-1c64-4928-846b-b9abc31b8951 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:45.151609 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 26/54] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:01:45.158422 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40980b92-bd2c-4383-b920-5f5e9451137f None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:45.158943 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40980b92-bd2c-4383-b920-5f5e9451137f None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:45.159060 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40980b92-bd2c-4383-b920-5f5e9451137f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:45.176875 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-40980b92-bd2c-4383-b920-5f5e9451137f None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:01:45.178538 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-40980b92-bd2c-4383-b920-5f5e9451137f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:01:45.248522 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 29/55] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:01:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:01:45.273105 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e6ef4-1c64-4928-846b-b9abc31b8951 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:45.372887 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e6ef4-1c64-4928-846b-b9abc31b8951 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:45.405270 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89151bc-86d1-4088-8b14-84760dbcce66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:45.405989 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89151bc-86d1-4088-8b14-84760dbcce66 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:45.406270 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89151bc-86d1-4088-8b14-84760dbcce66 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:45.406542 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89151bc-86d1-4088-8b14-84760dbcce66 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:45.407812 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89151bc-86d1-4088-8b14-84760dbcce66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:45.409278 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89151bc-86d1-4088-8b14-84760dbcce66 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:45.410866 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 27/56] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:01:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:01:45.416410 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40980b92-bd2c-4383-b920-5f5e9451137f None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:45.445808 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:45.511482 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40980b92-bd2c-4383-b920-5f5e9451137f None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:45.543900 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5621b9a-51ec-4e6c-911c-7fdffe498f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:45.544567 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5621b9a-51ec-4e6c-911c-7fdffe498f86 None admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:45.544850 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5621b9a-51ec-4e6c-911c-7fdffe498f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:45.545123 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5621b9a-51ec-4e6c-911c-7fdffe498f86 None admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:45.545809 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5621b9a-51ec-4e6c-911c-7fdffe498f86 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:45.547254 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5621b9a-51ec-4e6c-911c-7fdffe498f86 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:45.651045 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 30/57] 10.222.0.61 () {60 vars in 1140 bytes} [Fri Jun 3 13:01:45 2022] POST /identity/v3/projects => generated 298 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:01:47.882301 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9fdfc-3628-4387-a34e-522909e88efc None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:47.882850 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9fdfc-3628-4387-a34e-522909e88efc None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:47.882850 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9fdfc-3628-4387-a34e-522909e88efc None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:47.884289 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 28/58] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:01:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:01:47.889424 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21acc85-8a96-45dd-bc1e-14fcd7141a9e None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:47.889801 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21acc85-8a96-45dd-bc1e-14fcd7141a9e None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:47.890007 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21acc85-8a96-45dd-bc1e-14fcd7141a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:47.907366 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-f21acc85-8a96-45dd-bc1e-14fcd7141a9e None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:01:47.908816 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-f21acc85-8a96-45dd-bc1e-14fcd7141a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:01:47.974924 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 31/59] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:01:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:01:47.999675 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b9fdfc-3628-4387-a34e-522909e88efc None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:48.044606 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:48.103548 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b9fdfc-3628-4387-a34e-522909e88efc None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:48.136913 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cbb00f-d061-4bbf-83cd-9d05d039567e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:48.137633 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cbb00f-d061-4bbf-83cd-9d05d039567e None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:48.137916 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cbb00f-d061-4bbf-83cd-9d05d039567e None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:48.138197 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cbb00f-d061-4bbf-83cd-9d05d039567e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:48.139367 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cbb00f-d061-4bbf-83cd-9d05d039567e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:48.140829 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cbb00f-d061-4bbf-83cd-9d05d039567e None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:48.142749 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 29/60] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:01:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:01:48.148310 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21acc85-8a96-45dd-bc1e-14fcd7141a9e None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:48.163275 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:48.246636 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21acc85-8a96-45dd-bc1e-14fcd7141a9e None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:48.279365 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f86ea37-5340-484c-82d9-610cc80c2da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:48.280026 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86ea37-5340-484c-82d9-610cc80c2da6 None admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:48.280339 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86ea37-5340-484c-82d9-610cc80c2da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:48.280619 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86ea37-5340-484c-82d9-610cc80c2da6 None admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:48.281317 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f86ea37-5340-484c-82d9-610cc80c2da6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:48.283620 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f86ea37-5340-484c-82d9-610cc80c2da6 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:48.376292 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 32/61] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jun 3 13:01:48 2022] POST /identity/v3/users => generated 275 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:01:51.698683 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4d3d6-3872-468d-a183-f8072a491284 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:51.699697 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4d3d6-3872-468d-a183-f8072a491284 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:51.700218 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4d3d6-3872-468d-a183-f8072a491284 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:51.702027 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 30/62] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:01:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:01:51.708865 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbeb2f-ecf4-4bc0-9d61-ddee932988cf None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:51.709977 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbeb2f-ecf4-4bc0-9d61-ddee932988cf None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:51.710528 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbeb2f-ecf4-4bc0-9d61-ddee932988cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:51.731965 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-facbeb2f-ecf4-4bc0-9d61-ddee932988cf None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:01:51.737879 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-facbeb2f-ecf4-4bc0-9d61-ddee932988cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:01:51.824861 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:51.830586 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 33/63] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:01:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:01:51.865332 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4d3d6-3872-468d-a183-f8072a491284 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:51.993697 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d0413-ef0d-45cf-b680-9d6722802af6 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:51.994029 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d0413-ef0d-45cf-b680-9d6722802af6 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:51.994262 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d0413-ef0d-45cf-b680-9d6722802af6 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:51.996001 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 34/64] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:01:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:01:52.006445 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29c339-4bac-46d9-8e00-7170ff072ccd None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:52.006761 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29c339-4bac-46d9-8e00-7170ff072ccd None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:52.007015 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29c339-4bac-46d9-8e00-7170ff072ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:52.025399 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4d3d6-3872-468d-a183-f8072a491284 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:52.035808 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:52.053579 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-8d29c339-4bac-46d9-8e00-7170ff072ccd None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:01:52.054871 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-8d29c339-4bac-46d9-8e00-7170ff072ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:01:52.067856 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c1b71-53ee-4eb5-a630-04fbc731d133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:52.068715 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c1b71-53ee-4eb5-a630-04fbc731d133 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:52.068997 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c1b71-53ee-4eb5-a630-04fbc731d133 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:52.069272 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c1b71-53ee-4eb5-a630-04fbc731d133 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:52.082493 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212c1b71-53ee-4eb5-a630-04fbc731d133 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:01:52.091741 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-212c1b71-53ee-4eb5-a630-04fbc731d133 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 13:01:52.091741 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:01:52.091741 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:01:52.091741 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:01:52.091741 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:01:52.091741 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:01:52.091741 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:01:52.091741 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:01:52.091741 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:01:52.091741 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:01:52.091741 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:01:52.091741 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:01:52.091741 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:01:52.091741 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:01:52.091741 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:01:52.091741 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:01:52.092626 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:01:52.092626 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:01:52.092626 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:01:52.092626 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:01:52.092626 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:01:52.092626 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:01:52.092626 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:01:52.092626 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:01:52.092626 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:01:52.092626 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:01:52.092626 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:01:52.092626 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:01:52.092626 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:01:52.092626 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:01:52.092626 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:01:52.092626 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:01:52.093397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:01:52.093397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:01:52.093397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:01:52.093397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:01:52.093397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:01:52.093397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:01:52.093397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:01:52.093397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:01:52.093397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:01:52.093397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:01:52.093397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 13:01:52.093397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:01:52.093397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 31/65] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:01:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:01:52.101081 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c1b71-53ee-4eb5-a630-04fbc731d133 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:52.206494 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 35/66] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:01:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 13:01:52.207912 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebfefd-fdbf-4053-b669-e5788143bdef None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:52.208230 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebfefd-fdbf-4053-b669-e5788143bdef None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:52.208512 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebfefd-fdbf-4053-b669-e5788143bdef None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:52.210173 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 36/67] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:01:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:01:52.215538 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465c946-561d-4c2a-8402-8d4379825e13 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:52.215831 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465c946-561d-4c2a-8402-8d4379825e13 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:52.216111 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465c946-561d-4c2a-8402-8d4379825e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:52.241098 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-4465c946-561d-4c2a-8402-8d4379825e13 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:01:52.242722 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-4465c946-561d-4c2a-8402-8d4379825e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:01:52.268794 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c1b71-53ee-4eb5-a630-04fbc731d133 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:52.304777 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3fce29-31d7-443f-8d68-853a5ee36c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:52.305443 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fce29-31d7-443f-8d68-853a5ee36c1d None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:52.305727 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fce29-31d7-443f-8d68-853a5ee36c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:52.306000 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fce29-31d7-443f-8d68-853a5ee36c1d None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:52.306743 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3fce29-31d7-443f-8d68-853a5ee36c1d None admin] RBAC: Adding query filter params (name=member) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:01:52.307052 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3fce29-31d7-443f-8d68-853a5ee36c1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:52.308447 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3fce29-31d7-443f-8d68-853a5ee36c1d None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:52.317270 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 32/68] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 13:01:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:01:52.317990 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3fce29-31d7-443f-8d68-853a5ee36c1d None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:52.326167 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 37/69] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:01:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 13:01:52.326864 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465c946-561d-4c2a-8402-8d4379825e13 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:52.352254 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:52.390772 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:52.427628 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3fce29-31d7-443f-8d68-853a5ee36c1d None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:52.433279 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465c946-561d-4c2a-8402-8d4379825e13 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:52.465324 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f42f7-3869-4f92-bc1b-b11458ea888c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:52.465751 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a3647-d53e-4e7a-8582-cb790029a992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:52.466111 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f42f7-3869-4f92-bc1b-b11458ea888c None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:52.466392 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f42f7-3869-4f92-bc1b-b11458ea888c None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:52.466614 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a3647-d53e-4e7a-8582-cb790029a992 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:52.466711 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f42f7-3869-4f92-bc1b-b11458ea888c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:52.466896 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a3647-d53e-4e7a-8582-cb790029a992 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:52.467167 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a3647-d53e-4e7a-8582-cb790029a992 None admin] PATH_INFO: `/v3/users/dd10501b4efc4e1584a8886555a4f00a` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:52.477646 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f42f7-3869-4f92-bc1b-b11458ea888c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:01:52.481022 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a3647-d53e-4e7a-8582-cb790029a992 None admin] RBAC: Authorizing `identity:get_user(user_id=dd10501b4efc4e1584a8886555a4f00a)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:52.482482 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a3647-d53e-4e7a-8582-cb790029a992 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:52.484133 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 38/70] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 13:01:52 2022] GET /identity/v3/users/dd10501b4efc4e1584a8886555a4f00a => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:01:52.488763 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-719f42f7-3869-4f92-bc1b-b11458ea888c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:01:52.488763 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:01:52.488763 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:01:52.488763 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:01:52.488763 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:01:52.488763 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:01:52.488763 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:01:52.488763 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:01:52.488763 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:01:52.488763 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:01:52.488763 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:01:52.488763 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:01:52.488763 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:01:52.488763 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:01:52.488763 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:01:52.488763 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:01:52.489585 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:01:52.489585 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:01:52.489585 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:01:52.489585 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:01:52.489585 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:01:52.489585 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:01:52.489585 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:01:52.489585 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:01:52.489585 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:01:52.489585 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:01:52.489585 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:01:52.489585 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:01:52.489585 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:01:52.489585 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:01:52.489585 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:01:52.489585 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:01:52.490343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:01:52.490343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:01:52.490343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:01:52.490343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:01:52.490343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:01:52.490343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:01:52.490343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:01:52.490343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:01:52.490343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:01:52.490343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:01:52.490343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:01:52.490343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:01:52.490908 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f58db-e5cc-424b-966f-20b4c7fbaf21 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:52.490908 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f58db-e5cc-424b-966f-20b4c7fbaf21 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:52.490908 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f58db-e5cc-424b-966f-20b4c7fbaf21 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:52.491085 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 33/71] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 13:01:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:01:52.491148 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 39/72] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:01:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:01:52.491209 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f42f7-3869-4f92-bc1b-b11458ea888c None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:52.491287 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a91ce2-a0f7-43ec-9de3-e375348f8dba None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:52.491287 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a91ce2-a0f7-43ec-9de3-e375348f8dba None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:52.491287 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a91ce2-a0f7-43ec-9de3-e375348f8dba None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:52.491287 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 40/73] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:01:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:01:52.492096 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a91ce2-a0f7-43ec-9de3-e375348f8dba None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:52.582526 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:52.591237 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a91ce2-a0f7-43ec-9de3-e375348f8dba None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:52.595775 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f42f7-3869-4f92-bc1b-b11458ea888c None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:52.609446 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:52.625378 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21df3a-2b07-4711-86f0-4ee1c55aa981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:52.626194 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21df3a-2b07-4711-86f0-4ee1c55aa981 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:52.626519 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21df3a-2b07-4711-86f0-4ee1c55aa981 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:52.626795 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21df3a-2b07-4711-86f0-4ee1c55aa981 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:52.626893 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8daada4-dbf9-4605-84d5-d2c988fef96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:52.627501 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8daada4-dbf9-4605-84d5-d2c988fef96a None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:52.627792 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8daada4-dbf9-4605-84d5-d2c988fef96a None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:52.628068 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8daada4-dbf9-4605-84d5-d2c988fef96a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:52.638810 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f21df3a-2b07-4711-86f0-4ee1c55aa981 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:01:52.647553 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-2f21df3a-2b07-4711-86f0-4ee1c55aa981 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 13:01:52.647553 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:01:52.647553 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:01:52.647553 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:01:52.647553 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:01:52.647553 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:01:52.647553 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:01:52.647553 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:01:52.647553 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:01:52.647553 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:01:52.647553 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:01:52.647553 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:01:52.647553 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:01:52.647553 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:01:52.647553 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:01:52.647553 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:01:52.648484 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:01:52.648484 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:01:52.648484 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:01:52.648484 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:01:52.648484 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:01:52.648484 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:01:52.648484 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:01:52.648484 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:01:52.648484 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:01:52.648484 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:01:52.648484 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:01:52.648484 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:01:52.648484 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:01:52.648484 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:01:52.648484 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:01:52.648484 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:01:52.649570 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:01:52.649570 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:01:52.649570 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:01:52.649570 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:01:52.649570 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:01:52.649570 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:01:52.649570 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:01:52.649570 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:01:52.649570 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:01:52.649570 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:01:52.649570 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 13:01:52.649570 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:01:52.649570 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 34/74] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jun 3 13:01:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:01:52.653524 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa806b23-2602-44c4-affb-1b23ad0a9662 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:52.653964 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa806b23-2602-44c4-affb-1b23ad0a9662 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:52.654248 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa806b23-2602-44c4-affb-1b23ad0a9662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:52.671805 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-aa806b23-2602-44c4-affb-1b23ad0a9662 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:01:52.673149 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-aa806b23-2602-44c4-affb-1b23ad0a9662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:01:52.695345 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8daada4-dbf9-4605-84d5-d2c988fef96a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:52.696848 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8daada4-dbf9-4605-84d5-d2c988fef96a None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:52.748171 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 35/75] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:01:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:01:52.748171 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa806b23-2602-44c4-affb-1b23ad0a9662 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:52.796058 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 41/76] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:01:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 13:01:52.797412 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4644a1a-b824-4bfd-95c8-0708d9c086e6 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:52.797728 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4644a1a-b824-4bfd-95c8-0708d9c086e6 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:52.798068 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4644a1a-b824-4bfd-95c8-0708d9c086e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:52.814505 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-a4644a1a-b824-4bfd-95c8-0708d9c086e6 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:01:52.815713 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-a4644a1a-b824-4bfd-95c8-0708d9c086e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:01:52.830059 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:52.833090 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:52.853978 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa806b23-2602-44c4-affb-1b23ad0a9662 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:52.881864 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 42/77] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:01:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:01:52.882707 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4644a1a-b824-4bfd-95c8-0708d9c086e6 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:52.898466 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b00d6-5e74-4e14-8c2f-77addd94f689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:52.899142 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b00d6-5e74-4e14-8c2f-77addd94f689 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:52.899423 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b00d6-5e74-4e14-8c2f-77addd94f689 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:52.899698 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b00d6-5e74-4e14-8c2f-77addd94f689 None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:52.900468 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b00d6-5e74-4e14-8c2f-77addd94f689 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:01:52.900776 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b00d6-5e74-4e14-8c2f-77addd94f689 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:52.902182 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b00d6-5e74-4e14-8c2f-77addd94f689 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:52.910784 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 36/78] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:01:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:01:52.911585 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b00d6-5e74-4e14-8c2f-77addd94f689 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:52.983909 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4644a1a-b824-4bfd-95c8-0708d9c086e6 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:53.013925 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b00d6-5e74-4e14-8c2f-77addd94f689 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:53.018981 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d1f89e-a2ed-484d-955a-9ddc8feb5fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:53.019654 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1f89e-a2ed-484d-955a-9ddc8feb5fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:53.019940 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1f89e-a2ed-484d-955a-9ddc8feb5fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:53.020251 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1f89e-a2ed-484d-955a-9ddc8feb5fc8 None admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:53.020999 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d1f89e-a2ed-484d-955a-9ddc8feb5fc8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:01:53.021313 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d1f89e-a2ed-484d-955a-9ddc8feb5fc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:53.022720 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d1f89e-a2ed-484d-955a-9ddc8feb5fc8 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:53.030799 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 43/79] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:01:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:01:53.031382 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d1f89e-a2ed-484d-955a-9ddc8feb5fc8 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:53.043448 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:53.048976 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e902c7-92b5-4927-a16a-a506f952ab80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:53.049766 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e902c7-92b5-4927-a16a-a506f952ab80 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:53.050046 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e902c7-92b5-4927-a16a-a506f952ab80 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:53.050326 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e902c7-92b5-4927-a16a-a506f952ab80 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:53.053134 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e902c7-92b5-4927-a16a-a506f952ab80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:53.053134 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e902c7-92b5-4927-a16a-a506f952ab80 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:53.054723 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 37/80] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:01:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:01:53.055626 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e902c7-92b5-4927-a16a-a506f952ab80 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:53.071497 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:53.132292 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d1f89e-a2ed-484d-955a-9ddc8feb5fc8 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:53.155843 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e902c7-92b5-4927-a16a-a506f952ab80 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:53.164459 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61bf27a-c9f1-4175-9227-e12ae70b6d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:53.165324 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61bf27a-c9f1-4175-9227-e12ae70b6d43 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:53.165608 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61bf27a-c9f1-4175-9227-e12ae70b6d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:53.165885 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61bf27a-c9f1-4175-9227-e12ae70b6d43 None admin] PATH_INFO: `/v3/projects/69bee49150564ea3abbe7a2301dea4d8` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:53.167074 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61bf27a-c9f1-4175-9227-e12ae70b6d43 None admin] RBAC: Authorizing `identity:get_project(project_id=69bee49150564ea3abbe7a2301dea4d8)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:53.168574 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61bf27a-c9f1-4175-9227-e12ae70b6d43 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:53.170456 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 44/81] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:01:53 2022] GET /identity/v3/projects/69bee49150564ea3abbe7a2301dea4d8 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:01:53.171025 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61bf27a-c9f1-4175-9227-e12ae70b6d43 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:53.192188 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38258345-4ab7-495a-a4f2-74e16759ca25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:53.193005 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38258345-4ab7-495a-a4f2-74e16759ca25 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:53.193291 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38258345-4ab7-495a-a4f2-74e16759ca25 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:53.193566 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38258345-4ab7-495a-a4f2-74e16759ca25 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:53.203550 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38258345-4ab7-495a-a4f2-74e16759ca25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:01:53.211397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-38258345-4ab7-495a-a4f2-74e16759ca25 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 13:01:53.211397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:01:53.211397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:01:53.211397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:01:53.211397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:01:53.211397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:01:53.211397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:01:53.211397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:01:53.211397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:01:53.211397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:01:53.211397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:01:53.211397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:01:53.211397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:01:53.211397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:01:53.211397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:01:53.211397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:01:53.212319 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:01:53.212319 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:01:53.212319 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:01:53.212319 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:01:53.212319 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:01:53.212319 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:01:53.212319 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:01:53.212319 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:01:53.212319 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:01:53.212319 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:01:53.212319 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:01:53.212319 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:01:53.212319 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:01:53.212319 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:01:53.212319 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:01:53.212319 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:01:53.213094 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:01:53.213094 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:01:53.213094 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:01:53.213094 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:01:53.213094 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:01:53.213094 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:01:53.213094 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:01:53.213094 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:01:53.213094 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:01:53.213094 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:01:53.213094 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 13:01:53.213094 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:01:53.213094 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 38/82] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:01:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:01:53.213738 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38258345-4ab7-495a-a4f2-74e16759ca25 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:53.255185 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:53.277418 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61bf27a-c9f1-4175-9227-e12ae70b6d43 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:53.282700 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:53.311178 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7fd48c-a1e0-4f3d-98ed-b726c0c0c00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:53.312047 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7fd48c-a1e0-4f3d-98ed-b726c0c0c00a None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:53.312362 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7fd48c-a1e0-4f3d-98ed-b726c0c0c00a None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:53.312660 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7fd48c-a1e0-4f3d-98ed-b726c0c0c00a None admin] PATH_INFO: `/v3/users/31e8e6595d7242a98c3388e4c3784e70` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:53.312804 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38258345-4ab7-495a-a4f2-74e16759ca25 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:53.313898 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7fd48c-a1e0-4f3d-98ed-b726c0c0c00a None admin] RBAC: Authorizing `identity:get_user(user_id=31e8e6595d7242a98c3388e4c3784e70)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:53.315370 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7fd48c-a1e0-4f3d-98ed-b726c0c0c00a None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:53.317024 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 45/83] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 13:01:53 2022] GET /identity/v3/users/31e8e6595d7242a98c3388e4c3784e70 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:01:53.317769 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7fd48c-a1e0-4f3d-98ed-b726c0c0c00a None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:53.348500 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a65c87-fb91-47a8-8ae8-4b52c142eec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:53.349373 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a65c87-fb91-47a8-8ae8-4b52c142eec8 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:53.349654 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a65c87-fb91-47a8-8ae8-4b52c142eec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:53.349933 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a65c87-fb91-47a8-8ae8-4b52c142eec8 None admin] PATH_INFO: `/v3/users/dd10501b4efc4e1584a8886555a4f00a` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:53.351362 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a65c87-fb91-47a8-8ae8-4b52c142eec8 None admin] RBAC: Authorizing `identity:get_user(user_id=dd10501b4efc4e1584a8886555a4f00a)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:53.352860 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a65c87-fb91-47a8-8ae8-4b52c142eec8 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:53.354482 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 39/84] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 13:01:53 2022] GET /identity/v3/users/dd10501b4efc4e1584a8886555a4f00a => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:01:53.355251 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a65c87-fb91-47a8-8ae8-4b52c142eec8 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:53.421225 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7fd48c-a1e0-4f3d-98ed-b726c0c0c00a None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:53.455918 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a65c87-fb91-47a8-8ae8-4b52c142eec8 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:53.465510 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd5f62-e2aa-44a3-9dd2-55215e203135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:53.466182 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd5f62-e2aa-44a3-9dd2-55215e203135 None admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:53.466467 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd5f62-e2aa-44a3-9dd2-55215e203135 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:53.466746 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd5f62-e2aa-44a3-9dd2-55215e203135 None admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:53.467448 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd5f62-e2aa-44a3-9dd2-55215e203135 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:53.468931 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd5f62-e2aa-44a3-9dd2-55215e203135 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:53.489246 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261b60a-b987-4a4d-ab39-90918f02621e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:53.489895 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261b60a-b987-4a4d-ab39-90918f02621e None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:53.496221 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261b60a-b987-4a4d-ab39-90918f02621e None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:53.496221 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261b60a-b987-4a4d-ab39-90918f02621e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:53.496221 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261b60a-b987-4a4d-ab39-90918f02621e None admin] RBAC: Adding query filter params (role.id=d082d2b37fd1455ea61819353e8369ed, scope.project.id=69bee49150564ea3abbe7a2301dea4d8, user.id=dd10501b4efc4e1584a8886555a4f00a) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:01:53.496221 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261b60a-b987-4a4d-ab39-90918f02621e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:53.496221 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261b60a-b987-4a4d-ab39-90918f02621e None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:53.502125 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 40/85] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 13:01:53 2022] GET /identity/v3/role_assignments?user.id=dd10501b4efc4e1584a8886555a4f00a&scope.project.id=69bee49150564ea3abbe7a2301dea4d8&role.id=d082d2b37fd1455ea61819353e8369ed => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:01:53.502900 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261b60a-b987-4a4d-ab39-90918f02621e None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:53.505432 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:53.556239 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 46/86] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jun 3 13:01:53 2022] POST /identity/v3/users => generated 289 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:01:53.557436 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd5f62-e2aa-44a3-9dd2-55215e203135 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:53.561039 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:53.654344 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261b60a-b987-4a4d-ab39-90918f02621e None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:53.698159 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd5f62-e2aa-44a3-9dd2-55215e203135 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:53.703576 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964624b-eec2-48ce-a50d-7dcde899ef96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:53.706519 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964624b-eec2-48ce-a50d-7dcde899ef96 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:53.706875 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964624b-eec2-48ce-a50d-7dcde899ef96 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:53.707227 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964624b-eec2-48ce-a50d-7dcde899ef96 None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:53.708070 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964624b-eec2-48ce-a50d-7dcde899ef96 None admin] RBAC: Adding query filter params (name=member) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:01:53.708468 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964624b-eec2-48ce-a50d-7dcde899ef96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:53.710795 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964624b-eec2-48ce-a50d-7dcde899ef96 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:53.724651 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 41/87] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 13:01:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:01:53.725639 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964624b-eec2-48ce-a50d-7dcde899ef96 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:53.755193 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c59f05-cdee-43e6-806a-926d70b59247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:53.756204 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c59f05-cdee-43e6-806a-926d70b59247 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:53.756537 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c59f05-cdee-43e6-806a-926d70b59247 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:53.757115 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c59f05-cdee-43e6-806a-926d70b59247 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:53.817570 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:53.847910 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c59f05-cdee-43e6-806a-926d70b59247 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:53.849557 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c59f05-cdee-43e6-806a-926d70b59247 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:53.851645 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:53.861405 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964624b-eec2-48ce-a50d-7dcde899ef96 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:53.917317 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7c4fd-d07d-4b21-bcea-2b99a71c1d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:53.917977 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7c4fd-d07d-4b21-bcea-2b99a71c1d2f None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:53.918259 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7c4fd-d07d-4b21-bcea-2b99a71c1d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:53.918537 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7c4fd-d07d-4b21-bcea-2b99a71c1d2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:53.975771 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 47/88] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:01:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 13:01:53.976794 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c59f05-cdee-43e6-806a-926d70b59247 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:54.011650 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a7c4fd-d07d-4b21-bcea-2b99a71c1d2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:54.021692 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a7c4fd-d07d-4b21-bcea-2b99a71c1d2f None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:54.112114 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:54.118088 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c59f05-cdee-43e6-806a-926d70b59247 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:54.118088 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:54.153498 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ca75e-4c33-42e8-ab25-f9b5125ed5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:54.154379 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ca75e-4c33-42e8-ab25-f9b5125ed5c6 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:54.154725 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ca75e-4c33-42e8-ab25-f9b5125ed5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:54.155003 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ca75e-4c33-42e8-ab25-f9b5125ed5c6 None admin] PATH_INFO: `/v3/users/dd10501b4efc4e1584a8886555a4f00a` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:54.156386 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ca75e-4c33-42e8-ab25-f9b5125ed5c6 None admin] RBAC: Authorizing `identity:get_user(user_id=dd10501b4efc4e1584a8886555a4f00a)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:54.158691 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ca75e-4c33-42e8-ab25-f9b5125ed5c6 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:54.160386 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 48/89] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 13:01:53 2022] GET /identity/v3/users/dd10501b4efc4e1584a8886555a4f00a => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:01:54.161170 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ca75e-4c33-42e8-ab25-f9b5125ed5c6 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:54.166096 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 42/90] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:01:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 13:01:54.167911 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7c4fd-d07d-4b21-bcea-2b99a71c1d2f None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:54.277473 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ca75e-4c33-42e8-ab25-f9b5125ed5c6 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:54.279988 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7c4fd-d07d-4b21-bcea-2b99a71c1d2f None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:54.314804 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9babf3-efef-4400-ae48-5530e1da694b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:54.315664 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9babf3-efef-4400-ae48-5530e1da694b None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:54.315948 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9babf3-efef-4400-ae48-5530e1da694b None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:54.316253 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9babf3-efef-4400-ae48-5530e1da694b None admin] PATH_INFO: `/v3/projects/69bee49150564ea3abbe7a2301dea4d8` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:54.317448 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9babf3-efef-4400-ae48-5530e1da694b None admin] RBAC: Authorizing `identity:get_project(project_id=69bee49150564ea3abbe7a2301dea4d8)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:54.317555 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec8300-46e3-47f3-9190-5c1ea74b366a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:54.318139 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec8300-46e3-47f3-9190-5c1ea74b366a None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:54.318426 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec8300-46e3-47f3-9190-5c1ea74b366a None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:54.318704 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec8300-46e3-47f3-9190-5c1ea74b366a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:54.318895 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9babf3-efef-4400-ae48-5530e1da694b None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:54.320844 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 49/91] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:01:54 2022] GET /identity/v3/projects/69bee49150564ea3abbe7a2301dea4d8 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:01:54.321503 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9babf3-efef-4400-ae48-5530e1da694b None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:54.357855 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:54.366658 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:54.396783 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec8300-46e3-47f3-9190-5c1ea74b366a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:54.398290 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec8300-46e3-47f3-9190-5c1ea74b366a None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:54.429743 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9babf3-efef-4400-ae48-5530e1da694b None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:54.465632 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd6b001-f6d5-4ff6-b7ef-83590a3ea43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:54.466557 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6b001-f6d5-4ff6-b7ef-83590a3ea43b None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:54.466833 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6b001-f6d5-4ff6-b7ef-83590a3ea43b None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:54.467103 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6b001-f6d5-4ff6-b7ef-83590a3ea43b None admin] PATH_INFO: `/v3/projects/69bee49150564ea3abbe7a2301dea4d8` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:54.468518 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd6b001-f6d5-4ff6-b7ef-83590a3ea43b None admin] RBAC: Authorizing `identity:get_project(project_id=69bee49150564ea3abbe7a2301dea4d8)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:54.470608 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd6b001-f6d5-4ff6-b7ef-83590a3ea43b None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:54.473045 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 50/92] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:01:54 2022] GET /identity/v3/projects/69bee49150564ea3abbe7a2301dea4d8 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:01:54.473836 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd6b001-f6d5-4ff6-b7ef-83590a3ea43b None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:54.511973 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 43/93] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:01:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 13:01:54.512869 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec8300-46e3-47f3-9190-5c1ea74b366a None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:54.584655 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:54.585845 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd6b001-f6d5-4ff6-b7ef-83590a3ea43b None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:54.600818 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:54.620870 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec8300-46e3-47f3-9190-5c1ea74b366a None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:54.653547 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f4a04-d481-4d7c-a6f4-04e8e2a9ff4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:54.654223 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f4a04-d481-4d7c-a6f4-04e8e2a9ff4d None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:54.654514 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f4a04-d481-4d7c-a6f4-04e8e2a9ff4d None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:54.654780 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f4a04-d481-4d7c-a6f4-04e8e2a9ff4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:54.655683 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f4a04-d481-4d7c-a6f4-04e8e2a9ff4d None admin] RBAC: Adding query filter params (role.id=bbd5f3e0c18e4992886fcfb4a3feb426, scope.project.id=69bee49150564ea3abbe7a2301dea4d8, user.id=31e8e6595d7242a98c3388e4c3784e70) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:01:54.655996 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f4a04-d481-4d7c-a6f4-04e8e2a9ff4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:54.657116 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0fabf7-46fe-4cba-934d-70588bbf2997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:54.657595 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f4a04-d481-4d7c-a6f4-04e8e2a9ff4d None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:54.658061 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fabf7-46fe-4cba-934d-70588bbf2997 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:54.658221 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fabf7-46fe-4cba-934d-70588bbf2997 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:54.658365 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fabf7-46fe-4cba-934d-70588bbf2997 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:54.659192 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0fabf7-46fe-4cba-934d-70588bbf2997 None admin] RBAC: Adding query filter params (role.id=7476baf91a50401596c34535d2c79a4f, scope.project.id=69bee49150564ea3abbe7a2301dea4d8, user.id=dd10501b4efc4e1584a8886555a4f00a) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:01:54.659509 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0fabf7-46fe-4cba-934d-70588bbf2997 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:54.661362 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0fabf7-46fe-4cba-934d-70588bbf2997 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:54.668104 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 44/94] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 13:01:54 2022] GET /identity/v3/role_assignments?user.id=dd10501b4efc4e1584a8886555a4f00a&scope.project.id=69bee49150564ea3abbe7a2301dea4d8&role.id=7476baf91a50401596c34535d2c79a4f => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:01:54.668769 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0fabf7-46fe-4cba-934d-70588bbf2997 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:54.671271 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 51/95] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 13:01:54 2022] GET /identity/v3/role_assignments?user.id=31e8e6595d7242a98c3388e4c3784e70&scope.project.id=69bee49150564ea3abbe7a2301dea4d8&role.id=bbd5f3e0c18e4992886fcfb4a3feb426 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:01:54.810459 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0fabf7-46fe-4cba-934d-70588bbf2997 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:54.840854 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:54.849669 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc36f5-46d3-4676-8172-5cbbc4eef99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:54.850581 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc36f5-46d3-4676-8172-5cbbc4eef99b None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:54.850865 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc36f5-46d3-4676-8172-5cbbc4eef99b None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:54.851142 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc36f5-46d3-4676-8172-5cbbc4eef99b None admin] PATH_INFO: `/v3/projects/57abebb6d35f4e5085880bf49a442713` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:54.852538 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc36f5-46d3-4676-8172-5cbbc4eef99b None admin] RBAC: Authorizing `identity:get_project(project_id=57abebb6d35f4e5085880bf49a442713)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:54.854035 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc36f5-46d3-4676-8172-5cbbc4eef99b None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:54.856260 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 45/96] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:01:54 2022] GET /identity/v3/projects/57abebb6d35f4e5085880bf49a442713 => generated 312 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:01:54.862071 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f4a04-d481-4d7c-a6f4-04e8e2a9ff4d None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:54.994387 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f4a04-d481-4d7c-a6f4-04e8e2a9ff4d None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:55.035689 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179716c-371f-4024-9336-fd17ed5d25b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:55.036402 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179716c-371f-4024-9336-fd17ed5d25b1 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:55.036693 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179716c-371f-4024-9336-fd17ed5d25b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:55.036973 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179716c-371f-4024-9336-fd17ed5d25b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:55.037828 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179716c-371f-4024-9336-fd17ed5d25b1 None admin] RBAC: Adding query filter params (role.id=d082d2b37fd1455ea61819353e8369ed, scope.project.id=57abebb6d35f4e5085880bf49a442713, user.id=dd10501b4efc4e1584a8886555a4f00a) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:01:55.038144 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179716c-371f-4024-9336-fd17ed5d25b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:55.039654 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179716c-371f-4024-9336-fd17ed5d25b1 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:55.046762 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 52/97] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 13:01:54 2022] GET /identity/v3/role_assignments?user.id=dd10501b4efc4e1584a8886555a4f00a&scope.project.id=57abebb6d35f4e5085880bf49a442713&role.id=d082d2b37fd1455ea61819353e8369ed => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:01:56.735957 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c091bb2-327c-49c4-9d10-a9f8daf4aa77 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:56.736801 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c091bb2-327c-49c4-9d10-a9f8daf4aa77 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:56.736801 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c091bb2-327c-49c4-9d10-a9f8daf4aa77 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:56.737919 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 46/98] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:01:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:01:56.743996 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f229c-2c1a-4ffa-9dff-34c3bd264799 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:56.744473 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f229c-2c1a-4ffa-9dff-34c3bd264799 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:56.744663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f229c-2c1a-4ffa-9dff-34c3bd264799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:56.762611 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-023f229c-2c1a-4ffa-9dff-34c3bd264799 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:01:56.763805 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-023f229c-2c1a-4ffa-9dff-34c3bd264799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:01:56.795702 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:56.860398 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 53/99] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:01:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:01:56.906173 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c091bb2-327c-49c4-9d10-a9f8daf4aa77 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:57.095193 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c091bb2-327c-49c4-9d10-a9f8daf4aa77 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:57.119052 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a8199-2313-4248-924a-e02cdbc16a43 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:57.121159 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a8199-2313-4248-924a-e02cdbc16a43 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:57.121679 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a8199-2313-4248-924a-e02cdbc16a43 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:57.124041 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 54/100] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:01:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:01:57.133661 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b9329-fa98-44cd-a60a-ade147a79fa0 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:57.133990 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b9329-fa98-44cd-a60a-ade147a79fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:57.134308 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b9329-fa98-44cd-a60a-ade147a79fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:57.170120 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-cb2b9329-fa98-44cd-a60a-ade147a79fa0 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:01:57.171317 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-cb2b9329-fa98-44cd-a60a-ade147a79fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:01:57.174780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9154d5-8aa0-46c3-91ae-d29b9ae6a574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:57.175582 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9154d5-8aa0-46c3-91ae-d29b9ae6a574 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:57.175862 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9154d5-8aa0-46c3-91ae-d29b9ae6a574 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:57.176133 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9154d5-8aa0-46c3-91ae-d29b9ae6a574 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:57.198244 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9154d5-8aa0-46c3-91ae-d29b9ae6a574 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:01:57.210742 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-2a9154d5-8aa0-46c3-91ae-d29b9ae6a574 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 13:01:57.210742 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:01:57.210742 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:01:57.210742 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:01:57.210742 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:01:57.210742 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:01:57.210742 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:01:57.210742 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:01:57.210742 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:01:57.210742 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:01:57.210742 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:01:57.210742 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:01:57.210742 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:01:57.210742 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:01:57.210742 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:01:57.210742 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:01:57.211694 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:01:57.211694 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:01:57.211694 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:01:57.211694 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:01:57.211694 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:01:57.211694 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:01:57.211694 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:01:57.211694 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:01:57.211694 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:01:57.211694 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:01:57.211694 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:01:57.211694 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:01:57.211694 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:01:57.211694 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:01:57.211694 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:01:57.211694 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:01:57.212522 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:01:57.212522 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:01:57.212522 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:01:57.212522 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:01:57.212522 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:01:57.212522 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:01:57.212522 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:01:57.212522 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:01:57.212522 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:01:57.212522 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:01:57.212522 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 13:01:57.212522 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:01:57.213131 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 47/101] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:01:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:01:57.221228 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9154d5-8aa0-46c3-91ae-d29b9ae6a574 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:57.307603 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 55/102] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:01:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:01:57.332519 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:57.356303 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b9329-fa98-44cd-a60a-ade147a79fa0 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:57.403905 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9154d5-8aa0-46c3-91ae-d29b9ae6a574 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:57.466081 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13743fc7-13bc-4af7-a0b8-ea47cc656f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:57.466755 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13743fc7-13bc-4af7-a0b8-ea47cc656f27 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:57.467040 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13743fc7-13bc-4af7-a0b8-ea47cc656f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:57.467311 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13743fc7-13bc-4af7-a0b8-ea47cc656f27 None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:57.468059 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13743fc7-13bc-4af7-a0b8-ea47cc656f27 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:01:57.468385 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13743fc7-13bc-4af7-a0b8-ea47cc656f27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:57.469971 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13743fc7-13bc-4af7-a0b8-ea47cc656f27 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:57.484042 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 48/103] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 13:01:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:01:57.486806 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6b550-b8cf-4e1f-87a1-2867c5238b69 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:57.488452 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6b550-b8cf-4e1f-87a1-2867c5238b69 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:57.489550 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6b550-b8cf-4e1f-87a1-2867c5238b69 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:57.493149 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 49/104] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:01:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:01:57.494091 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6b550-b8cf-4e1f-87a1-2867c5238b69 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:57.519391 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:57.530826 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b9329-fa98-44cd-a60a-ade147a79fa0 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:57.597845 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd6fe2a-b9dd-475f-a8ea-a0612c94d61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:57.598573 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6fe2a-b9dd-475f-a8ea-a0612c94d61e None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:57.598859 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6fe2a-b9dd-475f-a8ea-a0612c94d61e None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:57.599138 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6fe2a-b9dd-475f-a8ea-a0612c94d61e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:57.619546 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd6fe2a-b9dd-475f-a8ea-a0612c94d61e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:01:57.636803 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-2fd6fe2a-b9dd-475f-a8ea-a0612c94d61e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 13:01:57.636803 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:01:57.636803 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:01:57.636803 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:01:57.636803 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:01:57.636803 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:01:57.636803 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:01:57.636803 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:01:57.636803 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:01:57.636803 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:01:57.636803 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:01:57.636803 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:01:57.636803 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:01:57.636803 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:01:57.636803 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:01:57.636803 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:01:57.637681 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:01:57.637681 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:01:57.637681 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:01:57.637681 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:01:57.637681 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:01:57.637681 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:01:57.637681 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:01:57.637681 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:01:57.637681 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:01:57.637681 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:01:57.637681 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:01:57.637681 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:01:57.637681 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:01:57.637681 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:01:57.637681 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:01:57.637681 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:01:57.638432 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:01:57.638432 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:01:57.638432 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:01:57.638432 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:01:57.638432 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:01:57.638432 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:01:57.638432 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:01:57.638432 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:01:57.638432 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:01:57.638432 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:01:57.638432 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 13:01:57.638432 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:01:57.643421 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 56/105] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:01:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:01:57.649662 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b145b1-96c6-402f-8634-e3990f3342d7 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:57.650302 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b145b1-96c6-402f-8634-e3990f3342d7 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:57.652238 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b145b1-96c6-402f-8634-e3990f3342d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:57.681771 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-39b145b1-96c6-402f-8634-e3990f3342d7 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:01:57.683920 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-39b145b1-96c6-402f-8634-e3990f3342d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:01:57.692763 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6b550-b8cf-4e1f-87a1-2867c5238b69 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:57.732526 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:57.778049 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e970b-50df-403b-b755-612254ae27b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:57.778953 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e970b-50df-403b-b755-612254ae27b9 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:57.779242 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e970b-50df-403b-b755-612254ae27b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:57.779529 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e970b-50df-403b-b755-612254ae27b9 None admin] PATH_INFO: `/v3/users/c3181dffc3e14068851292120f2c18a1` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:57.781385 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 57/106] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:01:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:01:57.783373 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b145b1-96c6-402f-8634-e3990f3342d7 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:57.819256 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e970b-50df-403b-b755-612254ae27b9 None admin] RBAC: Authorizing `identity:get_user(user_id=c3181dffc3e14068851292120f2c18a1)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:57.820834 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e970b-50df-403b-b755-612254ae27b9 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:57.822766 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 50/107] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 13:01:57 2022] GET /identity/v3/users/c3181dffc3e14068851292120f2c18a1 => generated 289 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:01:57.824855 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e970b-50df-403b-b755-612254ae27b9 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:57.931581 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e970b-50df-403b-b755-612254ae27b9 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:57.972509 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:58.010334 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d094bb-5e43-420b-9ac2-bcc85458f5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:58.011171 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d094bb-5e43-420b-9ac2-bcc85458f5ba None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:58.011457 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d094bb-5e43-420b-9ac2-bcc85458f5ba None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:58.011737 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d094bb-5e43-420b-9ac2-bcc85458f5ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:58.013093 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d094bb-5e43-420b-9ac2-bcc85458f5ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:58.014598 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d094bb-5e43-420b-9ac2-bcc85458f5ba None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:58.015680 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b145b1-96c6-402f-8634-e3990f3342d7 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:58.016428 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 51/108] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:01:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:01:58.022337 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d094bb-5e43-420b-9ac2-bcc85458f5ba None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:58.063138 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d779394-d857-49a1-834b-7240baeab102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:58.064266 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d779394-d857-49a1-834b-7240baeab102 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:58.064770 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d779394-d857-49a1-834b-7240baeab102 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:58.065258 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d779394-d857-49a1-834b-7240baeab102 None admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:58.066678 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d779394-d857-49a1-834b-7240baeab102 None admin] RBAC: Adding query filter params (name=member) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:01:58.067233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d779394-d857-49a1-834b-7240baeab102 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:58.069261 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d779394-d857-49a1-834b-7240baeab102 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:58.072504 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:58.081362 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 58/109] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 13:01:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:01:58.083057 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b5a13-b8e4-4b69-8a79-b84157ef3a09 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:58.083479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b5a13-b8e4-4b69-8a79-b84157ef3a09 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:58.083895 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b5a13-b8e4-4b69-8a79-b84157ef3a09 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:58.089762 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 59/110] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:01:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:01:58.089762 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b5a13-b8e4-4b69-8a79-b84157ef3a09 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:58.149942 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d094bb-5e43-420b-9ac2-bcc85458f5ba None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:58.194472 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9344ae-9522-4aaf-b972-b0433ac50ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:58.195150 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9344ae-9522-4aaf-b972-b0433ac50ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:58.195442 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9344ae-9522-4aaf-b972-b0433ac50ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:58.195721 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9344ae-9522-4aaf-b972-b0433ac50ae9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:58.217746 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b5a13-b8e4-4b69-8a79-b84157ef3a09 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:58.254545 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84335649-3480-4dce-b703-33912b4ba62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:58.255216 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84335649-3480-4dce-b703-33912b4ba62f None admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:58.255502 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84335649-3480-4dce-b703-33912b4ba62f None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:58.255783 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84335649-3480-4dce-b703-33912b4ba62f None admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:58.256522 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84335649-3480-4dce-b703-33912b4ba62f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:58.257989 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84335649-3480-4dce-b703-33912b4ba62f None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:58.275561 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9344ae-9522-4aaf-b972-b0433ac50ae9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:58.277213 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9344ae-9522-4aaf-b972-b0433ac50ae9 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:58.325880 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:58.349050 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:58.363227 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 60/111] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Jun 3 13:01:58 2022] POST /identity/v3/projects => generated 302 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:01:58.364397 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84335649-3480-4dce-b703-33912b4ba62f None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:58.410508 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 52/112] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:01:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 13:01:58.420048 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805cf91-1ffd-4982-8cf2-69121a809155 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:58.420725 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805cf91-1ffd-4982-8cf2-69121a809155 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:58.421194 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805cf91-1ffd-4982-8cf2-69121a809155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:58.451966 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-9805cf91-1ffd-4982-8cf2-69121a809155 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:01:58.451966 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-9805cf91-1ffd-4982-8cf2-69121a809155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:01:58.491251 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84335649-3480-4dce-b703-33912b4ba62f None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:58.520370 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 53/113] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:01:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:01:58.531104 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd34f8fe-5b7a-4668-90bf-3d9abefcc11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:58.532185 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34f8fe-5b7a-4668-90bf-3d9abefcc11c None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:58.532514 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34f8fe-5b7a-4668-90bf-3d9abefcc11c None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:58.532792 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34f8fe-5b7a-4668-90bf-3d9abefcc11c None admin] PATH_INFO: `/v3/users/dd10501b4efc4e1584a8886555a4f00a` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:58.533729 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fefe3-56a3-4253-b988-5147d8b66eaa None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:58.534024 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fefe3-56a3-4253-b988-5147d8b66eaa None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:58.534185 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd34f8fe-5b7a-4668-90bf-3d9abefcc11c None admin] RBAC: Authorizing `identity:get_user(user_id=dd10501b4efc4e1584a8886555a4f00a)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:58.534333 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fefe3-56a3-4253-b988-5147d8b66eaa None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:58.535685 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd34f8fe-5b7a-4668-90bf-3d9abefcc11c None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:58.535798 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 54/114] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:01:58 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:01:58.536492 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66fefe3-56a3-4253-b988-5147d8b66eaa None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:58.541898 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 61/115] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 13:01:58 2022] GET /identity/v3/users/dd10501b4efc4e1584a8886555a4f00a => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:01:58.543234 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a9aea-137d-4dc8-9da7-629625da1acc None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:58.543522 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a9aea-137d-4dc8-9da7-629625da1acc None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:58.543794 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a9aea-137d-4dc8-9da7-629625da1acc None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:58.545109 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 62/116] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:01:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:01:58.546178 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefae9c-248d-4dff-a3e2-806bec52434b None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:58.546431 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefae9c-248d-4dff-a3e2-806bec52434b None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:58.546933 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefae9c-248d-4dff-a3e2-806bec52434b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:58.566725 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-daefae9c-248d-4dff-a3e2-806bec52434b None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:01:58.567947 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-daefae9c-248d-4dff-a3e2-806bec52434b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:01:58.629325 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:58.638457 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:58.648337 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 63/117] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:01:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:01:58.648337 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefae9c-248d-4dff-a3e2-806bec52434b None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:58.660726 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66fefe3-56a3-4253-b988-5147d8b66eaa None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:58.699425 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ebb7a4-dfdc-43b6-ba95-c153c52b4d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:58.700427 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ebb7a4-dfdc-43b6-ba95-c153c52b4d0f None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:58.700717 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ebb7a4-dfdc-43b6-ba95-c153c52b4d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:58.700990 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ebb7a4-dfdc-43b6-ba95-c153c52b4d0f None admin] PATH_INFO: `/v3/projects/69bee49150564ea3abbe7a2301dea4d8` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:58.702245 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ebb7a4-dfdc-43b6-ba95-c153c52b4d0f None admin] RBAC: Authorizing `identity:get_project(project_id=69bee49150564ea3abbe7a2301dea4d8)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:58.703682 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ebb7a4-dfdc-43b6-ba95-c153c52b4d0f None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:58.706212 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 55/118] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:01:58 2022] GET /identity/v3/projects/69bee49150564ea3abbe7a2301dea4d8 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:01:58.707307 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d131a8c-7a69-47ed-a78d-e2155644fd7b None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:58.707601 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d131a8c-7a69-47ed-a78d-e2155644fd7b None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:58.707879 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d131a8c-7a69-47ed-a78d-e2155644fd7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:58.728523 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-6d131a8c-7a69-47ed-a78d-e2155644fd7b None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:01:58.729757 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-6d131a8c-7a69-47ed-a78d-e2155644fd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:01:58.762370 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefae9c-248d-4dff-a3e2-806bec52434b None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:58.799736 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4b931-da3b-4e3f-ab88-db92cf212586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:58.800627 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4b931-da3b-4e3f-ab88-db92cf212586 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:58.800913 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4b931-da3b-4e3f-ab88-db92cf212586 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:58.801192 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4b931-da3b-4e3f-ab88-db92cf212586 None admin] PATH_INFO: `/v3/projects/69bee49150564ea3abbe7a2301dea4d8` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:58.802384 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4b931-da3b-4e3f-ab88-db92cf212586 None admin] RBAC: Authorizing `identity:get_project(project_id=69bee49150564ea3abbe7a2301dea4d8)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:58.803853 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4b931-da3b-4e3f-ab88-db92cf212586 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:58.805806 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 64/119] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:01:58 2022] GET /identity/v3/projects/69bee49150564ea3abbe7a2301dea4d8 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:01:58.813974 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 56/120] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:01:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:01:58.813974 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d131a8c-7a69-47ed-a78d-e2155644fd7b None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:58.814493 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4b931-da3b-4e3f-ab88-db92cf212586 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:58.876697 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:58.896210 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:58.943050 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d131a8c-7a69-47ed-a78d-e2155644fd7b None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:58.948114 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4b931-da3b-4e3f-ab88-db92cf212586 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:58.981139 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6696e3a-880b-4518-9c90-bb59130ea13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:58.981968 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6696e3a-880b-4518-9c90-bb59130ea13c None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:58.982262 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6696e3a-880b-4518-9c90-bb59130ea13c None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:58.982541 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6696e3a-880b-4518-9c90-bb59130ea13c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:58.984594 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df2796-40a5-4b4f-a62b-4d0314e8d4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:58.986261 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df2796-40a5-4b4f-a62b-4d0314e8d4c7 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:58.989073 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df2796-40a5-4b4f-a62b-4d0314e8d4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:58.989073 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df2796-40a5-4b4f-a62b-4d0314e8d4c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:58.996588 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6696e3a-880b-4518-9c90-bb59130ea13c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:01:59.002780 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03df2796-40a5-4b4f-a62b-4d0314e8d4c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:01:59.005402 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-f6696e3a-880b-4518-9c90-bb59130ea13c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 13:01:59.005402 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:01:59.005402 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:01:59.005402 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:01:59.005402 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:01:59.005402 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:01:59.005402 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:01:59.005402 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:01:59.005402 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:01:59.005402 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:01:59.005402 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:01:59.005402 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:01:59.005402 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:01:59.005402 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:01:59.005402 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:01:59.005402 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:01:59.006450 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:01:59.006450 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:01:59.006450 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:01:59.006450 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:01:59.006450 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:01:59.006450 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:01:59.006450 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:01:59.006450 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:01:59.006450 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:01:59.006450 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:01:59.006450 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:01:59.006450 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:01:59.006450 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:01:59.006450 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:01:59.006450 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:01:59.006450 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:01:59.007374 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:01:59.007374 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:01:59.007374 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:01:59.007374 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:01:59.007374 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:01:59.007374 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:01:59.007374 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:01:59.007374 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:01:59.007374 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:01:59.007374 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:01:59.007374 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 13:01:59.007374 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:01:59.007374 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 57/121] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jun 3 13:01:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:01:59.008198 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6696e3a-880b-4518-9c90-bb59130ea13c None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:59.013099 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-03df2796-40a5-4b4f-a62b-4d0314e8d4c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:01:59.013099 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:01:59.013099 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:01:59.013099 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:01:59.013099 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:01:59.013099 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:01:59.013099 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:01:59.013099 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:01:59.013099 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:01:59.013099 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:01:59.013099 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:01:59.013099 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:01:59.013099 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:01:59.013099 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:01:59.013099 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:01:59.013099 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:01:59.013937 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:01:59.013937 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:01:59.013937 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:01:59.013937 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:01:59.013937 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:01:59.013937 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:01:59.013937 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:01:59.013937 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:01:59.013937 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:01:59.013937 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:01:59.013937 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:01:59.013937 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:01:59.013937 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:01:59.013937 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:01:59.013937 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:01:59.013937 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:01:59.014700 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:01:59.014700 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:01:59.014700 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:01:59.014700 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:01:59.014700 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:01:59.014700 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:01:59.014700 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:01:59.014700 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:01:59.014700 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:01:59.014700 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:01:59.014700 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:01:59.014700 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:01:59.014700 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 65/122] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 13:01:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:01:59.015325 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df2796-40a5-4b4f-a62b-4d0314e8d4c7 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:59.119593 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6696e3a-880b-4518-9c90-bb59130ea13c None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:59.125390 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df2796-40a5-4b4f-a62b-4d0314e8d4c7 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:59.150956 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:59.151805 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:59.155748 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0094a-cbe7-44e2-8266-c40c2f5266df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:59.156440 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0094a-cbe7-44e2-8266-c40c2f5266df None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:59.161277 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0094a-cbe7-44e2-8266-c40c2f5266df None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:59.161277 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0094a-cbe7-44e2-8266-c40c2f5266df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:59.161277 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0094a-cbe7-44e2-8266-c40c2f5266df None admin] RBAC: Adding query filter params (role.id=f3c7872a0874484085c534eb05e404eb, scope.project.id=69bee49150564ea3abbe7a2301dea4d8, user.id=c3181dffc3e14068851292120f2c18a1) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:01:59.161277 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0094a-cbe7-44e2-8266-c40c2f5266df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:59.161277 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0094a-cbe7-44e2-8266-c40c2f5266df None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:59.163299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f1a79-176e-4706-9ddb-0589ab0db102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:59.164255 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f1a79-176e-4706-9ddb-0589ab0db102 None admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:59.164555 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f1a79-176e-4706-9ddb-0589ab0db102 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:59.164812 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f1a79-176e-4706-9ddb-0589ab0db102 None admin] PATH_INFO: `/v3/projects/69bee49150564ea3abbe7a2301dea4d8/users/dd10501b4efc4e1584a8886555a4f00a/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:59.176506 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 58/123] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 13:01:59 2022] GET /identity/v3/role_assignments?user.id=c3181dffc3e14068851292120f2c18a1&scope.project.id=69bee49150564ea3abbe7a2301dea4d8&role.id=f3c7872a0874484085c534eb05e404eb => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:01:59.176732 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3f1a79-176e-4706-9ddb-0589ab0db102 None admin] RBAC: Authorizing `identity:create_grant(project_id=69bee49150564ea3abbe7a2301dea4d8, user_id=dd10501b4efc4e1584a8886555a4f00a, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:59.176825 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0094a-cbe7-44e2-8266-c40c2f5266df None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:59.176908 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3f1a79-176e-4706-9ddb-0589ab0db102 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:59.288033 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 66/124] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jun 3 13:01:59 2022] PUT /identity/v3/projects/69bee49150564ea3abbe7a2301dea4d8/users/dd10501b4efc4e1584a8886555a4f00a/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:01:59.288838 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f1a79-176e-4706-9ddb-0589ab0db102 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:59.319228 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0094a-cbe7-44e2-8266-c40c2f5266df None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:59.398025 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787a6cf-bd38-48fa-be89-61ac0b59e9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:59.398878 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787a6cf-bd38-48fa-be89-61ac0b59e9ac None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:59.399167 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787a6cf-bd38-48fa-be89-61ac0b59e9ac None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:59.399444 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787a6cf-bd38-48fa-be89-61ac0b59e9ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:59.425376 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d787a6cf-bd38-48fa-be89-61ac0b59e9ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:01:59.440979 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-d787a6cf-bd38-48fa-be89-61ac0b59e9ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 13:01:59.440979 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:01:59.440979 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:01:59.440979 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:01:59.440979 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:01:59.440979 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:01:59.440979 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:01:59.440979 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:01:59.440979 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:01:59.440979 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:01:59.440979 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:01:59.440979 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:01:59.440979 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:01:59.440979 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:01:59.440979 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:01:59.440979 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:01:59.441928 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:01:59.441928 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:01:59.441928 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:01:59.441928 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:01:59.441928 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:01:59.441928 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:01:59.441928 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:01:59.441928 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:01:59.441928 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:01:59.441928 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:01:59.441928 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:01:59.441928 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:01:59.441928 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:01:59.441928 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:01:59.441928 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:01:59.441928 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:01:59.442706 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:01:59.442706 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:01:59.442706 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:01:59.442706 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:01:59.442706 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:01:59.442706 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:01:59.442706 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:01:59.442706 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:01:59.442706 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:01:59.442706 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:01:59.442706 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 13:01:59.442706 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:01:59.443795 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 59/125] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:01:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:01:59.444705 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787a6cf-bd38-48fa-be89-61ac0b59e9ac None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:59.484260 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f1a79-176e-4706-9ddb-0589ab0db102 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:59.547291 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3876c-08ed-48b2-b51c-52cf38104944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:59.548102 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3876c-08ed-48b2-b51c-52cf38104944 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:59.548478 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3876c-08ed-48b2-b51c-52cf38104944 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:59.548882 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3876c-08ed-48b2-b51c-52cf38104944 None admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:59.549650 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca3876c-08ed-48b2-b51c-52cf38104944 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:01:59.550132 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca3876c-08ed-48b2-b51c-52cf38104944 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:59.551584 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca3876c-08ed-48b2-b51c-52cf38104944 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:59.570477 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:59.571051 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 67/126] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:01:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:01:59.571956 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3876c-08ed-48b2-b51c-52cf38104944 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:59.636186 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:59.641027 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787a6cf-bd38-48fa-be89-61ac0b59e9ac None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:59.697221 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3876c-08ed-48b2-b51c-52cf38104944 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:59.708914 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb6488-b5e0-4e05-9f0f-b3397cfaedc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:59.709969 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb6488-b5e0-4e05-9f0f-b3397cfaedc9 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:59.710462 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb6488-b5e0-4e05-9f0f-b3397cfaedc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:59.710947 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb6488-b5e0-4e05-9f0f-b3397cfaedc9 None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:59.711918 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb6488-b5e0-4e05-9f0f-b3397cfaedc9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:01:59.712449 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb6488-b5e0-4e05-9f0f-b3397cfaedc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:59.714032 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb6488-b5e0-4e05-9f0f-b3397cfaedc9 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:59.736038 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 60/127] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:01:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:01:59.736561 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7f1d7-e8cc-4d89-ba64-7582a7518b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:59.737280 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7f1d7-e8cc-4d89-ba64-7582a7518b2f None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:59.737566 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7f1d7-e8cc-4d89-ba64-7582a7518b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:59.742776 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7f1d7-e8cc-4d89-ba64-7582a7518b2f None admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:59.742776 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed7f1d7-e8cc-4d89-ba64-7582a7518b2f None admin] RBAC: Adding query filter params (name=member) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:01:59.742776 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed7f1d7-e8cc-4d89-ba64-7582a7518b2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:59.742776 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed7f1d7-e8cc-4d89-ba64-7582a7518b2f None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:59.743393 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb6488-b5e0-4e05-9f0f-b3397cfaedc9 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:59.749361 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 68/128] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 13:01:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:01:59.750029 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7f1d7-e8cc-4d89-ba64-7582a7518b2f None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:59.867395 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7f1d7-e8cc-4d89-ba64-7582a7518b2f None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:59.877570 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:59.890935 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb6488-b5e0-4e05-9f0f-b3397cfaedc9 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:01:59.904687 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7d096-bc16-45a9-8f39-21c36b6118c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:59.905617 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7d096-bc16-45a9-8f39-21c36b6118c9 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:59.905901 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7d096-bc16-45a9-8f39-21c36b6118c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:59.906178 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7d096-bc16-45a9-8f39-21c36b6118c9 None admin] PATH_INFO: `/v3/users/31e8e6595d7242a98c3388e4c3784e70` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:59.908162 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b7d096-bc16-45a9-8f39-21c36b6118c9 None admin] RBAC: Authorizing `identity:get_user(user_id=31e8e6595d7242a98c3388e4c3784e70)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:59.909697 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b7d096-bc16-45a9-8f39-21c36b6118c9 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:59.911591 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 69/129] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 13:01:59 2022] GET /identity/v3/users/31e8e6595d7242a98c3388e4c3784e70 => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:01:59.913437 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7d096-bc16-45a9-8f39-21c36b6118c9 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:01:59.915234 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:01:59.933366 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f4405e-27e5-47b6-bb7f-71ed0cc54a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:01:59.935017 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4405e-27e5-47b6-bb7f-71ed0cc54a07 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:01:59.935505 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4405e-27e5-47b6-bb7f-71ed0cc54a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:01:59.935981 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4405e-27e5-47b6-bb7f-71ed0cc54a07 None admin] PATH_INFO: `/v3/users/dd10501b4efc4e1584a8886555a4f00a` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:01:59.937454 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f4405e-27e5-47b6-bb7f-71ed0cc54a07 None admin] RBAC: Authorizing `identity:get_user(user_id=dd10501b4efc4e1584a8886555a4f00a)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:01:59.939451 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f4405e-27e5-47b6-bb7f-71ed0cc54a07 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:01:59.941392 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 61/130] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 13:01:59 2022] GET /identity/v3/users/dd10501b4efc4e1584a8886555a4f00a => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:01:59.942364 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f4405e-27e5-47b6-bb7f-71ed0cc54a07 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:00.029583 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7d096-bc16-45a9-8f39-21c36b6118c9 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:00.050835 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f4405e-27e5-47b6-bb7f-71ed0cc54a07 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:00.076087 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbdf9d2-206b-415e-828c-2c1eb2b450c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:00.077004 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbdf9d2-206b-415e-828c-2c1eb2b450c3 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:00.077292 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbdf9d2-206b-415e-828c-2c1eb2b450c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:00.077560 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbdf9d2-206b-415e-828c-2c1eb2b450c3 None admin] PATH_INFO: `/v3/users/dd10501b4efc4e1584a8886555a4f00a` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:00.083459 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbdf9d2-206b-415e-828c-2c1eb2b450c3 None admin] RBAC: Authorizing `identity:get_user(user_id=dd10501b4efc4e1584a8886555a4f00a)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:00.085228 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbdf9d2-206b-415e-828c-2c1eb2b450c3 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:00.086896 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 70/131] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 13:01:59 2022] GET /identity/v3/users/dd10501b4efc4e1584a8886555a4f00a => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:00.087657 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbdf9d2-206b-415e-828c-2c1eb2b450c3 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:00.088264 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390fc77-e353-44a9-834e-de2cde088262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:00.089363 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390fc77-e353-44a9-834e-de2cde088262 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:00.089842 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390fc77-e353-44a9-834e-de2cde088262 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:00.090321 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390fc77-e353-44a9-834e-de2cde088262 None admin] PATH_INFO: `/v3/projects/69bee49150564ea3abbe7a2301dea4d8` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:00.091703 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d390fc77-e353-44a9-834e-de2cde088262 None admin] RBAC: Authorizing `identity:get_project(project_id=69bee49150564ea3abbe7a2301dea4d8)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:00.093425 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d390fc77-e353-44a9-834e-de2cde088262 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:00.095472 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 62/132] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:01:59 2022] GET /identity/v3/projects/69bee49150564ea3abbe7a2301dea4d8 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:00.096489 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390fc77-e353-44a9-834e-de2cde088262 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:00.158080 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:00.176903 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:00.201043 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390fc77-e353-44a9-834e-de2cde088262 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:00.248321 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbdf9d2-206b-415e-828c-2c1eb2b450c3 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:00.268874 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9de446-019c-48f3-9348-d007a6641b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:00.270076 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9de446-019c-48f3-9348-d007a6641b19 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:00.270582 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9de446-019c-48f3-9348-d007a6641b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:00.271056 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9de446-019c-48f3-9348-d007a6641b19 None admin] PATH_INFO: `/v3/projects/57abebb6d35f4e5085880bf49a442713` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:00.272532 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9de446-019c-48f3-9348-d007a6641b19 None admin] RBAC: Authorizing `identity:get_project(project_id=57abebb6d35f4e5085880bf49a442713)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:00.274188 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9de446-019c-48f3-9348-d007a6641b19 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:00.276081 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 63/133] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:02:00 2022] GET /identity/v3/projects/57abebb6d35f4e5085880bf49a442713 => generated 312 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:00.277036 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9de446-019c-48f3-9348-d007a6641b19 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:00.290074 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14edf426-e210-4648-955c-1807b0d45faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:00.290940 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edf426-e210-4648-955c-1807b0d45faa None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:00.291221 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edf426-e210-4648-955c-1807b0d45faa None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:00.291494 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edf426-e210-4648-955c-1807b0d45faa None admin] PATH_INFO: `/v3/projects/69bee49150564ea3abbe7a2301dea4d8` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:00.292712 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14edf426-e210-4648-955c-1807b0d45faa None admin] RBAC: Authorizing `identity:get_project(project_id=69bee49150564ea3abbe7a2301dea4d8)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:00.294295 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14edf426-e210-4648-955c-1807b0d45faa None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:00.296283 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 71/134] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:02:00 2022] GET /identity/v3/projects/69bee49150564ea3abbe7a2301dea4d8 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:00.296850 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14edf426-e210-4648-955c-1807b0d45faa None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:00.387981 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9de446-019c-48f3-9348-d007a6641b19 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:00.420646 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:00.428821 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129de15-aff9-4331-8b51-c62551cf4510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:00.430074 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129de15-aff9-4331-8b51-c62551cf4510 None admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:00.430556 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129de15-aff9-4331-8b51-c62551cf4510 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:00.431038 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129de15-aff9-4331-8b51-c62551cf4510 None admin] PATH_INFO: `/v3/projects/69bee49150564ea3abbe7a2301dea4d8/users/31e8e6595d7242a98c3388e4c3784e70/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:00.434220 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4129de15-aff9-4331-8b51-c62551cf4510 None admin] RBAC: Authorizing `identity:create_grant(project_id=69bee49150564ea3abbe7a2301dea4d8, user_id=31e8e6595d7242a98c3388e4c3784e70, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:00.438928 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4129de15-aff9-4331-8b51-c62551cf4510 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:00.464568 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14edf426-e210-4648-955c-1807b0d45faa None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:00.479772 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:00.504977 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499bb430-17e6-48f1-bff6-79c54f168b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:00.506344 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499bb430-17e6-48f1-bff6-79c54f168b4e None admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:00.506790 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499bb430-17e6-48f1-bff6-79c54f168b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:00.507523 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499bb430-17e6-48f1-bff6-79c54f168b4e None admin] PATH_INFO: `/v3/projects/57abebb6d35f4e5085880bf49a442713/users/dd10501b4efc4e1584a8886555a4f00a/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:00.509886 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499bb430-17e6-48f1-bff6-79c54f168b4e None admin] RBAC: Authorizing `identity:create_grant(project_id=57abebb6d35f4e5085880bf49a442713, user_id=dd10501b4efc4e1584a8886555a4f00a, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:00.511635 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499bb430-17e6-48f1-bff6-79c54f168b4e None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:00.557624 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 64/135] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jun 3 13:02:00 2022] PUT /identity/v3/projects/69bee49150564ea3abbe7a2301dea4d8/users/31e8e6595d7242a98c3388e4c3784e70/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:00.558506 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129de15-aff9-4331-8b51-c62551cf4510 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:00.580264 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 72/136] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jun 3 13:02:00 2022] PUT /identity/v3/projects/57abebb6d35f4e5085880bf49a442713/users/dd10501b4efc4e1584a8886555a4f00a/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:00.712094 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129de15-aff9-4331-8b51-c62551cf4510 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:00.767790 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f7f0f-05c1-4d79-8cfc-a1cce00b56d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:00.769037 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f7f0f-05c1-4d79-8cfc-a1cce00b56d2 None admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:00.769605 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f7f0f-05c1-4d79-8cfc-a1cce00b56d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:00.770057 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f7f0f-05c1-4d79-8cfc-a1cce00b56d2 None admin] PATH_INFO: `/v3/projects/69bee49150564ea3abbe7a2301dea4d8/users/dd10501b4efc4e1584a8886555a4f00a/roles/7476baf91a50401596c34535d2c79a4f` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:00.774945 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7f7f0f-05c1-4d79-8cfc-a1cce00b56d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=69bee49150564ea3abbe7a2301dea4d8, user_id=dd10501b4efc4e1584a8886555a4f00a, role_id=7476baf91a50401596c34535d2c79a4f)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:00.776888 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7f7f0f-05c1-4d79-8cfc-a1cce00b56d2 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:00.863586 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 65/137] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jun 3 13:02:00 2022] PUT /identity/v3/projects/69bee49150564ea3abbe7a2301dea4d8/users/dd10501b4efc4e1584a8886555a4f00a/roles/7476baf91a50401596c34535d2c79a4f => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:01.249056 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e200e-900c-4d70-be68-5aee32d1815b None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:01.249958 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e200e-900c-4d70-be68-5aee32d1815b None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:01.250416 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e200e-900c-4d70-be68-5aee32d1815b None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:01.252777 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 73/138] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:01.258208 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6303e1-3b63-4834-b02b-573e72776d11 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:01.259029 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6303e1-3b63-4834-b02b-573e72776d11 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:01.259489 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6303e1-3b63-4834-b02b-573e72776d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:01.281169 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-ad6303e1-3b63-4834-b02b-573e72776d11 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:01.282701 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-ad6303e1-3b63-4834-b02b-573e72776d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:01.325356 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:01.371138 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 66/139] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:02:01.433603 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e200e-900c-4d70-be68-5aee32d1815b None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:01.571620 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e200e-900c-4d70-be68-5aee32d1815b None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:01.615355 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86254d36-c121-496a-bc4d-37841de3eddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:01.616174 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86254d36-c121-496a-bc4d-37841de3eddc None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:01.616497 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86254d36-c121-496a-bc4d-37841de3eddc None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:01.616773 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86254d36-c121-496a-bc4d-37841de3eddc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:01.620879 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86254d36-c121-496a-bc4d-37841de3eddc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:01.622374 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86254d36-c121-496a-bc4d-37841de3eddc None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:01.624039 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 74/140] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:02:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:01.630730 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6303e1-3b63-4834-b02b-573e72776d11 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:01.769192 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6303e1-3b63-4834-b02b-573e72776d11 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:01.818287 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25601e0-765e-4a01-a9d1-6c9dfeef1f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:01.819335 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25601e0-765e-4a01-a9d1-6c9dfeef1f02 None admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:01.819844 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25601e0-765e-4a01-a9d1-6c9dfeef1f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:01.820340 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25601e0-765e-4a01-a9d1-6c9dfeef1f02 None admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:01.821251 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25601e0-765e-4a01-a9d1-6c9dfeef1f02 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:01.822964 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25601e0-765e-4a01-a9d1-6c9dfeef1f02 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:01.900752 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a6d24-c9d3-465d-8492-2f96b68efa49 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:01.901066 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a6d24-c9d3-465d-8492-2f96b68efa49 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:01.901370 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a6d24-c9d3-465d-8492-2f96b68efa49 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:01.902824 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 75/141] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 13:02:01.909863 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09673de-4361-4c6e-9eaf-8278716ac1d5 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:01.910149 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09673de-4361-4c6e-9eaf-8278716ac1d5 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:01.910428 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09673de-4361-4c6e-9eaf-8278716ac1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:01.917280 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 67/142] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jun 3 13:02:01 2022] POST /identity/v3/users => generated 283 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:01.937866 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-e09673de-4361-4c6e-9eaf-8278716ac1d5 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:01.939436 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-e09673de-4361-4c6e-9eaf-8278716ac1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:01.987247 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:02.033086 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 76/143] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 03 13:02:02.064490 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25601e0-765e-4a01-a9d1-6c9dfeef1f02 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:02.102835 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:02.194972 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25601e0-765e-4a01-a9d1-6c9dfeef1f02 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:02.232267 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621e7e0-4343-4860-a1c7-a6c236907203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:02.233448 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621e7e0-4343-4860-a1c7-a6c236907203 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:02.234018 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621e7e0-4343-4860-a1c7-a6c236907203 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:02.235447 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621e7e0-4343-4860-a1c7-a6c236907203 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:02.247638 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621e7e0-4343-4860-a1c7-a6c236907203 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:02:02.257078 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-1621e7e0-4343-4860-a1c7-a6c236907203 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 13:02:02.257078 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:02.257078 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:02.257078 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:02.257078 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:02.257078 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:02.257078 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:02.257078 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:02.257078 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:02.257078 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:02.257078 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:02.257078 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:02.257078 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:02:02.257078 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:02:02.257078 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:02:02.257078 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:02:02.257946 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:02:02.257946 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:02:02.257946 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:02:02.257946 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:02:02.257946 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:02.257946 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:02.257946 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:02.257946 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:02.257946 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:02.257946 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:02.257946 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:02.257946 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:02.257946 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:02.257946 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:02.257946 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:02.257946 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:02.259121 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:02.259121 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:02.259121 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:02.259121 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:02.259121 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:02:02.259121 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:02:02.259121 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:02:02.259121 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:02:02.259121 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:02:02.259121 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:02:02.259121 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 13:02:02.259121 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:02:02.261498 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 68/144] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:02:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:02.268484 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09673de-4361-4c6e-9eaf-8278716ac1d5 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:02.393059 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8ca44-2f2a-4851-bb22-52b80653ba0e None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:02.393403 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8ca44-2f2a-4851-bb22-52b80653ba0e None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:02.393576 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8ca44-2f2a-4851-bb22-52b80653ba0e None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:02.394898 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 69/145] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:02.399966 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033d213-1cbf-4227-98f3-ab4c78abf00e None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:02.400448 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033d213-1cbf-4227-98f3-ab4c78abf00e None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:02.400735 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033d213-1cbf-4227-98f3-ab4c78abf00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:02.412865 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09673de-4361-4c6e-9eaf-8278716ac1d5 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:02.430812 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-d033d213-1cbf-4227-98f3-ab4c78abf00e None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:02.432060 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-d033d213-1cbf-4227-98f3-ab4c78abf00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:02.483511 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7086087-9f44-4b1c-acbd-e15ed0cd28b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:02.484222 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7086087-9f44-4b1c-acbd-e15ed0cd28b6 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:02.484562 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7086087-9f44-4b1c-acbd-e15ed0cd28b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:02.484821 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7086087-9f44-4b1c-acbd-e15ed0cd28b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:02.485989 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7086087-9f44-4b1c-acbd-e15ed0cd28b6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:02.486307 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7086087-9f44-4b1c-acbd-e15ed0cd28b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:02.487731 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7086087-9f44-4b1c-acbd-e15ed0cd28b6 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:02.501303 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 77/146] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 13:02:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:02.505641 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7086087-9f44-4b1c-acbd-e15ed0cd28b6 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:02.565541 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 70/147] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 13:02:02.567937 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:02.613161 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033d213-1cbf-4227-98f3-ab4c78abf00e None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:02.647110 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:02.676028 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7086087-9f44-4b1c-acbd-e15ed0cd28b6 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:02.749828 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd858c5b-a97e-49ba-943c-15f837128fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:02.751339 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd858c5b-a97e-49ba-943c-15f837128fff None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:02.751620 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd858c5b-a97e-49ba-943c-15f837128fff None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:02.751896 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd858c5b-a97e-49ba-943c-15f837128fff None admin] PATH_INFO: `/v3/users/c3181dffc3e14068851292120f2c18a1` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:02.755480 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd858c5b-a97e-49ba-943c-15f837128fff None admin] RBAC: Authorizing `identity:get_user(user_id=c3181dffc3e14068851292120f2c18a1)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:02.756962 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd858c5b-a97e-49ba-943c-15f837128fff None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:02.763280 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 78/148] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 13:02:02 2022] GET /identity/v3/users/c3181dffc3e14068851292120f2c18a1 => generated 289 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:02.764126 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd858c5b-a97e-49ba-943c-15f837128fff None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:02.783618 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033d213-1cbf-4227-98f3-ab4c78abf00e None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:02.860967 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5c4b8-99be-4cdc-aec0-fc4f7c19d966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:02.862055 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5c4b8-99be-4cdc-aec0-fc4f7c19d966 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:02.863480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5c4b8-99be-4cdc-aec0-fc4f7c19d966 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:02.863758 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5c4b8-99be-4cdc-aec0-fc4f7c19d966 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:02.890768 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e5c4b8-99be-4cdc-aec0-fc4f7c19d966 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:02:02.899449 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-92e5c4b8-99be-4cdc-aec0-fc4f7c19d966 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 13:02:02.899449 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:02.899449 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:02.899449 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:02.899449 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:02.899449 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:02.899449 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:02.899449 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:02.899449 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:02.899449 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:02.899449 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:02.899449 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:02.899449 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:02:02.899449 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:02:02.899449 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:02:02.899449 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:02:02.900355 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:02:02.900355 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:02:02.900355 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:02:02.900355 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:02:02.900355 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:02.900355 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:02.900355 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:02.900355 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:02.900355 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:02.900355 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:02.900355 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:02.900355 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:02.900355 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:02.900355 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:02.900355 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:02.900355 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:02.901131 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:02.901131 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:02.901131 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:02.901131 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:02.901131 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:02:02.901131 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:02:02.901131 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:02:02.901131 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:02:02.901131 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:02:02.901131 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:02:02.901131 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 13:02:02.901131 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:02:02.904576 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 71/149] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:02:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:02.910242 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5c4b8-99be-4cdc-aec0-fc4f7c19d966 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:02.933554 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd858c5b-a97e-49ba-943c-15f837128fff None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:02.936445 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:02.979475 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb1746-facc-418a-a6f0-ba95ad8173e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:02.980379 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb1746-facc-418a-a6f0-ba95ad8173e5 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:02.980739 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb1746-facc-418a-a6f0-ba95ad8173e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:02.981070 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb1746-facc-418a-a6f0-ba95ad8173e5 None admin] PATH_INFO: `/v3/projects/69bee49150564ea3abbe7a2301dea4d8` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:02.982288 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb1746-facc-418a-a6f0-ba95ad8173e5 None admin] RBAC: Authorizing `identity:get_project(project_id=69bee49150564ea3abbe7a2301dea4d8)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:02.983775 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb1746-facc-418a-a6f0-ba95ad8173e5 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:02.986416 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 79/150] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:02:02 2022] GET /identity/v3/projects/69bee49150564ea3abbe7a2301dea4d8 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:02.992230 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb1746-facc-418a-a6f0-ba95ad8173e5 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:03.051910 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5c4b8-99be-4cdc-aec0-fc4f7c19d966 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:03.072534 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:03.126113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d858e-310f-44f2-9d5d-20c93cb29d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:03.127070 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d858e-310f-44f2-9d5d-20c93cb29d1a None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:03.131655 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d858e-310f-44f2-9d5d-20c93cb29d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:03.132086 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d858e-310f-44f2-9d5d-20c93cb29d1a None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:03.133053 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7d858e-310f-44f2-9d5d-20c93cb29d1a None admin] RBAC: Adding query filter params (name=member) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:03.133503 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7d858e-310f-44f2-9d5d-20c93cb29d1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:03.135066 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7d858e-310f-44f2-9d5d-20c93cb29d1a None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:03.150482 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 72/151] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 13:02:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:02:03.158170 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d858e-310f-44f2-9d5d-20c93cb29d1a None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:03.188734 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb1746-facc-418a-a6f0-ba95ad8173e5 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:03.274243 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342dbe8-bac8-439e-b690-8fa7e63d8e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:03.275149 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342dbe8-bac8-439e-b690-8fa7e63d8e35 None admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:03.275433 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342dbe8-bac8-439e-b690-8fa7e63d8e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:03.275710 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342dbe8-bac8-439e-b690-8fa7e63d8e35 None admin] PATH_INFO: `/v3/projects/69bee49150564ea3abbe7a2301dea4d8/users/c3181dffc3e14068851292120f2c18a1/roles/f3c7872a0874484085c534eb05e404eb` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:03.281518 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5342dbe8-bac8-439e-b690-8fa7e63d8e35 None admin] RBAC: Authorizing `identity:create_grant(project_id=69bee49150564ea3abbe7a2301dea4d8, user_id=c3181dffc3e14068851292120f2c18a1, role_id=f3c7872a0874484085c534eb05e404eb)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:03.283217 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5342dbe8-bac8-439e-b690-8fa7e63d8e35 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:03.301886 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d858e-310f-44f2-9d5d-20c93cb29d1a None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:03.340282 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35e2ba-96f0-4a71-8c78-04155f710b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:03.341396 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35e2ba-96f0-4a71-8c78-04155f710b19 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:03.341884 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35e2ba-96f0-4a71-8c78-04155f710b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:03.342312 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35e2ba-96f0-4a71-8c78-04155f710b19 None admin] PATH_INFO: `/v3/users/dd10501b4efc4e1584a8886555a4f00a` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:03.343657 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35e2ba-96f0-4a71-8c78-04155f710b19 None admin] RBAC: Authorizing `identity:get_user(user_id=dd10501b4efc4e1584a8886555a4f00a)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:03.345336 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35e2ba-96f0-4a71-8c78-04155f710b19 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:03.347479 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 73/152] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 13:02:03 2022] GET /identity/v3/users/dd10501b4efc4e1584a8886555a4f00a => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:03.352826 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35e2ba-96f0-4a71-8c78-04155f710b19 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:03.365130 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:03.374549 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 80/153] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jun 3 13:02:02 2022] PUT /identity/v3/projects/69bee49150564ea3abbe7a2301dea4d8/users/c3181dffc3e14068851292120f2c18a1/roles/f3c7872a0874484085c534eb05e404eb => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:02:03.489296 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35e2ba-96f0-4a71-8c78-04155f710b19 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:03.543979 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e61c9-300b-465c-b314-3d1e2b7caf8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:03.544678 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e61c9-300b-465c-b314-3d1e2b7caf8b None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:03.544961 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e61c9-300b-465c-b314-3d1e2b7caf8b None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:03.545234 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e61c9-300b-465c-b314-3d1e2b7caf8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:03.632402 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e61c9-300b-465c-b314-3d1e2b7caf8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:03.633942 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e61c9-300b-465c-b314-3d1e2b7caf8b None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:03.646538 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:03.757170 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 74/154] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:02:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:03.762994 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342dbe8-bac8-439e-b690-8fa7e63d8e35 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:03.805594 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:03.888278 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342dbe8-bac8-439e-b690-8fa7e63d8e35 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:03.933922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9b025-952d-446a-b7b5-8e12ceed1e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:03.934801 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9b025-952d-446a-b7b5-8e12ceed1e2b None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:03.935151 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9b025-952d-446a-b7b5-8e12ceed1e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:03.935427 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9b025-952d-446a-b7b5-8e12ceed1e2b None admin] PATH_INFO: `/v3/projects/69bee49150564ea3abbe7a2301dea4d8` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:03.936677 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9b025-952d-446a-b7b5-8e12ceed1e2b None admin] RBAC: Authorizing `identity:get_project(project_id=69bee49150564ea3abbe7a2301dea4d8)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:03.938770 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9b025-952d-446a-b7b5-8e12ceed1e2b None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:03.941292 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 81/155] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:02:03 2022] GET /identity/v3/projects/69bee49150564ea3abbe7a2301dea4d8 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:03.946990 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e61c9-300b-465c-b314-3d1e2b7caf8b None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:04.098713 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e61c9-300b-465c-b314-3d1e2b7caf8b None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:04.112790 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:04.144612 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc25b15-0da1-4f36-b64e-4d7e109287a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:04.145274 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc25b15-0da1-4f36-b64e-4d7e109287a0 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:04.145557 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc25b15-0da1-4f36-b64e-4d7e109287a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:04.145828 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc25b15-0da1-4f36-b64e-4d7e109287a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:04.146666 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc25b15-0da1-4f36-b64e-4d7e109287a0 None admin] RBAC: Adding query filter params (role.id=d082d2b37fd1455ea61819353e8369ed, scope.project.id=69bee49150564ea3abbe7a2301dea4d8, user.id=dd10501b4efc4e1584a8886555a4f00a) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:04.147020 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc25b15-0da1-4f36-b64e-4d7e109287a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:04.153750 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc25b15-0da1-4f36-b64e-4d7e109287a0 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:04.160904 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 75/156] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 13:02:03 2022] GET /identity/v3/role_assignments?user.id=dd10501b4efc4e1584a8886555a4f00a&scope.project.id=69bee49150564ea3abbe7a2301dea4d8&role.id=d082d2b37fd1455ea61819353e8369ed => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:04.262037 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7033d-3b7e-4a4d-9991-dfff7a944b4e None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:04.262356 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7033d-3b7e-4a4d-9991-dfff7a944b4e None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:04.262599 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7033d-3b7e-4a4d-9991-dfff7a944b4e None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:04.264078 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 82/157] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:04.270000 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679606b-7ac1-474d-a096-bedfcf8da148 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:04.270288 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679606b-7ac1-474d-a096-bedfcf8da148 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:04.270567 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679606b-7ac1-474d-a096-bedfcf8da148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:04.297172 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-c679606b-7ac1-474d-a096-bedfcf8da148 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:04.298771 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-c679606b-7ac1-474d-a096-bedfcf8da148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:04.390596 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 76/158] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:02:04.428403 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7033d-3b7e-4a4d-9991-dfff7a944b4e None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:04.542683 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:04.548944 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7033d-3b7e-4a4d-9991-dfff7a944b4e None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:04.591438 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d9c2c-11cc-48d4-94bc-711406b25f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:04.592359 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d9c2c-11cc-48d4-94bc-711406b25f17 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:04.593059 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d9c2c-11cc-48d4-94bc-711406b25f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:04.593689 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d9c2c-11cc-48d4-94bc-711406b25f17 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:04.603646 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41379c-5d3e-49a2-8fc4-45a208c010f6 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:04.603946 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41379c-5d3e-49a2-8fc4-45a208c010f6 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:04.604236 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41379c-5d3e-49a2-8fc4-45a208c010f6 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:04.605888 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 77/159] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 13:02:04.612102 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16310221-1f01-45e3-ba87-dc7e67134fa7 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:04.612408 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16310221-1f01-45e3-ba87-dc7e67134fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:04.612686 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16310221-1f01-45e3-ba87-dc7e67134fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:04.626646 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8d9c2c-11cc-48d4-94bc-711406b25f17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:02:04.642581 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-5f8d9c2c-11cc-48d4-94bc-711406b25f17 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 13:02:04.642581 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:04.642581 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:04.642581 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:04.642581 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:04.642581 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:04.642581 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:04.642581 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:04.642581 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:04.642581 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:04.642581 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:04.642581 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:04.642581 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:02:04.642581 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:02:04.642581 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:02:04.642581 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:02:04.643591 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:02:04.643591 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:02:04.643591 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:02:04.643591 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:02:04.643591 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:04.643591 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:04.643591 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:04.643591 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:04.643591 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:04.643591 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:04.643591 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:04.643591 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:04.643591 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:04.643591 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:04.643591 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:04.643591 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:04.644467 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:04.644467 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:04.644467 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:04.644467 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:04.644467 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:02:04.644467 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:02:04.644467 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:02:04.644467 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:02:04.644467 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:02:04.644467 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:02:04.644467 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 13:02:04.644467 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:02:04.645057 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-16310221-1f01-45e3-ba87-dc7e67134fa7 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:04.645625 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-16310221-1f01-45e3-ba87-dc7e67134fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:04.653615 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 83/160] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jun 3 13:02:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:04.656062 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d9c2c-11cc-48d4-94bc-711406b25f17 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:04.786594 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 78/161] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 13:02:04.829851 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16310221-1f01-45e3-ba87-dc7e67134fa7 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:04.842654 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d9c2c-11cc-48d4-94bc-711406b25f17 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:04.864967 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:04.955569 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16310221-1f01-45e3-ba87-dc7e67134fa7 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:04.957752 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418dfe8e-0c06-40e9-8b59-0957282c2b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:04.958449 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418dfe8e-0c06-40e9-8b59-0957282c2b11 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:04.958737 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418dfe8e-0c06-40e9-8b59-0957282c2b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:04.959016 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418dfe8e-0c06-40e9-8b59-0957282c2b11 None admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:04.959781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418dfe8e-0c06-40e9-8b59-0957282c2b11 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:04.960087 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418dfe8e-0c06-40e9-8b59-0957282c2b11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:04.961546 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418dfe8e-0c06-40e9-8b59-0957282c2b11 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:04.978734 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 84/162] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:02:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:04.984352 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418dfe8e-0c06-40e9-8b59-0957282c2b11 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:05.002216 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7ebbc-b6e5-48b8-be10-759ded9269b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:05.008262 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7ebbc-b6e5-48b8-be10-759ded9269b1 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:05.008262 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7ebbc-b6e5-48b8-be10-759ded9269b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:05.008262 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7ebbc-b6e5-48b8-be10-759ded9269b1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:05.023811 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d7ebbc-b6e5-48b8-be10-759ded9269b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:02:05.036754 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-71d7ebbc-b6e5-48b8-be10-759ded9269b1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 13:02:05.036754 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:05.036754 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:05.036754 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:05.036754 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:05.036754 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:05.036754 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:05.036754 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:05.036754 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:05.036754 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:05.036754 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:05.036754 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:05.036754 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:02:05.036754 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:02:05.036754 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:02:05.036754 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:02:05.037663 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:02:05.037663 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:02:05.037663 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:02:05.037663 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:02:05.037663 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:05.037663 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:05.037663 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:05.037663 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:05.037663 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:05.037663 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:05.037663 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:05.037663 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:05.037663 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:05.037663 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:05.037663 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:05.037663 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:05.038430 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:05.038430 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:05.038430 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:05.038430 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:05.038430 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:02:05.038430 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:02:05.038430 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:02:05.038430 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:02:05.038430 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:02:05.038430 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:02:05.038430 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 13:02:05.038430 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:02:05.038430 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 79/163] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:02:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:05.046830 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:05.048429 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7ebbc-b6e5-48b8-be10-759ded9269b1 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:05.177088 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418dfe8e-0c06-40e9-8b59-0957282c2b11 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:05.183018 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:05.196614 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7ebbc-b6e5-48b8-be10-759ded9269b1 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:05.231727 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027112da-2fec-4581-94fd-43e0aa5ade2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:05.232670 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027112da-2fec-4581-94fd-43e0aa5ade2c None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:05.232952 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027112da-2fec-4581-94fd-43e0aa5ade2c None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:05.233256 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027112da-2fec-4581-94fd-43e0aa5ade2c None admin] PATH_INFO: `/v3/users/dd10501b4efc4e1584a8886555a4f00a` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:05.234491 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027112da-2fec-4581-94fd-43e0aa5ade2c None admin] RBAC: Authorizing `identity:get_user(user_id=dd10501b4efc4e1584a8886555a4f00a)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:05.237004 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027112da-2fec-4581-94fd-43e0aa5ade2c None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:05.243473 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 85/164] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 13:02:04 2022] GET /identity/v3/users/dd10501b4efc4e1584a8886555a4f00a => generated 275 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:05.244428 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027112da-2fec-4581-94fd-43e0aa5ade2c None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:05.253428 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac14d1d-221d-48e4-ac02-9909ea0e7d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:05.254110 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac14d1d-221d-48e4-ac02-9909ea0e7d48 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:05.254389 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac14d1d-221d-48e4-ac02-9909ea0e7d48 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:05.254658 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac14d1d-221d-48e4-ac02-9909ea0e7d48 None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:05.255424 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac14d1d-221d-48e4-ac02-9909ea0e7d48 None admin] RBAC: Adding query filter params (name=member) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:05.255726 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac14d1d-221d-48e4-ac02-9909ea0e7d48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:05.257151 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac14d1d-221d-48e4-ac02-9909ea0e7d48 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:05.271708 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 80/165] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 13:02:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:05.278280 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac14d1d-221d-48e4-ac02-9909ea0e7d48 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:05.384916 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:05.403342 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac14d1d-221d-48e4-ac02-9909ea0e7d48 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:05.409268 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027112da-2fec-4581-94fd-43e0aa5ade2c None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:05.439449 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10487af3-a4cd-4021-a3df-f62063a2247e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:05.440419 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10487af3-a4cd-4021-a3df-f62063a2247e None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:05.440707 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10487af3-a4cd-4021-a3df-f62063a2247e None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:05.440981 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10487af3-a4cd-4021-a3df-f62063a2247e None admin] PATH_INFO: `/v3/users/dd10501b4efc4e1584a8886555a4f00a` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:05.442190 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10487af3-a4cd-4021-a3df-f62063a2247e None admin] RBAC: Authorizing `identity:get_user(user_id=dd10501b4efc4e1584a8886555a4f00a)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:05.444945 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10487af3-a4cd-4021-a3df-f62063a2247e None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:05.445408 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 81/166] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 13:02:05 2022] GET /identity/v3/users/dd10501b4efc4e1584a8886555a4f00a => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:02:05.452090 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10487af3-a4cd-4021-a3df-f62063a2247e None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:05.477722 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:05.481843 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0450586c-8243-4ac5-b041-fb18a4836e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:05.482446 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450586c-8243-4ac5-b041-fb18a4836e56 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:05.482728 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450586c-8243-4ac5-b041-fb18a4836e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:05.483006 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450586c-8243-4ac5-b041-fb18a4836e56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:05.582882 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10487af3-a4cd-4021-a3df-f62063a2247e None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:05.628996 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904a26f-c739-46cd-a8f6-15b9afad13c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:05.629652 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904a26f-c739-46cd-a8f6-15b9afad13c4 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:05.629935 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904a26f-c739-46cd-a8f6-15b9afad13c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:05.630207 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904a26f-c739-46cd-a8f6-15b9afad13c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:05.633209 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0450586c-8243-4ac5-b041-fb18a4836e56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:05.634720 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0450586c-8243-4ac5-b041-fb18a4836e56 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:05.699606 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7904a26f-c739-46cd-a8f6-15b9afad13c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:05.701142 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7904a26f-c739-46cd-a8f6-15b9afad13c4 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:05.728555 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:05.807736 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 82/167] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:02:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 03 13:02:05.809044 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87046b-2b09-4f1d-a638-c609fcd62196 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:05.809318 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87046b-2b09-4f1d-a638-c609fcd62196 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:05.809607 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87046b-2b09-4f1d-a638-c609fcd62196 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:05.811020 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 83/168] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:05.816746 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc87046b-2b09-4f1d-a638-c609fcd62196 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:05.877632 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:05.906773 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 86/169] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:02:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 663 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:05.908139 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4e848-87c5-4556-9204-3a3546984b21 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:05.908457 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4e848-87c5-4556-9204-3a3546984b21 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:05.908734 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4e848-87c5-4556-9204-3a3546984b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:06.009526 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-f7d4e848-87c5-4556-9204-3a3546984b21 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:06.010739 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-f7d4e848-87c5-4556-9204-3a3546984b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:06.028538 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc87046b-2b09-4f1d-a638-c609fcd62196 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:06.072407 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:06.098896 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f124d8-83e8-4590-abca-07e510c08815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:06.099770 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f124d8-83e8-4590-abca-07e510c08815 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:06.100047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f124d8-83e8-4590-abca-07e510c08815 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:06.100340 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f124d8-83e8-4590-abca-07e510c08815 None admin] PATH_INFO: `/v3/projects/57abebb6d35f4e5085880bf49a442713` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:06.102670 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f124d8-83e8-4590-abca-07e510c08815 None admin] RBAC: Authorizing `identity:get_project(project_id=57abebb6d35f4e5085880bf49a442713)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:06.104113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f124d8-83e8-4590-abca-07e510c08815 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:06.105841 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 84/170] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:02:05 2022] GET /identity/v3/projects/57abebb6d35f4e5085880bf49a442713 => generated 312 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:06.106644 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f124d8-83e8-4590-abca-07e510c08815 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:06.155047 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 87/171] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:02:06.155927 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4e848-87c5-4556-9204-3a3546984b21 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:06.336903 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f124d8-83e8-4590-abca-07e510c08815 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:06.390401 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4e848-87c5-4556-9204-3a3546984b21 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:06.413463 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57355ae9-82f9-454d-863b-810e7bc0a681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:06.414335 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57355ae9-82f9-454d-863b-810e7bc0a681 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:06.414612 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57355ae9-82f9-454d-863b-810e7bc0a681 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:06.414881 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57355ae9-82f9-454d-863b-810e7bc0a681 None admin] PATH_INFO: `/v3/projects/69bee49150564ea3abbe7a2301dea4d8` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:06.420876 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57355ae9-82f9-454d-863b-810e7bc0a681 None admin] RBAC: Authorizing `identity:get_project(project_id=69bee49150564ea3abbe7a2301dea4d8)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:06.422707 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57355ae9-82f9-454d-863b-810e7bc0a681 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:06.424634 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 85/172] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:02:06 2022] GET /identity/v3/projects/69bee49150564ea3abbe7a2301dea4d8 => generated 298 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:06.425418 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57355ae9-82f9-454d-863b-810e7bc0a681 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:06.436495 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:06.467048 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d615cc-e472-4664-ab9e-17bf23dbe772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:06.467874 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d615cc-e472-4664-ab9e-17bf23dbe772 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:06.468296 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d615cc-e472-4664-ab9e-17bf23dbe772 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:06.468577 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d615cc-e472-4664-ab9e-17bf23dbe772 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:06.469553 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d615cc-e472-4664-ab9e-17bf23dbe772 None admin] RBAC: Adding query filter params (role.id=d082d2b37fd1455ea61819353e8369ed, scope.project.id=57abebb6d35f4e5085880bf49a442713, user.id=dd10501b4efc4e1584a8886555a4f00a) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:06.469870 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d615cc-e472-4664-ab9e-17bf23dbe772 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:06.471572 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d615cc-e472-4664-ab9e-17bf23dbe772 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:06.485770 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 88/173] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 13:02:06 2022] GET /identity/v3/role_assignments?user.id=dd10501b4efc4e1584a8886555a4f00a&scope.project.id=57abebb6d35f4e5085880bf49a442713&role.id=d082d2b37fd1455ea61819353e8369ed => generated 608 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:06.486653 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d615cc-e472-4664-ab9e-17bf23dbe772 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:06.523898 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:06.573743 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57355ae9-82f9-454d-863b-810e7bc0a681 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:06.611830 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7fc7b-97be-448c-beef-8a2a5ff46d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:06.612609 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7fc7b-97be-448c-beef-8a2a5ff46d0d None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:06.612891 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7fc7b-97be-448c-beef-8a2a5ff46d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:06.613648 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7fc7b-97be-448c-beef-8a2a5ff46d0d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:06.626614 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb7fc7b-97be-448c-beef-8a2a5ff46d0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:02:06.635673 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-3cb7fc7b-97be-448c-beef-8a2a5ff46d0d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:02:06.635673 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:06.635673 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:06.635673 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:06.635673 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:06.635673 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:06.635673 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:06.635673 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:06.635673 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:06.635673 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:06.635673 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:06.635673 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:06.635673 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:02:06.635673 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:02:06.635673 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:02:06.635673 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:02:06.636676 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:02:06.636676 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:02:06.636676 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:02:06.636676 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:02:06.636676 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:06.636676 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:06.636676 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:06.636676 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:06.636676 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:06.636676 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:06.636676 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:06.636676 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:06.636676 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:06.636676 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:06.636676 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:06.636676 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:06.637458 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:06.637458 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:06.637458 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:06.637458 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:06.637458 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:02:06.637458 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:02:06.637458 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:02:06.637458 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:02:06.637458 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:02:06.637458 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:02:06.637458 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:02:06.637458 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:02:06.638628 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 86/174] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 13:02:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:06.649433 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7fc7b-97be-448c-beef-8a2a5ff46d0d None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:06.709222 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d615cc-e472-4664-ab9e-17bf23dbe772 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:06.775965 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7fc7b-97be-448c-beef-8a2a5ff46d0d None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:06.786749 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd80b0d-6b5b-417b-9169-2f0f60cb2e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:06.787582 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd80b0d-6b5b-417b-9169-2f0f60cb2e4f None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:06.787872 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd80b0d-6b5b-417b-9169-2f0f60cb2e4f None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:06.788166 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd80b0d-6b5b-417b-9169-2f0f60cb2e4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:06.789027 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd80b0d-6b5b-417b-9169-2f0f60cb2e4f None admin] RBAC: Adding query filter params (role.id=7476baf91a50401596c34535d2c79a4f, scope.project.id=69bee49150564ea3abbe7a2301dea4d8, user.id=dd10501b4efc4e1584a8886555a4f00a) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:06.789339 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd80b0d-6b5b-417b-9169-2f0f60cb2e4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:06.791057 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd80b0d-6b5b-417b-9169-2f0f60cb2e4f None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:06.810401 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 89/175] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 13:02:06 2022] GET /identity/v3/role_assignments?user.id=dd10501b4efc4e1584a8886555a4f00a&scope.project.id=69bee49150564ea3abbe7a2301dea4d8&role.id=7476baf91a50401596c34535d2c79a4f => generated 608 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:06.814510 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b31f147-3838-47f4-8d92-652a76142faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:06.815210 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b31f147-3838-47f4-8d92-652a76142faf None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:06.815496 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b31f147-3838-47f4-8d92-652a76142faf None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:06.815776 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b31f147-3838-47f4-8d92-652a76142faf None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:06.816590 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b31f147-3838-47f4-8d92-652a76142faf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:06.816903 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b31f147-3838-47f4-8d92-652a76142faf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:06.817375 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:06.824511 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b31f147-3838-47f4-8d92-652a76142faf None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:06.834822 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 87/176] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:02:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:02:06.842599 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd80b0d-6b5b-417b-9169-2f0f60cb2e4f None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:06.915873 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:06.999104 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd80b0d-6b5b-417b-9169-2f0f60cb2e4f None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:07.028849 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee7517-5000-482c-a481-798fdab8eb25 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:07.029188 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee7517-5000-482c-a481-798fdab8eb25 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:07.029405 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee7517-5000-482c-a481-798fdab8eb25 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:07.031084 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 88/177] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:07.039974 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e223c66-22f0-4f8a-9d3f-e5d5cb4dc94e None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:07.040325 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e223c66-22f0-4f8a-9d3f-e5d5cb4dc94e None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:07.040764 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e223c66-22f0-4f8a-9d3f-e5d5cb4dc94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:07.052629 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2bfa2c-fefc-4260-8b5e-9f260f3d70ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:07.053524 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bfa2c-fefc-4260-8b5e-9f260f3d70ca None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:07.053807 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bfa2c-fefc-4260-8b5e-9f260f3d70ca None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:07.054084 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bfa2c-fefc-4260-8b5e-9f260f3d70ca None admin] PATH_INFO: `/v3/users/31e8e6595d7242a98c3388e4c3784e70` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:07.061033 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2bfa2c-fefc-4260-8b5e-9f260f3d70ca None admin] RBAC: Authorizing `identity:get_user(user_id=31e8e6595d7242a98c3388e4c3784e70)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:07.062513 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2bfa2c-fefc-4260-8b5e-9f260f3d70ca None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:07.065510 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 90/178] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 13:02:06 2022] GET /identity/v3/users/31e8e6595d7242a98c3388e4c3784e70 => generated 247 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:07.066261 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-2e223c66-22f0-4f8a-9d3f-e5d5cb4dc94e None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:07.067480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-2e223c66-22f0-4f8a-9d3f-e5d5cb4dc94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:07.073958 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2bfa2c-fefc-4260-8b5e-9f260f3d70ca None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:07.200264 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2bfa2c-fefc-4260-8b5e-9f260f3d70ca None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:07.217894 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:07.240598 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb7a73c-1380-4e88-abe6-704f694988e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:07.241420 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7a73c-1380-4e88-abe6-704f694988e8 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:07.241708 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7a73c-1380-4e88-abe6-704f694988e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:07.242109 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7a73c-1380-4e88-abe6-704f694988e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:07.289584 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 89/179] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 13:02:07.330992 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb7a73c-1380-4e88-abe6-704f694988e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:07.332597 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb7a73c-1380-4e88-abe6-704f694988e8 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:07.339104 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e223c66-22f0-4f8a-9d3f-e5d5cb4dc94e None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:07.460044 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e223c66-22f0-4f8a-9d3f-e5d5cb4dc94e None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:07.472601 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:07.501551 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de6724-1b31-47cd-9e1a-5d75a13568d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:07.504620 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de6724-1b31-47cd-9e1a-5d75a13568d5 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:07.504620 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de6724-1b31-47cd-9e1a-5d75a13568d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:07.504620 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de6724-1b31-47cd-9e1a-5d75a13568d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:07.518045 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3de6724-1b31-47cd-9e1a-5d75a13568d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:02:07.527954 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-c3de6724-1b31-47cd-9e1a-5d75a13568d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:02:07.527954 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:07.527954 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:07.527954 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:07.527954 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:07.527954 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:07.527954 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:07.527954 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:07.527954 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:07.527954 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:07.527954 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:07.527954 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:07.527954 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:02:07.527954 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:02:07.527954 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:02:07.527954 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:02:07.528974 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:02:07.528974 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:02:07.528974 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:02:07.528974 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:02:07.528974 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:07.528974 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:07.528974 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:07.528974 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:07.528974 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:07.528974 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:07.528974 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:07.528974 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:07.528974 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:07.528974 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:07.528974 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:07.528974 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:07.529750 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:07.529750 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:07.529750 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:07.529750 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:07.529750 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:02:07.529750 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:02:07.529750 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:02:07.529750 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:02:07.529750 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:02:07.529750 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:02:07.529750 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:02:07.529750 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:02:07.530342 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 90/180] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 13:02:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:02:07.536650 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de6724-1b31-47cd-9e1a-5d75a13568d5 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:07.566785 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 91/181] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:02:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 03 13:02:07.568840 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5e5dc-6a78-40a5-81c4-f78a9cb321d7 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:07.569525 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5e5dc-6a78-40a5-81c4-f78a9cb321d7 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:07.570001 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5e5dc-6a78-40a5-81c4-f78a9cb321d7 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:07.571499 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 92/182] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:07.576858 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13f3a1-9135-499c-b0f8-a2572163a8df None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:07.577369 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13f3a1-9135-499c-b0f8-a2572163a8df None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:07.577856 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13f3a1-9135-499c-b0f8-a2572163a8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:07.595712 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-ca13f3a1-9135-499c-b0f8-a2572163a8df None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:07.597540 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-ca13f3a1-9135-499c-b0f8-a2572163a8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:07.605780 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:07.665162 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de6724-1b31-47cd-9e1a-5d75a13568d5 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:07.670844 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 93/183] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:02:07.671879 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13f3a1-9135-499c-b0f8-a2572163a8df None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:07.705343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429136bf-d669-49d7-988f-fa10b045328d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:07.706543 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429136bf-d669-49d7-988f-fa10b045328d None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:07.706826 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429136bf-d669-49d7-988f-fa10b045328d None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:07.707243 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429136bf-d669-49d7-988f-fa10b045328d None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:07.708131 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429136bf-d669-49d7-988f-fa10b045328d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:07.708701 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429136bf-d669-49d7-988f-fa10b045328d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:07.710740 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429136bf-d669-49d7-988f-fa10b045328d None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:07.722843 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 91/184] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:02:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:02:07.725555 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53794d-7f22-45e2-b088-172121c1dbd8 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:07.725927 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53794d-7f22-45e2-b088-172121c1dbd8 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:07.726270 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53794d-7f22-45e2-b088-172121c1dbd8 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:07.727692 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 92/185] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:07.728502 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb53794d-7f22-45e2-b088-172121c1dbd8 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:07.760955 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:07.794229 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13f3a1-9135-499c-b0f8-a2572163a8df None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:07.828535 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b03671-3ba8-4b95-9a3f-016e1fbc28af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:07.829553 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b03671-3ba8-4b95-9a3f-016e1fbc28af None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:07.829834 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b03671-3ba8-4b95-9a3f-016e1fbc28af None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:07.830119 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b03671-3ba8-4b95-9a3f-016e1fbc28af None admin] PATH_INFO: `/v3/projects/69bee49150564ea3abbe7a2301dea4d8` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:07.831291 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b03671-3ba8-4b95-9a3f-016e1fbc28af None admin] RBAC: Authorizing `identity:get_project(project_id=69bee49150564ea3abbe7a2301dea4d8)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:07.832767 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b03671-3ba8-4b95-9a3f-016e1fbc28af None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:07.834551 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 94/186] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:02:07 2022] GET /identity/v3/projects/69bee49150564ea3abbe7a2301dea4d8 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:07.835613 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b03671-3ba8-4b95-9a3f-016e1fbc28af None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:07.848462 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb53794d-7f22-45e2-b088-172121c1dbd8 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:07.848909 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:07.885006 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc510312-e164-4f02-aef7-60f0d0fbdcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:07.885795 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc510312-e164-4f02-aef7-60f0d0fbdcb3 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:07.886077 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc510312-e164-4f02-aef7-60f0d0fbdcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:07.886345 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc510312-e164-4f02-aef7-60f0d0fbdcb3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:07.896280 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc510312-e164-4f02-aef7-60f0d0fbdcb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:02:07.903794 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-bc510312-e164-4f02-aef7-60f0d0fbdcb3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 13:02:07.903794 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:07.903794 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:07.903794 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:07.903794 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:07.903794 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:07.903794 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:07.903794 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:07.903794 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:07.903794 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:07.903794 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:07.903794 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:07.903794 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:02:07.903794 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:02:07.903794 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:02:07.903794 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:02:07.904771 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:02:07.904771 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:02:07.904771 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:02:07.904771 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:02:07.904771 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:07.904771 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:07.904771 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:07.904771 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:07.904771 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:07.904771 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:07.904771 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:07.904771 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:07.904771 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:07.904771 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:07.904771 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:07.904771 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:07.905565 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:07.905565 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:07.905565 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:07.905565 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:07.905565 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:02:07.905565 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:02:07.905565 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:02:07.905565 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:02:07.905565 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:02:07.905565 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:02:07.905565 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 13:02:07.905565 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:02:07.905565 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 93/187] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:02:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:07.906257 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638f317-93bd-425e-903a-8a72fda26be8 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:07.907162 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638f317-93bd-425e-903a-8a72fda26be8 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:07.907397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638f317-93bd-425e-903a-8a72fda26be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:07.926176 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-b638f317-93bd-425e-903a-8a72fda26be8 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:07.927386 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-b638f317-93bd-425e-903a-8a72fda26be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:07.945975 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b03671-3ba8-4b95-9a3f-016e1fbc28af None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:07.982451 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04142ab2-cd96-48f5-864d-cde00f839157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:07.983251 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04142ab2-cd96-48f5-864d-cde00f839157 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:07.983537 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04142ab2-cd96-48f5-864d-cde00f839157 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:07.983814 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04142ab2-cd96-48f5-864d-cde00f839157 None admin] PATH_INFO: `/v3/users/a12691e1e6b143ceb7ce5533a7a5ff26` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:07.994156 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 94/188] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:02:07.999960 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638f317-93bd-425e-903a-8a72fda26be8 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:08.002970 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04142ab2-cd96-48f5-864d-cde00f839157 None admin] RBAC: Authorizing `identity:get_user(user_id=a12691e1e6b143ceb7ce5533a7a5ff26)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:08.005314 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04142ab2-cd96-48f5-864d-cde00f839157 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:08.007220 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 95/189] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 13:02:07 2022] GET /identity/v3/users/a12691e1e6b143ceb7ce5533a7a5ff26 => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:08.008740 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278be72d-437b-433e-9750-016951bdd192 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:08.009026 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278be72d-437b-433e-9750-016951bdd192 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:08.009431 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278be72d-437b-433e-9750-016951bdd192 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:08.015082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 96/190] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:08.015082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278be72d-437b-433e-9750-016951bdd192 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:08.023708 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:08.084736 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:08.098625 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638f317-93bd-425e-903a-8a72fda26be8 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:08.121564 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278be72d-437b-433e-9750-016951bdd192 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:08.133596 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108a7ca-4dec-4efa-847f-bda367fa86ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:08.134257 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108a7ca-4dec-4efa-847f-bda367fa86ea None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:08.134547 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108a7ca-4dec-4efa-847f-bda367fa86ea None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:08.134826 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108a7ca-4dec-4efa-847f-bda367fa86ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:08.135654 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108a7ca-4dec-4efa-847f-bda367fa86ea None admin] RBAC: Adding query filter params (role.id=bbd5f3e0c18e4992886fcfb4a3feb426, scope.project.id=69bee49150564ea3abbe7a2301dea4d8, user.id=31e8e6595d7242a98c3388e4c3784e70) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:08.135964 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108a7ca-4dec-4efa-847f-bda367fa86ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:08.137467 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108a7ca-4dec-4efa-847f-bda367fa86ea None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:08.143443 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 95/191] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 13:02:07 2022] GET /identity/v3/role_assignments?user.id=31e8e6595d7242a98c3388e4c3784e70&scope.project.id=69bee49150564ea3abbe7a2301dea4d8&role.id=bbd5f3e0c18e4992886fcfb4a3feb426 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:08.144343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108a7ca-4dec-4efa-847f-bda367fa86ea None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:08.157742 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc5fd1-e91b-4ca0-90c5-422c967d095f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:08.158467 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc5fd1-e91b-4ca0-90c5-422c967d095f None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:08.158744 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc5fd1-e91b-4ca0-90c5-422c967d095f None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:08.159025 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc5fd1-e91b-4ca0-90c5-422c967d095f None admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:08.159825 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bc5fd1-e91b-4ca0-90c5-422c967d095f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:08.160196 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bc5fd1-e91b-4ca0-90c5-422c967d095f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:08.161650 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bc5fd1-e91b-4ca0-90c5-422c967d095f None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:08.176406 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 97/192] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 13:02:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:08.176406 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec845c3c-0b4b-4f0b-8711-91eb75f18556 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:08.176406 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec845c3c-0b4b-4f0b-8711-91eb75f18556 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:08.176406 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec845c3c-0b4b-4f0b-8711-91eb75f18556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:08.193129 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-ec845c3c-0b4b-4f0b-8711-91eb75f18556 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:08.194368 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-ec845c3c-0b4b-4f0b-8711-91eb75f18556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:08.249872 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:08.266528 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108a7ca-4dec-4efa-847f-bda367fa86ea None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:08.285277 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 98/193] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:02:08.286785 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec845c3c-0b4b-4f0b-8711-91eb75f18556 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:08.316751 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d156e12-461c-49c4-b1a4-51da8abf6705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:08.317737 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d156e12-461c-49c4-b1a4-51da8abf6705 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:08.318300 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d156e12-461c-49c4-b1a4-51da8abf6705 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:08.318582 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d156e12-461c-49c4-b1a4-51da8abf6705 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:08.366477 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:08.397808 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d156e12-461c-49c4-b1a4-51da8abf6705 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:08.399281 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d156e12-461c-49c4-b1a4-51da8abf6705 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:08.413407 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec845c3c-0b4b-4f0b-8711-91eb75f18556 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:08.449996 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b78117-b50a-4d74-9c70-992dca62a2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:08.450807 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b78117-b50a-4d74-9c70-992dca62a2ba None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:08.451093 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b78117-b50a-4d74-9c70-992dca62a2ba None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:08.451362 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b78117-b50a-4d74-9c70-992dca62a2ba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:08.461885 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b78117-b50a-4d74-9c70-992dca62a2ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:02:08.470910 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-33b78117-b50a-4d74-9c70-992dca62a2ba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 13:02:08.470910 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:08.470910 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:08.470910 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:08.470910 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:08.470910 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:08.470910 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:08.470910 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:08.470910 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:08.470910 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:08.470910 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:08.470910 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:08.470910 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:02:08.470910 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:02:08.470910 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:02:08.470910 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:02:08.471796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:02:08.471796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:02:08.471796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:02:08.471796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:02:08.471796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:08.471796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:08.471796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:08.471796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:08.471796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:08.471796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:08.471796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:08.471796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:08.471796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:08.471796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:08.471796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:08.471796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:08.472914 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:08.472914 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:08.472914 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:08.472914 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:08.472914 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:02:08.472914 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:02:08.472914 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:02:08.472914 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:02:08.472914 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:02:08.472914 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:02:08.472914 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 13:02:08.472914 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:02:08.472914 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 99/194] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jun 3 13:02:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:08.473585 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b78117-b50a-4d74-9c70-992dca62a2ba None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:08.484192 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:08.500583 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 96/195] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:02:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:08.501464 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d156e12-461c-49c4-b1a4-51da8abf6705 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:08.578132 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b78117-b50a-4d74-9c70-992dca62a2ba None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:08.598088 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:08.603687 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d156e12-461c-49c4-b1a4-51da8abf6705 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:08.611895 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00becf2-2792-488b-b414-a59e81bbb9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:08.612794 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00becf2-2792-488b-b414-a59e81bbb9e0 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:08.613077 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00becf2-2792-488b-b414-a59e81bbb9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:08.613350 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00becf2-2792-488b-b414-a59e81bbb9e0 None admin] PATH_INFO: `/v3/users/c3181dffc3e14068851292120f2c18a1` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:08.614654 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00becf2-2792-488b-b414-a59e81bbb9e0 None admin] RBAC: Authorizing `identity:get_user(user_id=c3181dffc3e14068851292120f2c18a1)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:08.616116 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00becf2-2792-488b-b414-a59e81bbb9e0 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:08.617762 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 100/196] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 13:02:08 2022] GET /identity/v3/users/c3181dffc3e14068851292120f2c18a1 => generated 289 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:08.618517 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00becf2-2792-488b-b414-a59e81bbb9e0 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:08.637372 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92fb114-cf8d-4a1d-9079-6b6483cfea5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:08.638155 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92fb114-cf8d-4a1d-9079-6b6483cfea5f None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:08.638435 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92fb114-cf8d-4a1d-9079-6b6483cfea5f None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:08.638706 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92fb114-cf8d-4a1d-9079-6b6483cfea5f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:08.639956 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92fb114-cf8d-4a1d-9079-6b6483cfea5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:08.641552 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92fb114-cf8d-4a1d-9079-6b6483cfea5f None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:08.643182 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 97/197] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:02:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:08.643941 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92fb114-cf8d-4a1d-9079-6b6483cfea5f None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:08.697207 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:08.718185 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00becf2-2792-488b-b414-a59e81bbb9e0 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:08.741768 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92fb114-cf8d-4a1d-9079-6b6483cfea5f None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:08.752076 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e2f54-0f1c-4f75-8e71-33786a250b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:08.752473 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e2f54-0f1c-4f75-8e71-33786a250b5b None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:08.752756 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e2f54-0f1c-4f75-8e71-33786a250b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:08.753041 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e2f54-0f1c-4f75-8e71-33786a250b5b None admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:08.753771 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e2f54-0f1c-4f75-8e71-33786a250b5b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:08.754077 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e2f54-0f1c-4f75-8e71-33786a250b5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:08.755463 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e2f54-0f1c-4f75-8e71-33786a250b5b None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:08.763499 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 101/198] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:02:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:08.764303 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e2f54-0f1c-4f75-8e71-33786a250b5b None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:08.779942 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf529c-7314-4ca9-96e4-379042536ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:08.780834 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf529c-7314-4ca9-96e4-379042536ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:08.781116 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf529c-7314-4ca9-96e4-379042536ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:08.781390 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf529c-7314-4ca9-96e4-379042536ab2 None admin] PATH_INFO: `/v3/projects/25310838cd094a4aba3f8ea2a06ff3c4` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:08.783120 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf529c-7314-4ca9-96e4-379042536ab2 None admin] RBAC: Authorizing `identity:get_project(project_id=25310838cd094a4aba3f8ea2a06ff3c4)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:08.784595 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf529c-7314-4ca9-96e4-379042536ab2 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:08.789387 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 98/199] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:02:08 2022] GET /identity/v3/projects/25310838cd094a4aba3f8ea2a06ff3c4 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:08.789387 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf529c-7314-4ca9-96e4-379042536ab2 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:08.815931 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:08.866226 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e2f54-0f1c-4f75-8e71-33786a250b5b None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:08.888824 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf529c-7314-4ca9-96e4-379042536ab2 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:08.903219 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9abb88-3b6c-44ba-a0fe-2f07b4f9a398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:08.903916 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9abb88-3b6c-44ba-a0fe-2f07b4f9a398 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:08.904234 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9abb88-3b6c-44ba-a0fe-2f07b4f9a398 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:08.904521 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9abb88-3b6c-44ba-a0fe-2f07b4f9a398 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:08.912458 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:08.924237 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd6f0b-5902-4b75-8b16-1fb1110db655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:08.924893 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd6f0b-5902-4b75-8b16-1fb1110db655 None admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:08.925173 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd6f0b-5902-4b75-8b16-1fb1110db655 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:08.925443 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd6f0b-5902-4b75-8b16-1fb1110db655 None admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:08.926185 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cd6f0b-5902-4b75-8b16-1fb1110db655 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:08.927633 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cd6f0b-5902-4b75-8b16-1fb1110db655 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:08.973411 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9abb88-3b6c-44ba-a0fe-2f07b4f9a398 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:08.974869 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9abb88-3b6c-44ba-a0fe-2f07b4f9a398 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:09.026794 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:09.027821 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 99/200] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jun 3 13:02:08 2022] POST /identity/v3/users => generated 297 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:09.028622 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd6f0b-5902-4b75-8b16-1fb1110db655 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:09.090406 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 102/201] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:02:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:09.091293 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9abb88-3b6c-44ba-a0fe-2f07b4f9a398 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:09.153660 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd6f0b-5902-4b75-8b16-1fb1110db655 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:09.194970 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ddc18-396b-473c-9187-3fba4324f486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:09.195863 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ddc18-396b-473c-9187-3fba4324f486 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:09.196175 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ddc18-396b-473c-9187-3fba4324f486 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:09.196628 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ddc18-396b-473c-9187-3fba4324f486 None admin] PATH_INFO: `/v3/users/a12691e1e6b143ceb7ce5533a7a5ff26` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:09.197959 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369ddc18-396b-473c-9187-3fba4324f486 None admin] RBAC: Authorizing `identity:get_user(user_id=a12691e1e6b143ceb7ce5533a7a5ff26)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:09.200182 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369ddc18-396b-473c-9187-3fba4324f486 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:09.207818 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 100/202] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 13:02:09 2022] GET /identity/v3/users/a12691e1e6b143ceb7ce5533a7a5ff26 => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:09.207818 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ddc18-396b-473c-9187-3fba4324f486 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:09.219408 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9abb88-3b6c-44ba-a0fe-2f07b4f9a398 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:09.267698 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167aaa90-a6ac-41d4-a984-f2330a73b234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:09.268353 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167aaa90-a6ac-41d4-a984-f2330a73b234 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:09.268634 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167aaa90-a6ac-41d4-a984-f2330a73b234 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:09.268909 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167aaa90-a6ac-41d4-a984-f2330a73b234 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:09.269745 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167aaa90-a6ac-41d4-a984-f2330a73b234 None admin] RBAC: Adding query filter params (role.id=bbd5f3e0c18e4992886fcfb4a3feb426, scope.project.id=25310838cd094a4aba3f8ea2a06ff3c4, user.id=a12691e1e6b143ceb7ce5533a7a5ff26) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:09.270055 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167aaa90-a6ac-41d4-a984-f2330a73b234 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:09.271594 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167aaa90-a6ac-41d4-a984-f2330a73b234 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:09.275961 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:09.278767 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 103/203] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 13:02:09 2022] GET /identity/v3/role_assignments?user.id=a12691e1e6b143ceb7ce5533a7a5ff26&scope.project.id=25310838cd094a4aba3f8ea2a06ff3c4&role.id=bbd5f3e0c18e4992886fcfb4a3feb426 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:09.284338 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167aaa90-a6ac-41d4-a984-f2330a73b234 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:09.302188 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:09.376040 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ddc18-396b-473c-9187-3fba4324f486 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:09.430616 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167aaa90-a6ac-41d4-a984-f2330a73b234 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:09.434082 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2be58-bb88-4189-8167-75a47f1881ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:09.435288 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2be58-bb88-4189-8167-75a47f1881ca None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:09.435897 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2be58-bb88-4189-8167-75a47f1881ca None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:09.436221 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2be58-bb88-4189-8167-75a47f1881ca None admin] PATH_INFO: `/v3/projects/69bee49150564ea3abbe7a2301dea4d8` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:09.437488 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2be58-bb88-4189-8167-75a47f1881ca None admin] RBAC: Authorizing `identity:get_project(project_id=69bee49150564ea3abbe7a2301dea4d8)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:09.439082 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2be58-bb88-4189-8167-75a47f1881ca None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:09.441272 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 101/204] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:02:09 2022] GET /identity/v3/projects/69bee49150564ea3abbe7a2301dea4d8 => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:09.446995 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2be58-bb88-4189-8167-75a47f1881ca None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:09.476871 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0933cc9-9b45-4790-bbb7-b20664c3a55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:09.477567 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0933cc9-9b45-4790-bbb7-b20664c3a55a None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:09.477854 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0933cc9-9b45-4790-bbb7-b20664c3a55a None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:09.478256 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0933cc9-9b45-4790-bbb7-b20664c3a55a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:09.582098 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0933cc9-9b45-4790-bbb7-b20664c3a55a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:09.583516 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0933cc9-9b45-4790-bbb7-b20664c3a55a None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:09.591532 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2be58-bb88-4189-8167-75a47f1881ca None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:09.607840 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:09.614871 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:09.665367 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824637d0-edf5-4800-a090-4c433ef949a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:09.666061 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824637d0-edf5-4800-a090-4c433ef949a6 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:09.666341 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824637d0-edf5-4800-a090-4c433ef949a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:09.666611 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824637d0-edf5-4800-a090-4c433ef949a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:09.667445 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824637d0-edf5-4800-a090-4c433ef949a6 None admin] RBAC: Adding query filter params (role.id=f3c7872a0874484085c534eb05e404eb, scope.project.id=69bee49150564ea3abbe7a2301dea4d8, user.id=c3181dffc3e14068851292120f2c18a1) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:09.667755 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824637d0-edf5-4800-a090-4c433ef949a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:09.669220 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824637d0-edf5-4800-a090-4c433ef949a6 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:09.675825 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 102/205] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 13:02:09 2022] GET /identity/v3/role_assignments?user.id=c3181dffc3e14068851292120f2c18a1&scope.project.id=69bee49150564ea3abbe7a2301dea4d8&role.id=f3c7872a0874484085c534eb05e404eb => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:02:09.798989 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 104/206] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:02:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:09.804989 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824637d0-edf5-4800-a090-4c433ef949a6 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:09.985789 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824637d0-edf5-4800-a090-4c433ef949a6 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:10.031221 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17281f2-4721-4322-81cf-5aea93e20deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:10.033585 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17281f2-4721-4322-81cf-5aea93e20deb None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:10.033872 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17281f2-4721-4322-81cf-5aea93e20deb None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:10.034147 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17281f2-4721-4322-81cf-5aea93e20deb None admin] PATH_INFO: `/v3/projects/25310838cd094a4aba3f8ea2a06ff3c4` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:10.035406 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17281f2-4721-4322-81cf-5aea93e20deb None admin] RBAC: Authorizing `identity:get_project(project_id=25310838cd094a4aba3f8ea2a06ff3c4)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:10.036958 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17281f2-4721-4322-81cf-5aea93e20deb None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:10.039918 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 103/207] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:02:09 2022] GET /identity/v3/projects/25310838cd094a4aba3f8ea2a06ff3c4 => generated 302 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:10.046077 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0933cc9-9b45-4790-bbb7-b20664c3a55a None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:10.170008 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0933cc9-9b45-4790-bbb7-b20664c3a55a None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:10.185047 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:10.208718 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd61ec3-2d44-4e00-a4a7-bb55293b2551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:10.209414 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd61ec3-2d44-4e00-a4a7-bb55293b2551 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:10.209699 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd61ec3-2d44-4e00-a4a7-bb55293b2551 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:10.210102 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd61ec3-2d44-4e00-a4a7-bb55293b2551 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:10.210949 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd61ec3-2d44-4e00-a4a7-bb55293b2551 None admin] RBAC: Adding query filter params (role.id=7476baf91a50401596c34535d2c79a4f, scope.project.id=25310838cd094a4aba3f8ea2a06ff3c4, user.id=a12691e1e6b143ceb7ce5533a7a5ff26) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:10.211262 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd61ec3-2d44-4e00-a4a7-bb55293b2551 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:10.212801 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd61ec3-2d44-4e00-a4a7-bb55293b2551 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:10.221357 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 105/208] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 13:02:10 2022] GET /identity/v3/role_assignments?user.id=a12691e1e6b143ceb7ce5533a7a5ff26&scope.project.id=25310838cd094a4aba3f8ea2a06ff3c4&role.id=7476baf91a50401596c34535d2c79a4f => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:11.739850 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed2322-c14a-465d-aa20-ca40769cbdcb None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:11.740406 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed2322-c14a-465d-aa20-ca40769cbdcb None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:11.740406 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed2322-c14a-465d-aa20-ca40769cbdcb None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:11.742025 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 104/209] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:11.747482 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4c321-a134-44f8-bc31-70cdfcecf465 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:11.747878 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4c321-a134-44f8-bc31-70cdfcecf465 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:11.748060 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4c321-a134-44f8-bc31-70cdfcecf465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:11.765216 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-4ff4c321-a134-44f8-bc31-70cdfcecf465 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:11.766556 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-4ff4c321-a134-44f8-bc31-70cdfcecf465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:11.836902 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 106/210] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:02:11.844704 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61b4ab-440f-46cf-8887-4d5cf7c34de4 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:11.845192 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61b4ab-440f-46cf-8887-4d5cf7c34de4 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:11.845654 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61b4ab-440f-46cf-8887-4d5cf7c34de4 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:11.847322 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 105/211] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:11.852892 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a8562-99b4-4b45-91c6-a5b494777098 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:11.860102 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a8562-99b4-4b45-91c6-a5b494777098 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:11.860102 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a8562-99b4-4b45-91c6-a5b494777098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:11.862988 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f61b4ab-440f-46cf-8887-4d5cf7c34de4 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:11.871018 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-209a8562-99b4-4b45-91c6-a5b494777098 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:11.872237 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-209a8562-99b4-4b45-91c6-a5b494777098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:11.918330 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:11.944941 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 107/212] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:02:11.946151 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1698989-a560-4c06-80ca-5fc64f96f0db None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:11.946526 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1698989-a560-4c06-80ca-5fc64f96f0db None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:11.946813 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1698989-a560-4c06-80ca-5fc64f96f0db None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:11.948262 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 108/213] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:11.954034 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e4176-a09f-4c0b-ba7d-2484f650bb5b None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:11.954336 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e4176-a09f-4c0b-ba7d-2484f650bb5b None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:11.954618 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e4176-a09f-4c0b-ba7d-2484f650bb5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:11.973468 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-eb0e4176-a09f-4c0b-ba7d-2484f650bb5b None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:11.974781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-eb0e4176-a09f-4c0b-ba7d-2484f650bb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:11.982177 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f61b4ab-440f-46cf-8887-4d5cf7c34de4 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:12.009026 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:12.024949 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e855ab7-4901-41e9-a332-d161aa36364f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:12.025819 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e855ab7-4901-41e9-a332-d161aa36364f None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:12.026106 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e855ab7-4901-41e9-a332-d161aa36364f None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:12.026385 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e855ab7-4901-41e9-a332-d161aa36364f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:12.038453 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e855ab7-4901-41e9-a332-d161aa36364f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:02:12.047018 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-6e855ab7-4901-41e9-a332-d161aa36364f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:02:12.047018 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:12.047018 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:12.047018 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:12.047018 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:12.047018 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:12.047018 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:12.047018 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:12.047018 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:12.047018 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:12.047018 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:12.047018 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:12.047018 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:02:12.047018 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:02:12.047018 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:02:12.047018 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:02:12.047945 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:02:12.047945 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:02:12.047945 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:02:12.047945 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:02:12.047945 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:12.047945 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:12.047945 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:12.047945 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:12.047945 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:12.047945 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:12.047945 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:12.047945 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:12.047945 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:12.047945 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:12.047945 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:12.047945 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:12.048764 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:12.048764 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:12.048764 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:12.048764 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:12.048764 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:02:12.048764 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:02:12.048764 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:02:12.048764 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:02:12.048764 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:02:12.048764 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:02:12.048764 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:02:12.048764 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:02:12.049364 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 109/214] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:02:12.049364 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e4176-a09f-4c0b-ba7d-2484f650bb5b None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:12.053769 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 106/215] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 13:02:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:02:12.054624 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e855ab7-4901-41e9-a332-d161aa36364f None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:12.168023 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e855ab7-4901-41e9-a332-d161aa36364f None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:12.168986 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e4176-a09f-4c0b-ba7d-2484f650bb5b None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:12.176018 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:12.204493 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d51de-b847-431e-8f49-253a406dcd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:12.205161 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d51de-b847-431e-8f49-253a406dcd67 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:12.205442 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d51de-b847-431e-8f49-253a406dcd67 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:12.205717 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d51de-b847-431e-8f49-253a406dcd67 None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:12.206452 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d51de-b847-431e-8f49-253a406dcd67 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:12.206755 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d51de-b847-431e-8f49-253a406dcd67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:12.208130 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d51de-b847-431e-8f49-253a406dcd67 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:12.209586 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91abdf9b-e6c5-407c-9f66-083b7449eb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:12.210383 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abdf9b-e6c5-407c-9f66-083b7449eb12 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:12.210669 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abdf9b-e6c5-407c-9f66-083b7449eb12 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:12.210947 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abdf9b-e6c5-407c-9f66-083b7449eb12 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:12.217185 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 107/216] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:02:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:12.218083 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d51de-b847-431e-8f49-253a406dcd67 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:12.227051 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91abdf9b-e6c5-407c-9f66-083b7449eb12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:02:12.237945 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-91abdf9b-e6c5-407c-9f66-083b7449eb12 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 13:02:12.237945 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:12.237945 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:12.237945 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:12.237945 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:12.237945 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:12.237945 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:12.237945 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:12.237945 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:12.237945 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:12.237945 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:12.237945 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:12.237945 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:02:12.237945 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:02:12.237945 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:02:12.237945 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:02:12.239087 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:02:12.239087 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:02:12.239087 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:02:12.239087 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:02:12.239087 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:12.239087 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:12.239087 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:12.239087 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:12.239087 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:12.239087 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:12.239087 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:12.239087 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:12.239087 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:12.239087 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:12.239087 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:12.239087 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:12.240066 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:12.240066 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:12.240066 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:12.240066 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:12.240066 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:02:12.240066 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:02:12.240066 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:02:12.240066 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:02:12.240066 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:02:12.240066 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:02:12.240066 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 13:02:12.240066 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:02:12.246359 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 110/217] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:02:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:12.246359 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91abdf9b-e6c5-407c-9f66-083b7449eb12 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:12.276387 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:12.329154 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d51de-b847-431e-8f49-253a406dcd67 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:12.355870 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91abdf9b-e6c5-407c-9f66-083b7449eb12 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:12.363454 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d63fbf-ec4f-48e2-95a2-5fab6a37e91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:12.364384 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d63fbf-ec4f-48e2-95a2-5fab6a37e91a None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:12.364663 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d63fbf-ec4f-48e2-95a2-5fab6a37e91a None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:12.364931 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d63fbf-ec4f-48e2-95a2-5fab6a37e91a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:12.366083 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d63fbf-ec4f-48e2-95a2-5fab6a37e91a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:12.367510 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d63fbf-ec4f-48e2-95a2-5fab6a37e91a None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:12.373536 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 108/218] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:02:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:12.373536 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d63fbf-ec4f-48e2-95a2-5fab6a37e91a None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:12.397282 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0118f31-f839-48a0-9301-38ad73f7e932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:12.398155 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0118f31-f839-48a0-9301-38ad73f7e932 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:12.398440 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0118f31-f839-48a0-9301-38ad73f7e932 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:12.398712 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0118f31-f839-48a0-9301-38ad73f7e932 None admin] PATH_INFO: `/v3/users/a12691e1e6b143ceb7ce5533a7a5ff26` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:12.399911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0118f31-f839-48a0-9301-38ad73f7e932 None admin] RBAC: Authorizing `identity:get_user(user_id=a12691e1e6b143ceb7ce5533a7a5ff26)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:12.401431 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0118f31-f839-48a0-9301-38ad73f7e932 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:12.403219 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 111/219] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 13:02:12 2022] GET /identity/v3/users/a12691e1e6b143ceb7ce5533a7a5ff26 => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:12.404993 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0118f31-f839-48a0-9301-38ad73f7e932 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:12.408608 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:12.477373 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d63fbf-ec4f-48e2-95a2-5fab6a37e91a None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:12.510645 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:12.515521 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5653e8c5-4773-496a-aa2f-d0f3ca5dcd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:12.516832 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0118f31-f839-48a0-9301-38ad73f7e932 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:12.517005 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653e8c5-4773-496a-aa2f-d0f3ca5dcd50 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:12.517290 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653e8c5-4773-496a-aa2f-d0f3ca5dcd50 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:12.517570 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653e8c5-4773-496a-aa2f-d0f3ca5dcd50 None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:12.519601 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5653e8c5-4773-496a-aa2f-d0f3ca5dcd50 None admin] RBAC: Adding query filter params (name=member) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:12.519601 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5653e8c5-4773-496a-aa2f-d0f3ca5dcd50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:12.519942 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5653e8c5-4773-496a-aa2f-d0f3ca5dcd50 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:12.528203 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 109/220] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 13:02:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:12.528849 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5653e8c5-4773-496a-aa2f-d0f3ca5dcd50 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:12.555227 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15515d-bc0d-48bc-a0ad-d5cd1e7c0222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:12.555889 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15515d-bc0d-48bc-a0ad-d5cd1e7c0222 None admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:12.556191 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15515d-bc0d-48bc-a0ad-d5cd1e7c0222 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:12.556470 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15515d-bc0d-48bc-a0ad-d5cd1e7c0222 None admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:12.557171 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b15515d-bc0d-48bc-a0ad-d5cd1e7c0222 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:12.558607 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b15515d-bc0d-48bc-a0ad-d5cd1e7c0222 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:12.623186 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:12.627554 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5653e8c5-4773-496a-aa2f-d0f3ca5dcd50 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:12.645442 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 112/221] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jun 3 13:02:12 2022] POST /identity/v3/users => generated 297 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:12.646772 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c7ec2-7d98-441f-85d7-6a968d19b446 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:12.647065 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c7ec2-7d98-441f-85d7-6a968d19b446 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:12.647346 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c7ec2-7d98-441f-85d7-6a968d19b446 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:12.648813 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 113/222] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:12.653492 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c7ec2-7d98-441f-85d7-6a968d19b446 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:12.670473 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4616c-0f51-4c79-a8c9-cd54002cbe7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:12.671512 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4616c-0f51-4c79-a8c9-cd54002cbe7b None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:12.671798 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4616c-0f51-4c79-a8c9-cd54002cbe7b None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:12.672098 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4616c-0f51-4c79-a8c9-cd54002cbe7b None admin] PATH_INFO: `/v3/projects/25310838cd094a4aba3f8ea2a06ff3c4` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:12.674349 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce4616c-0f51-4c79-a8c9-cd54002cbe7b None admin] RBAC: Authorizing `identity:get_project(project_id=25310838cd094a4aba3f8ea2a06ff3c4)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:12.675955 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce4616c-0f51-4c79-a8c9-cd54002cbe7b None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:12.682904 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 110/223] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:02:12 2022] GET /identity/v3/projects/25310838cd094a4aba3f8ea2a06ff3c4 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:12.682904 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dacd61f-00bc-41f6-ab8f-6237d2838caf None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:12.682904 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dacd61f-00bc-41f6-ab8f-6237d2838caf None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:12.682904 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dacd61f-00bc-41f6-ab8f-6237d2838caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:12.700405 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-8dacd61f-00bc-41f6-ab8f-6237d2838caf None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:12.702508 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-8dacd61f-00bc-41f6-ab8f-6237d2838caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:12.778971 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c7ec2-7d98-441f-85d7-6a968d19b446 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:12.787173 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 111/224] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:02:12.798366 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dacd61f-00bc-41f6-ab8f-6237d2838caf None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:12.820537 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff0e01-5ded-4739-b7e0-db80e1d242cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:12.821765 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff0e01-5ded-4739-b7e0-db80e1d242cf None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:12.822049 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff0e01-5ded-4739-b7e0-db80e1d242cf None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:12.822489 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff0e01-5ded-4739-b7e0-db80e1d242cf None admin] PATH_INFO: `/v3/users/98193543d0cc408ea22d6551ef35bcae` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:12.839900 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ff0e01-5ded-4739-b7e0-db80e1d242cf None admin] RBAC: Authorizing `identity:get_user(user_id=98193543d0cc408ea22d6551ef35bcae)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:12.842114 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ff0e01-5ded-4739-b7e0-db80e1d242cf None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:12.847743 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 114/225] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 13:02:12 2022] GET /identity/v3/users/98193543d0cc408ea22d6551ef35bcae => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:12.847743 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff0e01-5ded-4739-b7e0-db80e1d242cf None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:12.857920 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:12.914261 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:12.920490 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dacd61f-00bc-41f6-ab8f-6237d2838caf None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:12.959630 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7402a-25d1-40c9-86d3-b3076469a78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:12.959630 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7402a-25d1-40c9-86d3-b3076469a78c None admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:12.959915 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7402a-25d1-40c9-86d3-b3076469a78c None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:12.960169 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7402a-25d1-40c9-86d3-b3076469a78c None admin] PATH_INFO: `/v3/projects/25310838cd094a4aba3f8ea2a06ff3c4/users/a12691e1e6b143ceb7ce5533a7a5ff26/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:12.963455 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a7402a-25d1-40c9-86d3-b3076469a78c None admin] RBAC: Authorizing `identity:create_grant(project_id=25310838cd094a4aba3f8ea2a06ff3c4, user_id=a12691e1e6b143ceb7ce5533a7a5ff26, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:12.963866 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a7402a-25d1-40c9-86d3-b3076469a78c None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:12.968440 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff0e01-5ded-4739-b7e0-db80e1d242cf None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:13.013280 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3277735-1346-41d1-af6c-81d634dfc9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:13.014086 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3277735-1346-41d1-af6c-81d634dfc9fc None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:13.014365 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3277735-1346-41d1-af6c-81d634dfc9fc None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:13.014634 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3277735-1346-41d1-af6c-81d634dfc9fc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:13.025350 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3277735-1346-41d1-af6c-81d634dfc9fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:02:13.030557 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 112/226] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jun 3 13:02:12 2022] PUT /identity/v3/projects/25310838cd094a4aba3f8ea2a06ff3c4/users/a12691e1e6b143ceb7ce5533a7a5ff26/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:13.032271 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7402a-25d1-40c9-86d3-b3076469a78c None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:13.038524 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-e3277735-1346-41d1-af6c-81d634dfc9fc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 13:02:13.038524 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:13.038524 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:13.038524 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:13.038524 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:13.038524 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:13.038524 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:13.038524 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:13.038524 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:13.038524 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:13.038524 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:13.038524 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:13.038524 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:02:13.038524 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:02:13.038524 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:02:13.038524 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:02:13.039489 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:02:13.039489 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:02:13.039489 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:02:13.039489 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:02:13.039489 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:13.039489 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:13.039489 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:13.039489 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:13.039489 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:13.039489 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:13.039489 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:13.039489 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:13.039489 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:13.039489 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:13.039489 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:13.039489 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:13.040383 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:13.040383 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:13.040383 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:13.040383 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:13.040383 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:02:13.040383 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:02:13.040383 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:02:13.040383 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:02:13.040383 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:02:13.040383 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:02:13.040383 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 13:02:13.040383 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:02:13.040383 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 115/227] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jun 3 13:02:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:13.050930 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3277735-1346-41d1-af6c-81d634dfc9fc None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:13.200705 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:13.219984 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7402a-25d1-40c9-86d3-b3076469a78c None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:13.266143 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3277735-1346-41d1-af6c-81d634dfc9fc None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:13.272168 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4de0e-e201-4f1a-b55a-eb01057f84ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:13.272834 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4de0e-e201-4f1a-b55a-eb01057f84ef None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:13.273162 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4de0e-e201-4f1a-b55a-eb01057f84ef None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:13.273451 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4de0e-e201-4f1a-b55a-eb01057f84ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:13.307329 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:13.312086 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3ea04-3cee-4e57-a440-21cdd426e765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:13.312970 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3ea04-3cee-4e57-a440-21cdd426e765 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:13.313260 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3ea04-3cee-4e57-a440-21cdd426e765 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:13.313536 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3ea04-3cee-4e57-a440-21cdd426e765 None admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:13.314296 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d3ea04-3cee-4e57-a440-21cdd426e765 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:13.314604 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d3ea04-3cee-4e57-a440-21cdd426e765 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:13.316095 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d3ea04-3cee-4e57-a440-21cdd426e765 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:13.327157 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 116/228] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:02:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:02:13.333774 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3ea04-3cee-4e57-a440-21cdd426e765 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:13.358232 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e4de0e-e201-4f1a-b55a-eb01057f84ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:13.360355 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e4de0e-e201-4f1a-b55a-eb01057f84ef None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:13.504499 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3ea04-3cee-4e57-a440-21cdd426e765 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:13.545392 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 113/229] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:02:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:13.555346 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4de0e-e201-4f1a-b55a-eb01057f84ef None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:13.559730 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:13.564190 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195aeca-7206-4bbb-b630-3ca6aa58b0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:13.565088 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195aeca-7206-4bbb-b630-3ca6aa58b0c9 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:13.565372 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195aeca-7206-4bbb-b630-3ca6aa58b0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:13.565647 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195aeca-7206-4bbb-b630-3ca6aa58b0c9 None admin] PATH_INFO: `/v3/users/a12691e1e6b143ceb7ce5533a7a5ff26` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:13.566965 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0195aeca-7206-4bbb-b630-3ca6aa58b0c9 None admin] RBAC: Authorizing `identity:get_user(user_id=a12691e1e6b143ceb7ce5533a7a5ff26)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:13.574776 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0195aeca-7206-4bbb-b630-3ca6aa58b0c9 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:13.574776 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 117/230] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 13:02:13 2022] GET /identity/v3/users/a12691e1e6b143ceb7ce5533a7a5ff26 => generated 283 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:02:13.575846 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195aeca-7206-4bbb-b630-3ca6aa58b0c9 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:13.663346 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:13.742289 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4de0e-e201-4f1a-b55a-eb01057f84ef None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:13.761446 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195aeca-7206-4bbb-b630-3ca6aa58b0c9 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:13.813964 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0d7de-0ff3-44f6-b17d-09def4abeec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:13.815331 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0d7de-0ff3-44f6-b17d-09def4abeec6 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:13.815621 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0d7de-0ff3-44f6-b17d-09def4abeec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:13.815901 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0d7de-0ff3-44f6-b17d-09def4abeec6 None admin] PATH_INFO: `/v3/projects/25310838cd094a4aba3f8ea2a06ff3c4` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:13.817217 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0d7de-0ff3-44f6-b17d-09def4abeec6 None admin] RBAC: Authorizing `identity:get_project(project_id=25310838cd094a4aba3f8ea2a06ff3c4)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:13.818663 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0d7de-0ff3-44f6-b17d-09def4abeec6 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:13.825249 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 114/231] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:02:13 2022] GET /identity/v3/projects/25310838cd094a4aba3f8ea2a06ff3c4 => generated 302 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:13.825852 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56686cdf-7033-469f-8635-a1e0b1f8e4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:13.826463 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0d7de-0ff3-44f6-b17d-09def4abeec6 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:13.827334 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56686cdf-7033-469f-8635-a1e0b1f8e4b2 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:13.827757 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56686cdf-7033-469f-8635-a1e0b1f8e4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:13.828194 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56686cdf-7033-469f-8635-a1e0b1f8e4b2 None admin] PATH_INFO: `/v3/projects/25310838cd094a4aba3f8ea2a06ff3c4` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:13.835085 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56686cdf-7033-469f-8635-a1e0b1f8e4b2 None admin] RBAC: Authorizing `identity:get_project(project_id=25310838cd094a4aba3f8ea2a06ff3c4)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:13.836760 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56686cdf-7033-469f-8635-a1e0b1f8e4b2 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:13.838972 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 118/232] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:02:13 2022] GET /identity/v3/projects/25310838cd094a4aba3f8ea2a06ff3c4 => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:13.856382 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56686cdf-7033-469f-8635-a1e0b1f8e4b2 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:13.951064 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0d7de-0ff3-44f6-b17d-09def4abeec6 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:13.978351 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:13.991757 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d56ff9f-7ce4-44c9-be33-89c3aa93153e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:13.992780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56ff9f-7ce4-44c9-be33-89c3aa93153e None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:13.993240 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56ff9f-7ce4-44c9-be33-89c3aa93153e None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:13.993662 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56ff9f-7ce4-44c9-be33-89c3aa93153e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:13.994695 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d56ff9f-7ce4-44c9-be33-89c3aa93153e None admin] RBAC: Adding query filter params (role.id=d082d2b37fd1455ea61819353e8369ed, scope.project.id=25310838cd094a4aba3f8ea2a06ff3c4, user.id=98193543d0cc408ea22d6551ef35bcae) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:13.995174 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d56ff9f-7ce4-44c9-be33-89c3aa93153e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:13.996840 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d56ff9f-7ce4-44c9-be33-89c3aa93153e None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:14.008525 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 115/233] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 13:02:13 2022] GET /identity/v3/role_assignments?user.id=98193543d0cc408ea22d6551ef35bcae&scope.project.id=25310838cd094a4aba3f8ea2a06ff3c4&role.id=d082d2b37fd1455ea61819353e8369ed => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:02:14.057744 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:14.102542 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56686cdf-7033-469f-8635-a1e0b1f8e4b2 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:14.139804 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f74de15-3523-4de1-8725-341ed5290918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:14.140728 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74de15-3523-4de1-8725-341ed5290918 None admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:14.141059 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74de15-3523-4de1-8725-341ed5290918 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:14.141399 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74de15-3523-4de1-8725-341ed5290918 None admin] PATH_INFO: `/v3/projects/25310838cd094a4aba3f8ea2a06ff3c4/users/a12691e1e6b143ceb7ce5533a7a5ff26/roles/7476baf91a50401596c34535d2c79a4f` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:14.143753 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f74de15-3523-4de1-8725-341ed5290918 None admin] RBAC: Authorizing `identity:create_grant(project_id=25310838cd094a4aba3f8ea2a06ff3c4, user_id=a12691e1e6b143ceb7ce5533a7a5ff26, role_id=7476baf91a50401596c34535d2c79a4f)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:14.145317 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f74de15-3523-4de1-8725-341ed5290918 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:14.244971 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 119/234] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jun 3 13:02:13 2022] PUT /identity/v3/projects/25310838cd094a4aba3f8ea2a06ff3c4/users/a12691e1e6b143ceb7ce5533a7a5ff26/roles/7476baf91a50401596c34535d2c79a4f => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:15.397825 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e12f0-36ab-4fed-95ca-fb5078ffdf0f None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:15.398327 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e12f0-36ab-4fed-95ca-fb5078ffdf0f None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:15.398327 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e12f0-36ab-4fed-95ca-fb5078ffdf0f None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:15.399684 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 116/235] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:15.405091 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c60ceb-f1c6-476d-8d0f-b5226de17bc8 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:15.405507 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c60ceb-f1c6-476d-8d0f-b5226de17bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:15.405709 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c60ceb-f1c6-476d-8d0f-b5226de17bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:15.433484 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-59c60ceb-f1c6-476d-8d0f-b5226de17bc8 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:15.434693 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-59c60ceb-f1c6-476d-8d0f-b5226de17bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:15.473805 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a7f60-3d8f-4ff4-97fb-442e1b02f308 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:15.474157 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a7f60-3d8f-4ff4-97fb-442e1b02f308 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:15.474354 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a7f60-3d8f-4ff4-97fb-442e1b02f308 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:15.475845 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 117/236] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 13:02:15.483395 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19412673-4165-4795-8119-ab52986afb82 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:15.483689 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19412673-4165-4795-8119-ab52986afb82 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:15.483962 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19412673-4165-4795-8119-ab52986afb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:15.519660 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-19412673-4165-4795-8119-ab52986afb82 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:15.524095 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-19412673-4165-4795-8119-ab52986afb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:15.562347 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 120/237] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:02:15.597344 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c60ceb-f1c6-476d-8d0f-b5226de17bc8 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:15.635093 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 118/238] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:02:15.669136 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19412673-4165-4795-8119-ab52986afb82 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:15.693584 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:15.768196 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c60ceb-f1c6-476d-8d0f-b5226de17bc8 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:15.821023 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb49cd3d-6cd6-49b1-abf7-dfa913468b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:15.821772 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49cd3d-6cd6-49b1-abf7-dfa913468b45 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:15.822062 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49cd3d-6cd6-49b1-abf7-dfa913468b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:15.822340 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49cd3d-6cd6-49b1-abf7-dfa913468b45 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:15.839520 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19412673-4165-4795-8119-ab52986afb82 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:15.856005 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb49cd3d-6cd6-49b1-abf7-dfa913468b45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:02:15.861171 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:15.866233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-fb49cd3d-6cd6-49b1-abf7-dfa913468b45 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 13:02:15.866233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:15.866233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:15.866233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:15.866233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:15.866233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:15.866233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:15.866233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:15.866233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:15.866233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:15.866233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:15.866233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:15.866233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:02:15.866233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:02:15.866233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:02:15.866233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:02:15.867352 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:02:15.867352 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:02:15.867352 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:02:15.867352 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:02:15.867352 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:15.867352 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:15.867352 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:15.867352 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:15.867352 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:15.867352 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:15.867352 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:15.867352 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:15.867352 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:15.867352 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:15.867352 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:15.867352 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:15.868325 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:15.868325 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:15.868325 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:15.868325 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:15.868325 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:02:15.868325 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:02:15.868325 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:02:15.868325 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:02:15.868325 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:02:15.868325 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:02:15.868325 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 13:02:15.868325 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:02:15.868325 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 121/239] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:02:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:02:15.869227 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615626a-64b4-40e7-931b-89589970273c None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:15.869456 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615626a-64b4-40e7-931b-89589970273c None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:15.869733 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615626a-64b4-40e7-931b-89589970273c None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:15.871185 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 122/240] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:15.875736 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615626a-64b4-40e7-931b-89589970273c None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:15.883741 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a770352-e2b2-443b-9a7e-b3462b8811e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:15.884740 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a770352-e2b2-443b-9a7e-b3462b8811e9 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:15.885018 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a770352-e2b2-443b-9a7e-b3462b8811e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:15.885292 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a770352-e2b2-443b-9a7e-b3462b8811e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:15.886498 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a770352-e2b2-443b-9a7e-b3462b8811e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:15.887942 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a770352-e2b2-443b-9a7e-b3462b8811e9 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:15.889785 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 119/241] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:02:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:15.894501 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa6a69-7788-4901-8be4-7eebdc797bed None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:15.894501 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa6a69-7788-4901-8be4-7eebdc797bed None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:15.894501 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa6a69-7788-4901-8be4-7eebdc797bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:15.954102 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-68aa6a69-7788-4901-8be4-7eebdc797bed None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:15.955589 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-68aa6a69-7788-4901-8be4-7eebdc797bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:16.052179 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 120/242] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:02:16.052179 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa6a69-7788-4901-8be4-7eebdc797bed None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:16.095097 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615626a-64b4-40e7-931b-89589970273c None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:16.114353 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:16.131612 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bcd91d-79d8-4f8d-9035-5280b45cf881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:16.132333 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcd91d-79d8-4f8d-9035-5280b45cf881 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:16.132614 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcd91d-79d8-4f8d-9035-5280b45cf881 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:16.132884 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcd91d-79d8-4f8d-9035-5280b45cf881 None admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:16.133624 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bcd91d-79d8-4f8d-9035-5280b45cf881 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:16.133925 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bcd91d-79d8-4f8d-9035-5280b45cf881 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:16.135381 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bcd91d-79d8-4f8d-9035-5280b45cf881 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:16.144634 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 123/243] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 13:02:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:16.145420 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bcd91d-79d8-4f8d-9035-5280b45cf881 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:16.199590 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa6a69-7788-4901-8be4-7eebdc797bed None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:16.225143 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:16.246515 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa689940-f9c3-4dc7-b4a1-db98ec37e4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:16.247790 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa689940-f9c3-4dc7-b4a1-db98ec37e4c6 None admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:16.248523 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa689940-f9c3-4dc7-b4a1-db98ec37e4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:16.250476 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa689940-f9c3-4dc7-b4a1-db98ec37e4c6 None admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:16.250746 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa689940-f9c3-4dc7-b4a1-db98ec37e4c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:16.253637 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa689940-f9c3-4dc7-b4a1-db98ec37e4c6 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:16.258472 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bcd91d-79d8-4f8d-9035-5280b45cf881 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:16.297274 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe418c-75d9-4a47-a9de-e76cdc076626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:16.298664 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe418c-75d9-4a47-a9de-e76cdc076626 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:16.299161 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe418c-75d9-4a47-a9de-e76cdc076626 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:16.299709 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe418c-75d9-4a47-a9de-e76cdc076626 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:16.311054 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbe418c-75d9-4a47-a9de-e76cdc076626 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:02:16.319895 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 121/244] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jun 3 13:02:16 2022] POST /identity/v3/users => generated 293 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:16.321185 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa689940-f9c3-4dc7-b4a1-db98ec37e4c6 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:16.322763 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-2bbe418c-75d9-4a47-a9de-e76cdc076626 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:02:16.322763 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:16.322763 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:16.322763 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:16.322763 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:16.322763 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:16.322763 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:16.322763 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:16.322763 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:16.322763 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:16.322763 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:16.322763 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:16.322763 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:02:16.322763 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:02:16.322763 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:02:16.322763 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:02:16.330479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:02:16.330479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:02:16.330479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:02:16.330479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:02:16.330479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:16.330479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:16.330479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:16.330479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:16.330479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:16.330479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:16.330479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:16.330479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:16.330479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:16.330479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:16.330479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:16.330479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:16.331293 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:16.331293 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:16.331293 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:16.331293 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:16.331293 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:02:16.331293 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:02:16.331293 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:02:16.331293 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:02:16.331293 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:02:16.331293 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:02:16.331293 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:02:16.331293 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:02:16.331293 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 124/245] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 13:02:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:16.332618 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe418c-75d9-4a47-a9de-e76cdc076626 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:16.455494 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:16.492207 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa689940-f9c3-4dc7-b4a1-db98ec37e4c6 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:16.540932 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbaac25-43d4-41a3-a926-05a238da7639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:16.541812 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbaac25-43d4-41a3-a926-05a238da7639 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:16.542090 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbaac25-43d4-41a3-a926-05a238da7639 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:16.542361 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbaac25-43d4-41a3-a926-05a238da7639 None admin] PATH_INFO: `/v3/users/d6349a56617b45dbb808777c9559c848` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:16.561536 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbaac25-43d4-41a3-a926-05a238da7639 None admin] RBAC: Authorizing `identity:get_user(user_id=d6349a56617b45dbb808777c9559c848)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:16.563598 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbaac25-43d4-41a3-a926-05a238da7639 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:16.566223 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 122/246] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 13:02:16 2022] GET /identity/v3/users/d6349a56617b45dbb808777c9559c848 => generated 297 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:16.572697 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbaac25-43d4-41a3-a926-05a238da7639 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:16.581841 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe418c-75d9-4a47-a9de-e76cdc076626 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:16.616969 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:16.630604 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086fd906-c9d5-4037-8138-8b6d8c0ce5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:16.631646 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fd906-c9d5-4037-8138-8b6d8c0ce5fe None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:16.631957 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fd906-c9d5-4037-8138-8b6d8c0ce5fe None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:16.632385 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fd906-c9d5-4037-8138-8b6d8c0ce5fe None admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:16.633473 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086fd906-c9d5-4037-8138-8b6d8c0ce5fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:16.633787 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086fd906-c9d5-4037-8138-8b6d8c0ce5fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:16.635503 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086fd906-c9d5-4037-8138-8b6d8c0ce5fe None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:16.647881 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 125/247] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:02:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:16.653089 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086fd906-c9d5-4037-8138-8b6d8c0ce5fe None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:16.717659 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbaac25-43d4-41a3-a926-05a238da7639 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:16.759886 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6323aff-2a11-40d2-8d25-fe80b2103617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:16.760518 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6323aff-2a11-40d2-8d25-fe80b2103617 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:16.760808 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6323aff-2a11-40d2-8d25-fe80b2103617 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:16.761088 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6323aff-2a11-40d2-8d25-fe80b2103617 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:16.764890 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086fd906-c9d5-4037-8138-8b6d8c0ce5fe None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:16.768467 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:16.808877 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d109de7-b149-4068-8d30-a9bae687dc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:16.809775 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d109de7-b149-4068-8d30-a9bae687dc0a None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:16.810056 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d109de7-b149-4068-8d30-a9bae687dc0a None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:16.810333 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d109de7-b149-4068-8d30-a9bae687dc0a None admin] PATH_INFO: `/v3/users/a12691e1e6b143ceb7ce5533a7a5ff26` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:16.811590 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d109de7-b149-4068-8d30-a9bae687dc0a None admin] RBAC: Authorizing `identity:get_user(user_id=a12691e1e6b143ceb7ce5533a7a5ff26)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:16.813221 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d109de7-b149-4068-8d30-a9bae687dc0a None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:16.818021 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 126/248] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 13:02:16 2022] GET /identity/v3/users/a12691e1e6b143ceb7ce5533a7a5ff26 => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:16.823716 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d109de7-b149-4068-8d30-a9bae687dc0a None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:16.844078 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6323aff-2a11-40d2-8d25-fe80b2103617 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:16.846404 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6323aff-2a11-40d2-8d25-fe80b2103617 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:16.878207 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:16.942635 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d109de7-b149-4068-8d30-a9bae687dc0a None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:16.976523 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 123/249] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:02:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 03 13:02:16.978525 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af510fa6-6eed-4791-9f74-4a4597b603dc None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:16.978975 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af510fa6-6eed-4791-9f74-4a4597b603dc None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:16.979495 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af510fa6-6eed-4791-9f74-4a4597b603dc None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:16.979896 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9782c147-0d79-4cfe-beb8-55fbd33f02c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:16.980976 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782c147-0d79-4cfe-beb8-55fbd33f02c4 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:16.981423 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782c147-0d79-4cfe-beb8-55fbd33f02c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:16.981728 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782c147-0d79-4cfe-beb8-55fbd33f02c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:16.981871 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 124/250] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:16.982706 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af510fa6-6eed-4791-9f74-4a4597b603dc None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:17.044628 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:17.061611 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9782c147-0d79-4cfe-beb8-55fbd33f02c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:17.063962 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9782c147-0d79-4cfe-beb8-55fbd33f02c4 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:17.115293 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af510fa6-6eed-4791-9f74-4a4597b603dc None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:17.150893 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:17.159183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1489429e-da71-44a8-9a87-f79bd7835364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:17.160430 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489429e-da71-44a8-9a87-f79bd7835364 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:17.160723 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489429e-da71-44a8-9a87-f79bd7835364 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:17.161258 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489429e-da71-44a8-9a87-f79bd7835364 None admin] PATH_INFO: `/v3/projects/25310838cd094a4aba3f8ea2a06ff3c4` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:17.162865 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1489429e-da71-44a8-9a87-f79bd7835364 None admin] RBAC: Authorizing `identity:get_project(project_id=25310838cd094a4aba3f8ea2a06ff3c4)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:17.164379 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1489429e-da71-44a8-9a87-f79bd7835364 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:17.167818 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 125/251] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:02:16 2022] GET /identity/v3/projects/25310838cd094a4aba3f8ea2a06ff3c4 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:17.169050 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8eb3d5-2bb0-4e7a-acb4-58bf0dd03227 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:17.169352 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8eb3d5-2bb0-4e7a-acb4-58bf0dd03227 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:17.169631 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8eb3d5-2bb0-4e7a-acb4-58bf0dd03227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:17.196394 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-2e8eb3d5-2bb0-4e7a-acb4-58bf0dd03227 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:17.198427 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-2e8eb3d5-2bb0-4e7a-acb4-58bf0dd03227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:17.219186 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 127/252] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:02:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 03 13:02:17.220669 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b09aa-bf3a-4a15-8404-ad59750bccb0 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:17.221020 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b09aa-bf3a-4a15-8404-ad59750bccb0 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:17.221299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b09aa-bf3a-4a15-8404-ad59750bccb0 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:17.223134 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 128/253] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:17.223908 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b09aa-bf3a-4a15-8404-ad59750bccb0 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:17.289551 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 126/254] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:02:17.290467 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8eb3d5-2bb0-4e7a-acb4-58bf0dd03227 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:17.337011 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:17.380312 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b09aa-bf3a-4a15-8404-ad59750bccb0 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:17.418213 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8eb3d5-2bb0-4e7a-acb4-58bf0dd03227 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:17.424015 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d555121a-0f7e-4c9b-ab8f-4a37a8c7a861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:17.424707 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555121a-0f7e-4c9b-ab8f-4a37a8c7a861 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:17.424985 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555121a-0f7e-4c9b-ab8f-4a37a8c7a861 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:17.425259 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555121a-0f7e-4c9b-ab8f-4a37a8c7a861 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:17.426089 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d555121a-0f7e-4c9b-ab8f-4a37a8c7a861 None admin] RBAC: Adding query filter params (role.id=f3c7872a0874484085c534eb05e404eb, scope.project.id=25310838cd094a4aba3f8ea2a06ff3c4, user.id=d6349a56617b45dbb808777c9559c848) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:17.426397 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d555121a-0f7e-4c9b-ab8f-4a37a8c7a861 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:17.430735 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d555121a-0f7e-4c9b-ab8f-4a37a8c7a861 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:17.444190 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 129/255] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 13:02:17 2022] GET /identity/v3/role_assignments?user.id=d6349a56617b45dbb808777c9559c848&scope.project.id=25310838cd094a4aba3f8ea2a06ff3c4&role.id=f3c7872a0874484085c534eb05e404eb => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:17.444190 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaadeba-e887-460c-971e-e945dae46013 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:17.444190 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaadeba-e887-460c-971e-e945dae46013 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:17.444190 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaadeba-e887-460c-971e-e945dae46013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:17.461352 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-3aaadeba-e887-460c-971e-e945dae46013 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:17.462562 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-3aaadeba-e887-460c-971e-e945dae46013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:17.465609 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:17.480991 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d1912-cf12-41ce-a686-8b0870226171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:17.482334 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d1912-cf12-41ce-a686-8b0870226171 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:17.483031 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d1912-cf12-41ce-a686-8b0870226171 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:17.483759 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d1912-cf12-41ce-a686-8b0870226171 None admin] PATH_INFO: `/v3/projects/25310838cd094a4aba3f8ea2a06ff3c4` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:17.489858 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05d1912-cf12-41ce-a686-8b0870226171 None admin] RBAC: Authorizing `identity:get_project(project_id=25310838cd094a4aba3f8ea2a06ff3c4)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:17.491934 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05d1912-cf12-41ce-a686-8b0870226171 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:17.494151 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 127/256] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:02:17 2022] GET /identity/v3/projects/25310838cd094a4aba3f8ea2a06ff3c4 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:17.495900 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d1912-cf12-41ce-a686-8b0870226171 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:17.544767 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 130/257] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:02:17.546021 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaadeba-e887-460c-971e-e945dae46013 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:17.624362 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:17.668724 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaadeba-e887-460c-971e-e945dae46013 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:17.709085 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7bd8b0-aed2-460f-b165-1ccb4493a6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:17.709751 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7bd8b0-aed2-460f-b165-1ccb4493a6c9 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:17.710031 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7bd8b0-aed2-460f-b165-1ccb4493a6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:17.710307 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7bd8b0-aed2-460f-b165-1ccb4493a6c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:17.711450 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7bd8b0-aed2-460f-b165-1ccb4493a6c9 None admin] RBAC: Adding query filter params (role.id=bbd5f3e0c18e4992886fcfb4a3feb426, scope.project.id=25310838cd094a4aba3f8ea2a06ff3c4, user.id=a12691e1e6b143ceb7ce5533a7a5ff26) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:17.711759 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7bd8b0-aed2-460f-b165-1ccb4493a6c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:17.713790 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7bd8b0-aed2-460f-b165-1ccb4493a6c9 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:17.721470 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 131/258] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 13:02:17 2022] GET /identity/v3/role_assignments?user.id=a12691e1e6b143ceb7ce5533a7a5ff26&scope.project.id=25310838cd094a4aba3f8ea2a06ff3c4&role.id=bbd5f3e0c18e4992886fcfb4a3feb426 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:17.722718 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7bd8b0-aed2-460f-b165-1ccb4493a6c9 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:17.738546 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d1912-cf12-41ce-a686-8b0870226171 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:17.836242 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2af1a-2a9f-4046-a62f-898e37301eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:17.837494 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2af1a-2a9f-4046-a62f-898e37301eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:17.837959 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2af1a-2a9f-4046-a62f-898e37301eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:17.838441 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2af1a-2a9f-4046-a62f-898e37301eb2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:17.849251 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7bd8b0-aed2-460f-b165-1ccb4493a6c9 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:17.856753 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b2af1a-2a9f-4046-a62f-898e37301eb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:02:17.871272 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-19b2af1a-2a9f-4046-a62f-898e37301eb2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 13:02:17.871272 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:17.871272 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:17.871272 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:17.871272 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:17.871272 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:17.871272 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:17.871272 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:17.871272 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:17.871272 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:17.871272 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:17.871272 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:17.871272 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:02:17.871272 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:02:17.871272 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:02:17.871272 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:02:17.872443 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:02:17.872443 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:02:17.872443 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:02:17.872443 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:02:17.872443 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:17.872443 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:17.872443 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:17.872443 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:17.872443 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:17.872443 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:17.872443 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:17.872443 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:17.872443 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:17.872443 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:17.872443 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:17.872443 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:17.873234 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:17.873234 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:17.873234 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:17.873234 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:17.873234 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:02:17.873234 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:02:17.873234 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:02:17.873234 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:02:17.873234 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:02:17.873234 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:02:17.873234 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 13:02:17.873234 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:02:17.875889 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 128/259] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:02:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:17.889643 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:17.891487 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2af1a-2a9f-4046-a62f-898e37301eb2 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:17.894524 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c57efb-56bf-43ba-98da-26fcdffca8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:17.895349 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c57efb-56bf-43ba-98da-26fcdffca8be None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:17.895642 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c57efb-56bf-43ba-98da-26fcdffca8be None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:17.895925 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c57efb-56bf-43ba-98da-26fcdffca8be None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:17.910631 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c57efb-56bf-43ba-98da-26fcdffca8be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:02:17.919953 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-03c57efb-56bf-43ba-98da-26fcdffca8be None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 13:02:17.919953 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:17.919953 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:17.919953 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:17.919953 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:17.919953 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:17.919953 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:17.919953 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:17.919953 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:17.919953 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:17.919953 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:17.919953 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:17.919953 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:02:17.919953 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:02:17.919953 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:02:17.919953 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:02:17.921131 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:02:17.921131 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:02:17.921131 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:02:17.921131 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:02:17.921131 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:17.921131 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:17.921131 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:17.921131 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:17.921131 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:17.921131 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:17.921131 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:17.921131 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:17.921131 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:17.921131 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:17.921131 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:17.921131 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:17.922251 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:17.922251 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:17.922251 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:17.922251 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:17.922251 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:02:17.922251 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:02:17.922251 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:02:17.922251 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:02:17.922251 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:02:17.922251 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:02:17.922251 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 13:02:17.922251 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:02:17.922251 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 132/260] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jun 3 13:02:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:17.928520 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c57efb-56bf-43ba-98da-26fcdffca8be None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:18.047775 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c57efb-56bf-43ba-98da-26fcdffca8be None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:18.049618 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:18.093886 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9cd993-7b0d-43b3-b8dd-b4076ba54201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:18.095434 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9cd993-7b0d-43b3-b8dd-b4076ba54201 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:18.095867 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9cd993-7b0d-43b3-b8dd-b4076ba54201 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:18.096326 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9cd993-7b0d-43b3-b8dd-b4076ba54201 None admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:18.097489 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9cd993-7b0d-43b3-b8dd-b4076ba54201 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:18.097943 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9cd993-7b0d-43b3-b8dd-b4076ba54201 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:18.099569 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9cd993-7b0d-43b3-b8dd-b4076ba54201 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:18.110369 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 133/261] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:02:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:02:18.117171 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9cd993-7b0d-43b3-b8dd-b4076ba54201 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:18.165616 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2af1a-2a9f-4046-a62f-898e37301eb2 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:18.176534 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:18.241325 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119fb3c-3dac-4e09-a626-a8f4b601943f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:18.242286 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119fb3c-3dac-4e09-a626-a8f4b601943f None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:18.242715 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119fb3c-3dac-4e09-a626-a8f4b601943f None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:18.243130 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119fb3c-3dac-4e09-a626-a8f4b601943f None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:18.244022 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9119fb3c-3dac-4e09-a626-a8f4b601943f None admin] RBAC: Adding query filter params (name=member) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:18.245705 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9119fb3c-3dac-4e09-a626-a8f4b601943f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:18.247263 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9119fb3c-3dac-4e09-a626-a8f4b601943f None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:18.252613 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9cd993-7b0d-43b3-b8dd-b4076ba54201 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:18.269690 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 129/262] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 13:02:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:18.276786 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119fb3c-3dac-4e09-a626-a8f4b601943f None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:18.327796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f1370-cfb1-4b71-9020-78c6dfa77ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:18.328736 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f1370-cfb1-4b71-9020-78c6dfa77ef4 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:18.329249 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f1370-cfb1-4b71-9020-78c6dfa77ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:18.329577 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f1370-cfb1-4b71-9020-78c6dfa77ef4 None admin] PATH_INFO: `/v3/users/a12691e1e6b143ceb7ce5533a7a5ff26` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:18.330817 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213f1370-cfb1-4b71-9020-78c6dfa77ef4 None admin] RBAC: Authorizing `identity:get_user(user_id=a12691e1e6b143ceb7ce5533a7a5ff26)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:18.332332 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213f1370-cfb1-4b71-9020-78c6dfa77ef4 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:18.334053 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 134/263] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 13:02:18 2022] GET /identity/v3/users/a12691e1e6b143ceb7ce5533a7a5ff26 => generated 283 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:02:18.340908 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f1370-cfb1-4b71-9020-78c6dfa77ef4 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:18.393323 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119fb3c-3dac-4e09-a626-a8f4b601943f None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:18.412539 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:18.438203 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52976d-8832-46a5-9f39-0beaa66730d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:18.438203 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52976d-8832-46a5-9f39-0beaa66730d0 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:18.438203 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52976d-8832-46a5-9f39-0beaa66730d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:18.438203 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52976d-8832-46a5-9f39-0beaa66730d0 None admin] PATH_INFO: `/v3/users/98193543d0cc408ea22d6551ef35bcae` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:18.438676 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e52976d-8832-46a5-9f39-0beaa66730d0 None admin] RBAC: Authorizing `identity:get_user(user_id=98193543d0cc408ea22d6551ef35bcae)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:18.438676 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e52976d-8832-46a5-9f39-0beaa66730d0 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:18.439275 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 130/264] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 13:02:18 2022] GET /identity/v3/users/98193543d0cc408ea22d6551ef35bcae => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:02:18.445556 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52976d-8832-46a5-9f39-0beaa66730d0 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:18.559154 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52976d-8832-46a5-9f39-0beaa66730d0 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:18.597787 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac32dfc-bda8-416f-b957-846e32d89ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:18.598934 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac32dfc-bda8-416f-b957-846e32d89ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:18.599364 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac32dfc-bda8-416f-b957-846e32d89ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:18.599783 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac32dfc-bda8-416f-b957-846e32d89ad2 None admin] PATH_INFO: `/v3/projects/25310838cd094a4aba3f8ea2a06ff3c4` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:18.601190 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac32dfc-bda8-416f-b957-846e32d89ad2 None admin] RBAC: Authorizing `identity:get_project(project_id=25310838cd094a4aba3f8ea2a06ff3c4)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:18.602781 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac32dfc-bda8-416f-b957-846e32d89ad2 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:18.604700 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 131/265] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:02:18 2022] GET /identity/v3/projects/25310838cd094a4aba3f8ea2a06ff3c4 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:02:18.617571 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac32dfc-bda8-416f-b957-846e32d89ad2 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:18.702145 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f1370-cfb1-4b71-9020-78c6dfa77ef4 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:18.708576 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:18.732795 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac32dfc-bda8-416f-b957-846e32d89ad2 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:18.750623 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:18.778227 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24389559-a54c-4c7c-a9bf-67d373a953ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:18.779126 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24389559-a54c-4c7c-a9bf-67d373a953ce None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:18.779556 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24389559-a54c-4c7c-a9bf-67d373a953ce None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:18.779977 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24389559-a54c-4c7c-a9bf-67d373a953ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:18.814325 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a7cdf-a557-455d-a029-b8e582838f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:18.815372 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a7cdf-a557-455d-a029-b8e582838f66 None admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:18.815744 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a7cdf-a557-455d-a029-b8e582838f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:18.816112 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a7cdf-a557-455d-a029-b8e582838f66 None admin] PATH_INFO: `/v3/projects/25310838cd094a4aba3f8ea2a06ff3c4/users/98193543d0cc408ea22d6551ef35bcae/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:18.818300 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8a7cdf-a557-455d-a029-b8e582838f66 None admin] RBAC: Authorizing `identity:create_grant(project_id=25310838cd094a4aba3f8ea2a06ff3c4, user_id=98193543d0cc408ea22d6551ef35bcae, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:18.819851 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8a7cdf-a557-455d-a029-b8e582838f66 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:18.867324 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24389559-a54c-4c7c-a9bf-67d373a953ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:18.869210 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24389559-a54c-4c7c-a9bf-67d373a953ce None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:18.915967 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 132/266] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jun 3 13:02:18 2022] PUT /identity/v3/projects/25310838cd094a4aba3f8ea2a06ff3c4/users/98193543d0cc408ea22d6551ef35bcae/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:18.989418 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 135/267] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:02:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 649 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 03 13:02:18.999304 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a7cdf-a557-455d-a029-b8e582838f66 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:19.157194 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a7cdf-a557-455d-a029-b8e582838f66 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:19.171738 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:19.196960 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3656b128-e5ca-42c2-91de-aec2ed32e3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:19.197920 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656b128-e5ca-42c2-91de-aec2ed32e3fc None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:19.198177 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656b128-e5ca-42c2-91de-aec2ed32e3fc None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:19.198523 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656b128-e5ca-42c2-91de-aec2ed32e3fc None admin] PATH_INFO: `/v3/projects/25310838cd094a4aba3f8ea2a06ff3c4` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:19.199728 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3656b128-e5ca-42c2-91de-aec2ed32e3fc None admin] RBAC: Authorizing `identity:get_project(project_id=25310838cd094a4aba3f8ea2a06ff3c4)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:19.201259 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3656b128-e5ca-42c2-91de-aec2ed32e3fc None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:19.203371 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 133/268] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:02:18 2022] GET /identity/v3/projects/25310838cd094a4aba3f8ea2a06ff3c4 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:19.211276 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24389559-a54c-4c7c-a9bf-67d373a953ce None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:19.238816 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:19.336950 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24389559-a54c-4c7c-a9bf-67d373a953ce None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:19.340482 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f540f-ccf8-48e2-b417-3092a0e6a900 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:19.340766 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f540f-ccf8-48e2-b417-3092a0e6a900 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:19.341105 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f540f-ccf8-48e2-b417-3092a0e6a900 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:19.342477 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 134/269] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:19.348528 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e21d2-6050-4cf4-9f90-edd3b5f390e4 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:19.349075 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e21d2-6050-4cf4-9f90-edd3b5f390e4 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:19.349185 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e21d2-6050-4cf4-9f90-edd3b5f390e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:19.366852 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-d82e21d2-6050-4cf4-9f90-edd3b5f390e4 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:19.368031 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-d82e21d2-6050-4cf4-9f90-edd3b5f390e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:19.392889 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66611cb9-3023-4485-b610-ebc9a6b200d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:19.393557 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66611cb9-3023-4485-b610-ebc9a6b200d2 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:19.393840 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66611cb9-3023-4485-b610-ebc9a6b200d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:19.394117 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66611cb9-3023-4485-b610-ebc9a6b200d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:19.394955 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66611cb9-3023-4485-b610-ebc9a6b200d2 None admin] RBAC: Adding query filter params (role.id=7476baf91a50401596c34535d2c79a4f, scope.project.id=25310838cd094a4aba3f8ea2a06ff3c4, user.id=a12691e1e6b143ceb7ce5533a7a5ff26) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:19.395268 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66611cb9-3023-4485-b610-ebc9a6b200d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:19.396754 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66611cb9-3023-4485-b610-ebc9a6b200d2 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:19.403426 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 136/270] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 13:02:19 2022] GET /identity/v3/role_assignments?user.id=a12691e1e6b143ceb7ce5533a7a5ff26&scope.project.id=25310838cd094a4aba3f8ea2a06ff3c4&role.id=7476baf91a50401596c34535d2c79a4f => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:19.443301 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 135/271] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 13:02:19.468321 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66611cb9-3023-4485-b610-ebc9a6b200d2 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:19.597870 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:19.624955 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66611cb9-3023-4485-b610-ebc9a6b200d2 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:19.625785 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868286de-a3f2-4aca-98a7-7f175d321179 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:19.626479 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868286de-a3f2-4aca-98a7-7f175d321179 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:19.626479 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868286de-a3f2-4aca-98a7-7f175d321179 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:19.631606 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 136/272] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:19.637378 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b29ea-cff1-4da2-bb40-275997c41ba0 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:19.637665 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b29ea-cff1-4da2-bb40-275997c41ba0 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:19.637940 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b29ea-cff1-4da2-bb40-275997c41ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:19.658590 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-581b29ea-cff1-4da2-bb40-275997c41ba0 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:19.659931 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-581b29ea-cff1-4da2-bb40-275997c41ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:19.663035 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbd01c-c928-4ddf-b274-5c447822a111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:19.663918 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbd01c-c928-4ddf-b274-5c447822a111 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:19.664301 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbd01c-c928-4ddf-b274-5c447822a111 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:19.664649 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbd01c-c928-4ddf-b274-5c447822a111 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:19.675607 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fbd01c-c928-4ddf-b274-5c447822a111 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:02:19.683299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-33fbd01c-c928-4ddf-b274-5c447822a111 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 13:02:19.683299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:19.683299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:19.683299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:19.683299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:19.683299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:19.683299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:19.683299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:19.683299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:19.683299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:19.683299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:19.683299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:19.683299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:02:19.683299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:02:19.683299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:02:19.683299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:02:19.684245 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:02:19.684245 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:02:19.684245 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:02:19.684245 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:02:19.684245 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:19.684245 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:19.684245 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:19.684245 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:19.684245 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:19.684245 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:19.684245 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:19.684245 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:19.684245 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:19.684245 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:19.684245 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:19.684245 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:19.685065 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:19.685065 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:19.685065 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:19.685065 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:19.685065 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:02:19.685065 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:02:19.685065 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:02:19.685065 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:02:19.685065 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:02:19.685065 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:02:19.685065 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 13:02:19.685065 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:02:19.685065 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 137/273] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:02:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:19.692630 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbd01c-c928-4ddf-b274-5c447822a111 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:19.743692 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 137/274] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:02:19.782943 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b29ea-cff1-4da2-bb40-275997c41ba0 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:19.809032 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbd01c-c928-4ddf-b274-5c447822a111 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:19.846215 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:19.864047 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fcd649-bdbe-472b-8f3d-71eff264bfca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:19.864937 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcd649-bdbe-472b-8f3d-71eff264bfca None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:19.865221 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcd649-bdbe-472b-8f3d-71eff264bfca None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:19.865496 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcd649-bdbe-472b-8f3d-71eff264bfca None admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:19.866715 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fcd649-bdbe-472b-8f3d-71eff264bfca None admin] RBAC: Adding query filter params (name=member) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:19.867028 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fcd649-bdbe-472b-8f3d-71eff264bfca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:19.868888 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fcd649-bdbe-472b-8f3d-71eff264bfca None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:19.883459 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 138/275] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 13:02:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:19.889533 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fcd649-bdbe-472b-8f3d-71eff264bfca None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:19.896069 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:19.921504 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b29ea-cff1-4da2-bb40-275997c41ba0 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:19.961079 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360043c9-ffec-4d5f-8c54-42c743d3daea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:19.961876 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360043c9-ffec-4d5f-8c54-42c743d3daea None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:19.962155 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360043c9-ffec-4d5f-8c54-42c743d3daea None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:19.962425 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360043c9-ffec-4d5f-8c54-42c743d3daea None admin] PATH_INFO: `/v3/domains/default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:19.963774 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360043c9-ffec-4d5f-8c54-42c743d3daea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:19.965304 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360043c9-ffec-4d5f-8c54-42c743d3daea None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:19.967439 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 138/276] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:02:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:02:19.973041 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360043c9-ffec-4d5f-8c54-42c743d3daea None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:20.013108 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fcd649-bdbe-472b-8f3d-71eff264bfca None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:20.047843 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc39b2-0694-4199-b670-9398cae3d7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:20.048822 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc39b2-0694-4199-b670-9398cae3d7a4 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:20.049107 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc39b2-0694-4199-b670-9398cae3d7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:20.049384 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc39b2-0694-4199-b670-9398cae3d7a4 None admin] PATH_INFO: `/v3/users/d9ed617d0631449b825b4d6ead583194` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:20.065598 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbc39b2-0694-4199-b670-9398cae3d7a4 None admin] RBAC: Authorizing `identity:get_user(user_id=d9ed617d0631449b825b4d6ead583194)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:20.067131 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbc39b2-0694-4199-b670-9398cae3d7a4 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:20.069382 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 139/277] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 13:02:19 2022] GET /identity/v3/users/d9ed617d0631449b825b4d6ead583194 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:20.075849 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc39b2-0694-4199-b670-9398cae3d7a4 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:20.103419 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360043c9-ffec-4d5f-8c54-42c743d3daea None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:20.117638 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:20.148086 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3d0ad-d70c-46bc-b3a3-65e4f3904db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:20.148803 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3d0ad-d70c-46bc-b3a3-65e4f3904db4 None admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:20.149081 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3d0ad-d70c-46bc-b3a3-65e4f3904db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:20.149469 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3d0ad-d70c-46bc-b3a3-65e4f3904db4 None admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:20.150272 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f3d0ad-d70c-46bc-b3a3-65e4f3904db4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:20.151755 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f3d0ad-d70c-46bc-b3a3-65e4f3904db4 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:20.156775 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:20.195699 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc39b2-0694-4199-b670-9398cae3d7a4 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:20.232573 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ad34d-8990-464a-8e41-3c946345c918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:20.233234 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ad34d-8990-464a-8e41-3c946345c918 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:20.233522 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ad34d-8990-464a-8e41-3c946345c918 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:20.233821 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ad34d-8990-464a-8e41-3c946345c918 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:20.234795 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ad34d-8990-464a-8e41-3c946345c918 None admin] RBAC: Adding query filter params (role.id=d082d2b37fd1455ea61819353e8369ed, user.id=d9ed617d0631449b825b4d6ead583194, scope.system=all) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:20.235341 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ad34d-8990-464a-8e41-3c946345c918 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:20.236833 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ad34d-8990-464a-8e41-3c946345c918 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:20.242115 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 140/278] 10.222.0.61 () {56 vars in 1308 bytes} [Fri Jun 3 13:02:20 2022] GET /identity/v3/role_assignments?user.id=d9ed617d0631449b825b4d6ead583194&scope.system=all&role.id=d082d2b37fd1455ea61819353e8369ed => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:20.263955 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 139/279] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jun 3 13:02:19 2022] POST /identity/v3/users => generated 293 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:20.406343 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26b0cc-f932-4386-b06a-aa530d40d525 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:20.406592 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26b0cc-f932-4386-b06a-aa530d40d525 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:20.406859 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26b0cc-f932-4386-b06a-aa530d40d525 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:20.408288 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 141/280] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:20.414302 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32335f3-587d-4c08-af15-b036fe4bbc96 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:20.414751 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32335f3-587d-4c08-af15-b036fe4bbc96 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:20.415129 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32335f3-587d-4c08-af15-b036fe4bbc96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:20.434179 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-d32335f3-587d-4c08-af15-b036fe4bbc96 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:20.435810 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-d32335f3-587d-4c08-af15-b036fe4bbc96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:20.516900 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 140/281] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:02:20.539640 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26b0cc-f932-4386-b06a-aa530d40d525 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:20.658312 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26b0cc-f932-4386-b06a-aa530d40d525 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:20.685405 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:20.695157 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4d0ea-c061-4e1b-a783-bf49298fab01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:20.696061 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4d0ea-c061-4e1b-a783-bf49298fab01 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:20.696364 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4d0ea-c061-4e1b-a783-bf49298fab01 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:20.696701 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4d0ea-c061-4e1b-a783-bf49298fab01 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:20.708691 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e4d0ea-c061-4e1b-a783-bf49298fab01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:02:20.716744 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-41e4d0ea-c061-4e1b-a783-bf49298fab01 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 13:02:20.716744 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:20.716744 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:20.716744 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:20.716744 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:20.716744 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:20.716744 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:20.716744 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:20.716744 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:20.716744 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:20.716744 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:20.716744 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:20.716744 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:02:20.716744 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:02:20.716744 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:02:20.716744 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:02:20.717650 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:02:20.717650 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:02:20.717650 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:02:20.717650 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:02:20.717650 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:20.717650 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:20.717650 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:20.717650 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:20.717650 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:20.717650 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:20.717650 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:20.717650 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:20.717650 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:20.717650 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:20.717650 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:20.717650 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:20.718438 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:20.718438 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:20.718438 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:20.718438 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:20.718438 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:02:20.718438 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:02:20.718438 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:02:20.718438 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:02:20.718438 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:02:20.718438 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:02:20.718438 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 13:02:20.718438 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:02:20.718438 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 142/282] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:02:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:20.725080 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32335f3-587d-4c08-af15-b036fe4bbc96 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:20.837590 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:20.843362 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32335f3-587d-4c08-af15-b036fe4bbc96 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:20.891315 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babce01f-0331-446c-b78f-b7137ee6358a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:20.892348 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babce01f-0331-446c-b78f-b7137ee6358a None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:20.892639 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babce01f-0331-446c-b78f-b7137ee6358a None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:20.892918 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babce01f-0331-446c-b78f-b7137ee6358a None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:20.893681 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babce01f-0331-446c-b78f-b7137ee6358a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:20.894011 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babce01f-0331-446c-b78f-b7137ee6358a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:20.895486 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babce01f-0331-446c-b78f-b7137ee6358a None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:20.907279 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 141/283] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 13:02:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:20.913352 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4d0ea-c061-4e1b-a783-bf49298fab01 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:21.083049 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4d0ea-c061-4e1b-a783-bf49298fab01 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:21.121322 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477f2be-5512-4c97-a0fd-016fb47f414a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:21.122203 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477f2be-5512-4c97-a0fd-016fb47f414a None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:21.122482 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477f2be-5512-4c97-a0fd-016fb47f414a None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:21.122813 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477f2be-5512-4c97-a0fd-016fb47f414a None admin] PATH_INFO: `/v3/users/d6349a56617b45dbb808777c9559c848` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:21.124014 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d477f2be-5512-4c97-a0fd-016fb47f414a None admin] RBAC: Authorizing `identity:get_user(user_id=d6349a56617b45dbb808777c9559c848)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:21.125707 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d477f2be-5512-4c97-a0fd-016fb47f414a None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:21.127646 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 143/284] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 13:02:20 2022] GET /identity/v3/users/d6349a56617b45dbb808777c9559c848 => generated 297 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:21.133124 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babce01f-0331-446c-b78f-b7137ee6358a None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:21.251369 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babce01f-0331-446c-b78f-b7137ee6358a None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:21.293964 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f0e998-3b21-4474-a3c3-3ef9f30714e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:21.294830 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0e998-3b21-4474-a3c3-3ef9f30714e3 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:21.295110 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0e998-3b21-4474-a3c3-3ef9f30714e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:21.295383 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0e998-3b21-4474-a3c3-3ef9f30714e3 None admin] PATH_INFO: `/v3/projects/25310838cd094a4aba3f8ea2a06ff3c4` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:21.296594 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f0e998-3b21-4474-a3c3-3ef9f30714e3 None admin] RBAC: Authorizing `identity:get_project(project_id=25310838cd094a4aba3f8ea2a06ff3c4)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:21.298104 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f0e998-3b21-4474-a3c3-3ef9f30714e3 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:21.300128 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 142/285] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:02:21 2022] GET /identity/v3/projects/25310838cd094a4aba3f8ea2a06ff3c4 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:21.306011 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477f2be-5512-4c97-a0fd-016fb47f414a None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:21.389477 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:21.447433 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477f2be-5512-4c97-a0fd-016fb47f414a None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:21.488395 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833bb2e-5718-4796-beb5-52df0669fa2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:21.489703 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833bb2e-5718-4796-beb5-52df0669fa2d None admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:21.490176 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833bb2e-5718-4796-beb5-52df0669fa2d None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:21.490622 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833bb2e-5718-4796-beb5-52df0669fa2d None admin] PATH_INFO: `/v3/projects/25310838cd094a4aba3f8ea2a06ff3c4/users/d6349a56617b45dbb808777c9559c848/roles/f3c7872a0874484085c534eb05e404eb` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:21.497936 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7833bb2e-5718-4796-beb5-52df0669fa2d None admin] RBAC: Authorizing `identity:create_grant(project_id=25310838cd094a4aba3f8ea2a06ff3c4, user_id=d6349a56617b45dbb808777c9559c848, role_id=f3c7872a0874484085c534eb05e404eb)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:21.499633 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7833bb2e-5718-4796-beb5-52df0669fa2d None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:21.595184 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 144/286] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jun 3 13:02:21 2022] PUT /identity/v3/projects/25310838cd094a4aba3f8ea2a06ff3c4/users/d6349a56617b45dbb808777c9559c848/roles/f3c7872a0874484085c534eb05e404eb => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:21.735799 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4cdd9-c798-467b-a828-9636f7979436 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:21.736433 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4cdd9-c798-467b-a828-9636f7979436 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:21.736433 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4cdd9-c798-467b-a828-9636f7979436 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:21.738061 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 143/287] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:21.743481 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c3740-d58d-4008-bee5-faac6e67a667 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:21.743774 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c3740-d58d-4008-bee5-faac6e67a667 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:21.744052 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c3740-d58d-4008-bee5-faac6e67a667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:21.768273 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-e44c3740-d58d-4008-bee5-faac6e67a667 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:21.769563 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-e44c3740-d58d-4008-bee5-faac6e67a667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:21.862834 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 145/288] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:02:21.896221 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4cdd9-c798-467b-a828-9636f7979436 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:21.933937 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:22.018188 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4cdd9-c798-467b-a828-9636f7979436 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:22.054377 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d04e3-18ad-4e48-8631-6ffa27ffff04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:22.055158 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d04e3-18ad-4e48-8631-6ffa27ffff04 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:22.055437 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d04e3-18ad-4e48-8631-6ffa27ffff04 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:22.055707 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d04e3-18ad-4e48-8631-6ffa27ffff04 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:22.066913 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d04e3-18ad-4e48-8631-6ffa27ffff04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:02:22.074547 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-076d04e3-18ad-4e48-8631-6ffa27ffff04 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 13:02:22.074547 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:22.074547 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:22.074547 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:22.074547 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:22.074547 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:22.074547 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:22.074547 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:22.074547 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:22.074547 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:22.074547 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:22.074547 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:22.074547 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:02:22.074547 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:02:22.074547 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:02:22.074547 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:02:22.075516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:02:22.075516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:02:22.075516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:02:22.075516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:02:22.075516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:22.075516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:22.075516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:22.075516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:22.075516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:22.075516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:22.075516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:22.075516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:22.075516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:22.075516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:22.075516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:22.075516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:22.076759 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:22.076759 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:22.076759 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:22.076759 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:22.076759 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:02:22.076759 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:02:22.076759 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:02:22.076759 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:02:22.076759 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:02:22.076759 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:02:22.076759 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 13:02:22.076759 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:02:22.076759 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 144/289] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:02:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:22.085270 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c3740-d58d-4008-bee5-faac6e67a667 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:22.156860 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:22.223406 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c3740-d58d-4008-bee5-faac6e67a667 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:22.260560 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421dd89a-4c06-45d6-ad60-8dc6490e57a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:22.261230 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421dd89a-4c06-45d6-ad60-8dc6490e57a0 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:22.261510 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421dd89a-4c06-45d6-ad60-8dc6490e57a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:22.261785 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421dd89a-4c06-45d6-ad60-8dc6490e57a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:22.262528 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421dd89a-4c06-45d6-ad60-8dc6490e57a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:22.262831 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421dd89a-4c06-45d6-ad60-8dc6490e57a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:22.264239 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421dd89a-4c06-45d6-ad60-8dc6490e57a0 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:22.273963 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 146/290] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 13:02:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:22.279555 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d04e3-18ad-4e48-8631-6ffa27ffff04 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:22.386399 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:22.400828 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d04e3-18ad-4e48-8631-6ffa27ffff04 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:22.436873 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388f905-efdd-4030-a39a-825465ae57ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:22.438289 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388f905-efdd-4030-a39a-825465ae57ed None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:22.438805 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388f905-efdd-4030-a39a-825465ae57ed None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:22.439074 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388f905-efdd-4030-a39a-825465ae57ed None admin] PATH_INFO: `/v3/users/98193543d0cc408ea22d6551ef35bcae` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:22.440286 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1388f905-efdd-4030-a39a-825465ae57ed None admin] RBAC: Authorizing `identity:get_user(user_id=98193543d0cc408ea22d6551ef35bcae)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:22.441730 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1388f905-efdd-4030-a39a-825465ae57ed None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:22.443342 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 145/291] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 13:02:22 2022] GET /identity/v3/users/98193543d0cc408ea22d6551ef35bcae => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:22.448770 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421dd89a-4c06-45d6-ad60-8dc6490e57a0 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:22.576041 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421dd89a-4c06-45d6-ad60-8dc6490e57a0 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:22.585534 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:22.618953 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b35af7-77de-4dbd-8604-2b8d9f25f520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:22.619605 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b35af7-77de-4dbd-8604-2b8d9f25f520 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:22.619892 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b35af7-77de-4dbd-8604-2b8d9f25f520 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:22.620177 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b35af7-77de-4dbd-8604-2b8d9f25f520 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:22.730930 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b35af7-77de-4dbd-8604-2b8d9f25f520 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:22.732434 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b35af7-77de-4dbd-8604-2b8d9f25f520 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:22.837825 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 147/292] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:02:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:22.849279 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388f905-efdd-4030-a39a-825465ae57ed None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:22.995968 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388f905-efdd-4030-a39a-825465ae57ed None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:23.057758 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5ebc1-50fe-4aeb-a7b8-e6f0992a829b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:23.058614 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5ebc1-50fe-4aeb-a7b8-e6f0992a829b None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:23.058890 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5ebc1-50fe-4aeb-a7b8-e6f0992a829b None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:23.059160 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5ebc1-50fe-4aeb-a7b8-e6f0992a829b None admin] PATH_INFO: `/v3/projects/25310838cd094a4aba3f8ea2a06ff3c4` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:23.060371 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5ebc1-50fe-4aeb-a7b8-e6f0992a829b None admin] RBAC: Authorizing `identity:get_project(project_id=25310838cd094a4aba3f8ea2a06ff3c4)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:23.061790 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5ebc1-50fe-4aeb-a7b8-e6f0992a829b None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:23.063536 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 146/293] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:02:22 2022] GET /identity/v3/projects/25310838cd094a4aba3f8ea2a06ff3c4 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:23.069203 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b35af7-77de-4dbd-8604-2b8d9f25f520 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:23.077479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:23.180466 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b35af7-77de-4dbd-8604-2b8d9f25f520 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:23.222484 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e87c781-6102-4fd3-a1cb-a75a47cb249d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:23.223144 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87c781-6102-4fd3-a1cb-a75a47cb249d None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:23.223424 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87c781-6102-4fd3-a1cb-a75a47cb249d None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:23.223794 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87c781-6102-4fd3-a1cb-a75a47cb249d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:23.224649 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e87c781-6102-4fd3-a1cb-a75a47cb249d None admin] RBAC: Adding query filter params (role.id=d082d2b37fd1455ea61819353e8369ed, scope.project.id=25310838cd094a4aba3f8ea2a06ff3c4, user.id=98193543d0cc408ea22d6551ef35bcae) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:23.224959 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e87c781-6102-4fd3-a1cb-a75a47cb249d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:23.226393 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e87c781-6102-4fd3-a1cb-a75a47cb249d None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:23.232824 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 148/294] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 13:02:23 2022] GET /identity/v3/role_assignments?user.id=98193543d0cc408ea22d6551ef35bcae&scope.project.id=25310838cd094a4aba3f8ea2a06ff3c4&role.id=d082d2b37fd1455ea61819353e8369ed => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:23.254006 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6aa39e-9ddb-443d-b48b-f7f650dbab42 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:23.254293 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6aa39e-9ddb-443d-b48b-f7f650dbab42 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:23.254486 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6aa39e-9ddb-443d-b48b-f7f650dbab42 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:23.256267 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 147/295] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:23.261896 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fd45d-84e2-49e1-b88c-89800b8e69e3 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:23.262190 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fd45d-84e2-49e1-b88c-89800b8e69e3 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:23.262470 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fd45d-84e2-49e1-b88c-89800b8e69e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:23.293766 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-0c6fd45d-84e2-49e1-b88c-89800b8e69e3 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:23.294984 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-0c6fd45d-84e2-49e1-b88c-89800b8e69e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:23.345998 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f4c5a-ee78-4a2f-9203-b77a009efd46 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:23.346690 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f4c5a-ee78-4a2f-9203-b77a009efd46 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:23.347424 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f4c5a-ee78-4a2f-9203-b77a009efd46 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:23.353468 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 148/296] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:23.355419 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900c7f5-5311-4fd1-b272-a5f3d7d48ca1 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:23.355928 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900c7f5-5311-4fd1-b272-a5f3d7d48ca1 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:23.356625 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900c7f5-5311-4fd1-b272-a5f3d7d48ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:23.384591 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-1900c7f5-5311-4fd1-b272-a5f3d7d48ca1 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:23.385820 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-1900c7f5-5311-4fd1-b272-a5f3d7d48ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:23.398835 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:23.404078 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 149/297] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:02:23.405634 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844f314-bdc6-4786-a74c-feaa64972c64 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:23.406027 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844f314-bdc6-4786-a74c-feaa64972c64 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:23.407014 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844f314-bdc6-4786-a74c-feaa64972c64 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:23.412284 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 150/298] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:23.417983 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487bdf15-3989-4985-96e1-2f73fff79fc9 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:23.417983 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487bdf15-3989-4985-96e1-2f73fff79fc9 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:23.417983 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487bdf15-3989-4985-96e1-2f73fff79fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:23.418772 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:23.433335 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-487bdf15-3989-4985-96e1-2f73fff79fc9 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:23.434735 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-487bdf15-3989-4985-96e1-2f73fff79fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:23.496263 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 149/299] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 13:02:23.497432 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900c7f5-5311-4fd1-b272-a5f3d7d48ca1 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:23.518033 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 151/300] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:02:23.540791 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487bdf15-3989-4985-96e1-2f73fff79fc9 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:23.633080 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900c7f5-5311-4fd1-b272-a5f3d7d48ca1 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:23.664923 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487bdf15-3989-4985-96e1-2f73fff79fc9 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:23.671051 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e566969-fad7-4a14-979e-e335536951ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:23.671911 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e566969-fad7-4a14-979e-e335536951ac None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:23.672292 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e566969-fad7-4a14-979e-e335536951ac None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:23.672616 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e566969-fad7-4a14-979e-e335536951ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:23.685080 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e566969-fad7-4a14-979e-e335536951ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:02:23.693636 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-7e566969-fad7-4a14-979e-e335536951ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 13:02:23.693636 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:23.693636 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:23.693636 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:23.693636 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:23.693636 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:23.693636 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:23.693636 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:23.693636 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:23.693636 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:23.693636 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:23.693636 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:23.693636 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:02:23.693636 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:02:23.693636 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:02:23.693636 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:02:23.694514 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:02:23.694514 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:02:23.694514 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:02:23.694514 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:02:23.694514 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:23.694514 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:23.694514 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:23.694514 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:23.694514 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:23.694514 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:23.694514 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:23.694514 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:23.694514 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:23.694514 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:23.694514 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:23.694514 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:23.695300 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:23.695300 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:23.695300 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:23.695300 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:23.695300 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:02:23.695300 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:02:23.695300 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:02:23.695300 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:02:23.695300 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:02:23.695300 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:02:23.695300 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 13:02:23.695300 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:02:23.695300 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 150/301] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:02:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:23.695936 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e566969-fad7-4a14-979e-e335536951ac None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:23.701500 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:23.708308 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c75f7-1aa4-483d-a112-a511368bf2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:23.709254 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c75f7-1aa4-483d-a112-a511368bf2eb None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:23.709538 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c75f7-1aa4-483d-a112-a511368bf2eb None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:23.709815 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c75f7-1aa4-483d-a112-a511368bf2eb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:23.715113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:23.721645 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6c75f7-1aa4-483d-a112-a511368bf2eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:02:23.729697 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-ea6c75f7-1aa4-483d-a112-a511368bf2eb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 13:02:23.729697 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:23.729697 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:23.729697 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:23.729697 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:23.729697 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:23.729697 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:23.729697 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:23.729697 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:23.729697 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:23.729697 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:23.729697 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:23.729697 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:02:23.729697 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:02:23.729697 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:02:23.729697 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:02:23.730565 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:02:23.730565 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:02:23.730565 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:02:23.730565 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:02:23.730565 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:23.730565 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:23.730565 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:23.730565 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:23.730565 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:23.730565 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:23.730565 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:23.730565 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:23.730565 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:23.730565 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:23.730565 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:23.730565 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:23.733033 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:23.733033 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:23.733033 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:23.733033 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:23.733033 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:02:23.733033 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:02:23.733033 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:02:23.733033 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:02:23.733033 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:02:23.733033 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:02:23.733033 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 13:02:23.733033 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:02:23.733033 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 152/302] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:02:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:02:23.733033 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c75f7-1aa4-483d-a112-a511368bf2eb None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:23.803669 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e566969-fad7-4a14-979e-e335536951ac None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:23.837466 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650614c-816a-4b2e-8b62-197deba52efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:23.838257 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650614c-816a-4b2e-8b62-197deba52efd None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:23.838531 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650614c-816a-4b2e-8b62-197deba52efd None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:23.838803 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650614c-816a-4b2e-8b62-197deba52efd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:23.840025 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d650614c-816a-4b2e-8b62-197deba52efd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:23.841409 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d650614c-816a-4b2e-8b62-197deba52efd None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:23.842083 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c75f7-1aa4-483d-a112-a511368bf2eb None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:23.843223 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 151/303] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:02:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:23.845023 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650614c-816a-4b2e-8b62-197deba52efd None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:23.883000 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7783058-bf75-4bcd-82ab-7ac0094312ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:23.883667 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7783058-bf75-4bcd-82ab-7ac0094312ae None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:23.883953 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7783058-bf75-4bcd-82ab-7ac0094312ae None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:23.884260 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7783058-bf75-4bcd-82ab-7ac0094312ae None admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:23.885015 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7783058-bf75-4bcd-82ab-7ac0094312ae None admin] RBAC: Adding query filter params (name=member) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:23.885327 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7783058-bf75-4bcd-82ab-7ac0094312ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:23.886738 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7783058-bf75-4bcd-82ab-7ac0094312ae None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:23.896269 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 153/304] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 13:02:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:23.897083 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7783058-bf75-4bcd-82ab-7ac0094312ae None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:23.940786 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:23.956701 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:23.960663 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650614c-816a-4b2e-8b62-197deba52efd None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:24.001758 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ff20a-db85-4a1e-9d4c-928e387ee805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:24.001861 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ff20a-db85-4a1e-9d4c-928e387ee805 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:24.002116 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ff20a-db85-4a1e-9d4c-928e387ee805 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:24.002421 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ff20a-db85-4a1e-9d4c-928e387ee805 None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:24.003317 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446ff20a-db85-4a1e-9d4c-928e387ee805 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:24.003631 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446ff20a-db85-4a1e-9d4c-928e387ee805 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:24.005050 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446ff20a-db85-4a1e-9d4c-928e387ee805 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:24.018577 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 152/305] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 13:02:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:24.018577 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ff20a-db85-4a1e-9d4c-928e387ee805 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:24.021129 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7783058-bf75-4bcd-82ab-7ac0094312ae None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:24.057391 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e7f2f-ac20-455c-9532-6c3e0a93fd3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:24.057981 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e7f2f-ac20-455c-9532-6c3e0a93fd3b None admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:24.058267 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e7f2f-ac20-455c-9532-6c3e0a93fd3b None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:24.058546 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e7f2f-ac20-455c-9532-6c3e0a93fd3b None admin] PATH_INFO: `/v3/groups` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:24.059670 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e7f2f-ac20-455c-9532-6c3e0a93fd3b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:24.061554 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e7f2f-ac20-455c-9532-6c3e0a93fd3b None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:24.119279 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ff20a-db85-4a1e-9d4c-928e387ee805 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:24.152694 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717eb80b-8267-49a3-9cc0-7b36ad645ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:24.153602 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 154/306] 10.222.0.61 () {60 vars in 1134 bytes} [Fri Jun 3 13:02:23 2022] POST /identity/v3/groups => generated 229 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:24.154242 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e7f2f-ac20-455c-9532-6c3e0a93fd3b None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:24.160392 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717eb80b-8267-49a3-9cc0-7b36ad645ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:24.161104 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717eb80b-8267-49a3-9cc0-7b36ad645ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:24.161623 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717eb80b-8267-49a3-9cc0-7b36ad645ed1 None admin] PATH_INFO: `/v3/users/d9ed617d0631449b825b4d6ead583194` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:24.163471 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717eb80b-8267-49a3-9cc0-7b36ad645ed1 None admin] RBAC: Authorizing `identity:get_user(user_id=d9ed617d0631449b825b4d6ead583194)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:24.165508 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717eb80b-8267-49a3-9cc0-7b36ad645ed1 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:24.167567 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 153/307] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 13:02:24 2022] GET /identity/v3/users/d9ed617d0631449b825b4d6ead583194 => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:24.173954 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717eb80b-8267-49a3-9cc0-7b36ad645ed1 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:24.190774 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:24.282066 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e7f2f-ac20-455c-9532-6c3e0a93fd3b None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:24.297279 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:24.301889 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717eb80b-8267-49a3-9cc0-7b36ad645ed1 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:24.333017 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d011c-7d40-42a6-b615-bc58076c916e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:24.334256 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d011c-7d40-42a6-b615-bc58076c916e None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:24.334777 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d011c-7d40-42a6-b615-bc58076c916e None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:24.335258 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d011c-7d40-42a6-b615-bc58076c916e None admin] PATH_INFO: `/v3/users/b43110f33971412592068c6eded2f3cd` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:24.344968 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a28af-f485-490d-88d3-5f9a07bf7193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:24.345999 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a28af-f485-490d-88d3-5f9a07bf7193 None admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:24.346288 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a28af-f485-490d-88d3-5f9a07bf7193 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:24.350990 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a28af-f485-490d-88d3-5f9a07bf7193 None admin] PATH_INFO: `/v3/system/users/d9ed617d0631449b825b4d6ead583194/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:24.350990 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a28af-f485-490d-88d3-5f9a07bf7193 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d9ed617d0631449b825b4d6ead583194, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:24.350990 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a28af-f485-490d-88d3-5f9a07bf7193 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:24.353164 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d011c-7d40-42a6-b615-bc58076c916e None admin] RBAC: Authorizing `identity:get_user(user_id=b43110f33971412592068c6eded2f3cd)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:24.355242 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d011c-7d40-42a6-b615-bc58076c916e None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:24.357465 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 155/308] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 13:02:24 2022] GET /identity/v3/users/b43110f33971412592068c6eded2f3cd => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:24.363886 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d011c-7d40-42a6-b615-bc58076c916e None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:24.474415 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d011c-7d40-42a6-b615-bc58076c916e None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:24.490928 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 154/309] 10.222.0.61 () {58 vars in 1334 bytes} [Fri Jun 3 13:02:24 2022] PUT /identity/v3/system/users/d9ed617d0631449b825b4d6ead583194/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:24.527376 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec32dc-ec43-4fa9-be5e-a30fbeef3196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:24.528063 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec32dc-ec43-4fa9-be5e-a30fbeef3196 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:24.528385 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec32dc-ec43-4fa9-be5e-a30fbeef3196 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:24.528679 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec32dc-ec43-4fa9-be5e-a30fbeef3196 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:24.529512 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec32dc-ec43-4fa9-be5e-a30fbeef3196 None admin] RBAC: Adding query filter params (role.id=f3c7872a0874484085c534eb05e404eb, user.id=b43110f33971412592068c6eded2f3cd, scope.system=all) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:24.529850 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec32dc-ec43-4fa9-be5e-a30fbeef3196 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:24.531940 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec32dc-ec43-4fa9-be5e-a30fbeef3196 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:24.535653 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9c69d-5629-4a80-af57-99f191a8605d None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:24.536348 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9c69d-5629-4a80-af57-99f191a8605d None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:24.536837 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9c69d-5629-4a80-af57-99f191a8605d None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:24.538568 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 155/311] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 13:02:24.542027 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 156/311] 10.222.0.61 () {56 vars in 1308 bytes} [Fri Jun 3 13:02:24 2022] GET /identity/v3/role_assignments?user.id=b43110f33971412592068c6eded2f3cd&scope.system=all&role.id=f3c7872a0874484085c534eb05e404eb => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:02:24.550986 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a024397-f81e-4747-b488-f95abf06c518 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:24.551630 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a024397-f81e-4747-b488-f95abf06c518 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:24.552127 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a024397-f81e-4747-b488-f95abf06c518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:24.571795 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-5a024397-f81e-4747-b488-f95abf06c518 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:24.573586 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-5a024397-f81e-4747-b488-f95abf06c518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:24.609332 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:24.659488 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 157/312] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:02:24.685152 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9c69d-5629-4a80-af57-99f191a8605d None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:24.782711 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:24.808219 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9c69d-5629-4a80-af57-99f191a8605d None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:24.843262 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f2756d-40c4-47e0-bf5f-7bfc9f42af4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:24.844800 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2756d-40c4-47e0-bf5f-7bfc9f42af4a None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:24.845082 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2756d-40c4-47e0-bf5f-7bfc9f42af4a None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:24.845352 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2756d-40c4-47e0-bf5f-7bfc9f42af4a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:24.856330 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f2756d-40c4-47e0-bf5f-7bfc9f42af4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:02:24.868669 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-01f2756d-40c4-47e0-bf5f-7bfc9f42af4a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 13:02:24.868669 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:24.868669 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:24.868669 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:24.868669 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:24.868669 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:24.868669 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:24.868669 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:24.868669 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:24.868669 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:24.868669 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:24.868669 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:24.868669 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:02:24.868669 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:02:24.868669 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:02:24.868669 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:02:24.869558 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:02:24.869558 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:02:24.869558 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:02:24.869558 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:02:24.869558 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:24.869558 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:24.869558 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:24.869558 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:24.869558 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:24.869558 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:24.869558 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:24.869558 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:24.869558 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:24.869558 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:24.869558 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:24.869558 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:24.870353 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:24.870353 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:24.870353 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:24.870353 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:24.870353 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:02:24.870353 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:02:24.870353 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:02:24.870353 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:02:24.870353 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:02:24.870353 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:02:24.870353 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 13:02:24.870353 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:02:24.870353 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 156/313] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:02:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:24.872690 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a024397-f81e-4747-b488-f95abf06c518 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:24.979483 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a024397-f81e-4747-b488-f95abf06c518 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:25.018244 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157bcbf1-2eb7-4df0-ad9c-1545181d870f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:25.019026 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bcbf1-2eb7-4df0-ad9c-1545181d870f None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:25.019312 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bcbf1-2eb7-4df0-ad9c-1545181d870f None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:25.019586 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bcbf1-2eb7-4df0-ad9c-1545181d870f None admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:25.020357 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157bcbf1-2eb7-4df0-ad9c-1545181d870f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:25.020662 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157bcbf1-2eb7-4df0-ad9c-1545181d870f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:25.022042 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157bcbf1-2eb7-4df0-ad9c-1545181d870f None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:25.032733 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 158/314] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 13:02:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:25.038262 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f2756d-40c4-47e0-bf5f-7bfc9f42af4a None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:25.153066 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f2756d-40c4-47e0-bf5f-7bfc9f42af4a None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:25.192093 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88a2bf-3588-494d-b6bd-4e392b5d9e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:25.193045 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88a2bf-3588-494d-b6bd-4e392b5d9e1f None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:25.193320 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88a2bf-3588-494d-b6bd-4e392b5d9e1f None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:25.193591 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88a2bf-3588-494d-b6bd-4e392b5d9e1f None admin] PATH_INFO: `/v3/users/d6349a56617b45dbb808777c9559c848` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:25.194823 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88a2bf-3588-494d-b6bd-4e392b5d9e1f None admin] RBAC: Authorizing `identity:get_user(user_id=d6349a56617b45dbb808777c9559c848)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:25.196277 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88a2bf-3588-494d-b6bd-4e392b5d9e1f None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:25.198183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 157/315] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 13:02:25 2022] GET /identity/v3/users/d6349a56617b45dbb808777c9559c848 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:25.204248 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157bcbf1-2eb7-4df0-ad9c-1545181d870f None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:25.236623 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:25.311596 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157bcbf1-2eb7-4df0-ad9c-1545181d870f None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:25.347706 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f650acb-da26-4ac6-b5ab-2fc736f23c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:25.348434 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f650acb-da26-4ac6-b5ab-2fc736f23c50 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:25.348713 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f650acb-da26-4ac6-b5ab-2fc736f23c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:25.348987 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f650acb-da26-4ac6-b5ab-2fc736f23c50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:25.423975 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f650acb-da26-4ac6-b5ab-2fc736f23c50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:25.425385 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f650acb-da26-4ac6-b5ab-2fc736f23c50 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:25.452325 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:25.528628 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 159/316] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:02:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:25.534287 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88a2bf-3588-494d-b6bd-4e392b5d9e1f None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:25.548479 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:25.637528 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88a2bf-3588-494d-b6bd-4e392b5d9e1f None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:25.671078 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce03ef-e824-40d8-b9b3-1ae2977ddfdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:25.672496 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce03ef-e824-40d8-b9b3-1ae2977ddfdb None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:25.672778 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce03ef-e824-40d8-b9b3-1ae2977ddfdb None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:25.673215 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce03ef-e824-40d8-b9b3-1ae2977ddfdb None admin] PATH_INFO: `/v3/projects/25310838cd094a4aba3f8ea2a06ff3c4` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:25.674507 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dce03ef-e824-40d8-b9b3-1ae2977ddfdb None admin] RBAC: Authorizing `identity:get_project(project_id=25310838cd094a4aba3f8ea2a06ff3c4)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:25.675911 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dce03ef-e824-40d8-b9b3-1ae2977ddfdb None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:25.678057 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 158/317] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:02:25 2022] GET /identity/v3/projects/25310838cd094a4aba3f8ea2a06ff3c4 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:25.685348 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f650acb-da26-4ac6-b5ab-2fc736f23c50 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:25.799002 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f650acb-da26-4ac6-b5ab-2fc736f23c50 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:25.825726 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:25.835152 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f707f85-79a2-4233-9d0c-664eb99cbd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:25.835806 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f707f85-79a2-4233-9d0c-664eb99cbd51 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:25.836133 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f707f85-79a2-4233-9d0c-664eb99cbd51 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:25.836448 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f707f85-79a2-4233-9d0c-664eb99cbd51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:25.841439 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f707f85-79a2-4233-9d0c-664eb99cbd51 None admin] RBAC: Adding query filter params (role.id=f3c7872a0874484085c534eb05e404eb, scope.project.id=25310838cd094a4aba3f8ea2a06ff3c4, user.id=d6349a56617b45dbb808777c9559c848) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:25.841439 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f707f85-79a2-4233-9d0c-664eb99cbd51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:25.841439 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f707f85-79a2-4233-9d0c-664eb99cbd51 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:25.846448 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 160/318] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 13:02:25 2022] GET /identity/v3/role_assignments?user.id=d6349a56617b45dbb808777c9559c848&scope.project.id=25310838cd094a4aba3f8ea2a06ff3c4&role.id=f3c7872a0874484085c534eb05e404eb => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:26.554298 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fb1fe-199c-4768-9b81-52adae779aa9 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:26.554919 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fb1fe-199c-4768-9b81-52adae779aa9 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:26.554919 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fb1fe-199c-4768-9b81-52adae779aa9 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:26.556445 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 159/319] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:26.561417 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee6105-8e0a-49d3-b2b6-6bf91360a738 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:26.561847 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee6105-8e0a-49d3-b2b6-6bf91360a738 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:26.562016 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee6105-8e0a-49d3-b2b6-6bf91360a738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:26.581180 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-d4ee6105-8e0a-49d3-b2b6-6bf91360a738 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:26.582406 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-d4ee6105-8e0a-49d3-b2b6-6bf91360a738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:26.654439 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 161/320] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:02:26.676209 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781fb1fe-199c-4768-9b81-52adae779aa9 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:26.747225 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:26.779382 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781fb1fe-199c-4768-9b81-52adae779aa9 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:26.814381 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb82843-3a9a-4c4c-9793-833bb7448a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:26.815102 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb82843-3a9a-4c4c-9793-833bb7448a98 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:26.815386 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb82843-3a9a-4c4c-9793-833bb7448a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:26.815660 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb82843-3a9a-4c4c-9793-833bb7448a98 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:26.816872 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb82843-3a9a-4c4c-9793-833bb7448a98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:26.818512 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb82843-3a9a-4c4c-9793-833bb7448a98 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:26.820404 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 160/321] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:02:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:26.825705 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee6105-8e0a-49d3-b2b6-6bf91360a738 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:26.843428 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854c5d4-c7e1-4966-97fc-c5afc97652f1 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:26.843786 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854c5d4-c7e1-4966-97fc-c5afc97652f1 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:26.844022 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854c5d4-c7e1-4966-97fc-c5afc97652f1 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:26.845682 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 161/322] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:26.850699 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b0e5f-62b1-4cc5-9341-6d05519ac396 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:26.850994 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b0e5f-62b1-4cc5-9341-6d05519ac396 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:26.851269 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b0e5f-62b1-4cc5-9341-6d05519ac396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:26.869345 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-529b0e5f-62b1-4cc5-9341-6d05519ac396 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:26.870530 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-529b0e5f-62b1-4cc5-9341-6d05519ac396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:26.930174 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee6105-8e0a-49d3-b2b6-6bf91360a738 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:26.940196 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 162/323] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 13:02:26.941594 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50baf13f-dc32-4c88-900a-dde79fa82a7f None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:26.941887 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50baf13f-dc32-4c88-900a-dde79fa82a7f None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:26.942162 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50baf13f-dc32-4c88-900a-dde79fa82a7f None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:26.944199 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 163/324] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:26.948924 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b379f-4e33-4c44-933b-be50224b08a4 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:26.949210 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b379f-4e33-4c44-933b-be50224b08a4 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:26.949478 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b379f-4e33-4c44-933b-be50224b08a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:26.952112 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:26.965717 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061db08c-b421-408f-b31f-f59e118287dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:26.969170 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-fa7b379f-4e33-4c44-933b-be50224b08a4 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:26.969317 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061db08c-b421-408f-b31f-f59e118287dc None admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:26.969317 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061db08c-b421-408f-b31f-f59e118287dc None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:26.969317 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061db08c-b421-408f-b31f-f59e118287dc None admin] PATH_INFO: `/v3/groups` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:26.969642 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-fa7b379f-4e33-4c44-933b-be50224b08a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:26.969734 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061db08c-b421-408f-b31f-f59e118287dc None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:26.969734 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061db08c-b421-408f-b31f-f59e118287dc None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:27.027896 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:27.032935 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 164/325] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 13:02:27.033754 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b379f-4e33-4c44-933b-be50224b08a4 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:27.079108 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 162/326] 10.222.0.61 () {60 vars in 1134 bytes} [Fri Jun 3 13:02:26 2022] POST /identity/v3/groups => generated 226 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:27.080037 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061db08c-b421-408f-b31f-f59e118287dc None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:27.140183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b379f-4e33-4c44-933b-be50224b08a4 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:27.183430 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595ee40-4d1c-4b92-b331-98484b5c21a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:27.184267 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595ee40-4d1c-4b92-b331-98484b5c21a2 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:27.184554 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595ee40-4d1c-4b92-b331-98484b5c21a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:27.184826 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595ee40-4d1c-4b92-b331-98484b5c21a2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:27.193141 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061db08c-b421-408f-b31f-f59e118287dc None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:27.197695 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595ee40-4d1c-4b92-b331-98484b5c21a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:02:27.206325 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-2595ee40-4d1c-4b92-b331-98484b5c21a2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 13:02:27.206325 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:27.206325 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:27.206325 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:27.206325 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:27.206325 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:27.206325 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:27.206325 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:27.206325 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:27.206325 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:27.206325 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:27.206325 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:27.206325 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:02:27.206325 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:02:27.206325 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:02:27.206325 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:02:27.207356 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:02:27.207356 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:02:27.207356 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:02:27.207356 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:02:27.207356 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:27.207356 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:27.207356 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:27.207356 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:27.207356 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:27.207356 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:27.207356 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:27.207356 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:27.207356 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:27.207356 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:27.207356 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:27.207356 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:27.208996 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:27.208996 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:27.208996 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:27.208996 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:27.208996 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:02:27.208996 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:02:27.208996 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:02:27.208996 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:02:27.208996 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:02:27.208996 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:02:27.208996 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 13:02:27.208996 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:02:27.208996 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 165/327] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:02:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:27.213547 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595ee40-4d1c-4b92-b331-98484b5c21a2 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:27.233069 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5770559-c255-4a42-96e5-10e8c2f5eef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:27.233903 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5770559-c255-4a42-96e5-10e8c2f5eef6 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:27.234190 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5770559-c255-4a42-96e5-10e8c2f5eef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:27.234947 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5770559-c255-4a42-96e5-10e8c2f5eef6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:27.247092 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5770559-c255-4a42-96e5-10e8c2f5eef6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:02:27.255911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-e5770559-c255-4a42-96e5-10e8c2f5eef6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 13:02:27.255911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:27.255911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:27.255911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:27.255911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:27.255911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:27.255911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:27.255911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:27.255911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:27.255911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:27.255911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:27.255911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:27.255911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:02:27.255911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:02:27.255911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:02:27.255911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:02:27.257150 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:02:27.257150 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:02:27.257150 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:02:27.257150 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:02:27.257150 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:27.257150 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:27.257150 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:27.257150 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:27.257150 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:27.257150 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:27.257150 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:27.257150 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:27.257150 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:27.257150 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:27.257150 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:27.257150 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:27.257933 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:27.257933 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:27.257933 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:27.257933 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:27.257933 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:02:27.257933 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:02:27.257933 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:02:27.257933 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:02:27.257933 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:02:27.257933 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:02:27.257933 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 13:02:27.257933 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:02:27.257933 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 163/328] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:02:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:27.263266 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5770559-c255-4a42-96e5-10e8c2f5eef6 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:27.286292 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:27.311971 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:27.343678 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595ee40-4d1c-4b92-b331-98484b5c21a2 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:27.384895 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5770559-c255-4a42-96e5-10e8c2f5eef6 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:27.392672 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4091312a-e2e9-4aa8-9f2e-53c9927991a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:27.393580 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4091312a-e2e9-4aa8-9f2e-53c9927991a2 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:27.394009 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4091312a-e2e9-4aa8-9f2e-53c9927991a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:27.394439 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4091312a-e2e9-4aa8-9f2e-53c9927991a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:27.395197 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4091312a-e2e9-4aa8-9f2e-53c9927991a2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:27.395504 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4091312a-e2e9-4aa8-9f2e-53c9927991a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:27.397071 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4091312a-e2e9-4aa8-9f2e-53c9927991a2 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:27.408064 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 166/329] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 13:02:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:02:27.416713 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4091312a-e2e9-4aa8-9f2e-53c9927991a2 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:27.430412 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c34805-4f85-48e5-a06b-8e431e2f19a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:27.431096 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c34805-4f85-48e5-a06b-8e431e2f19a3 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:27.431384 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c34805-4f85-48e5-a06b-8e431e2f19a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:27.431661 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c34805-4f85-48e5-a06b-8e431e2f19a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:27.432759 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c34805-4f85-48e5-a06b-8e431e2f19a3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:27.432889 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c34805-4f85-48e5-a06b-8e431e2f19a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:27.434761 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c34805-4f85-48e5-a06b-8e431e2f19a3 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:27.447588 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 164/330] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 13:02:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:02:27.453748 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c34805-4f85-48e5-a06b-8e431e2f19a3 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:27.534183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4091312a-e2e9-4aa8-9f2e-53c9927991a2 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:27.560361 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:27.577615 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422decc-f419-4278-bb03-46382aaba0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:27.578632 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422decc-f419-4278-bb03-46382aaba0f1 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:27.578972 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422decc-f419-4278-bb03-46382aaba0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:27.579315 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422decc-f419-4278-bb03-46382aaba0f1 None admin] PATH_INFO: `/v3/users/d9ed617d0631449b825b4d6ead583194` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:27.580850 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c34805-4f85-48e5-a06b-8e431e2f19a3 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:27.581298 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422decc-f419-4278-bb03-46382aaba0f1 None admin] RBAC: Authorizing `identity:get_user(user_id=d9ed617d0631449b825b4d6ead583194)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:27.582420 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422decc-f419-4278-bb03-46382aaba0f1 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:27.584135 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:27.586178 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 167/331] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 13:02:27 2022] GET /identity/v3/users/d9ed617d0631449b825b4d6ead583194 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:02:27.590722 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422decc-f419-4278-bb03-46382aaba0f1 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:27.627499 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580c6b2-4284-4520-b635-ca0c0cdd2172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:27.628461 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580c6b2-4284-4520-b635-ca0c0cdd2172 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:27.629070 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580c6b2-4284-4520-b635-ca0c0cdd2172 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:27.629461 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580c6b2-4284-4520-b635-ca0c0cdd2172 None admin] PATH_INFO: `/v3/users/b43110f33971412592068c6eded2f3cd` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:27.630816 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e580c6b2-4284-4520-b635-ca0c0cdd2172 None admin] RBAC: Authorizing `identity:get_user(user_id=b43110f33971412592068c6eded2f3cd)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:27.632404 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e580c6b2-4284-4520-b635-ca0c0cdd2172 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:27.634396 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 165/332] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 13:02:27 2022] GET /identity/v3/users/b43110f33971412592068c6eded2f3cd => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:02:27.639763 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580c6b2-4284-4520-b635-ca0c0cdd2172 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:27.735149 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422decc-f419-4278-bb03-46382aaba0f1 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:27.782801 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580c6b2-4284-4520-b635-ca0c0cdd2172 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:27.792074 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f4371-6e9d-41c6-b735-d4ce10e71849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:27.793504 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f4371-6e9d-41c6-b735-d4ce10e71849 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:27.794016 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f4371-6e9d-41c6-b735-d4ce10e71849 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:27.794500 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f4371-6e9d-41c6-b735-d4ce10e71849 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:27.795527 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71f4371-6e9d-41c6-b735-d4ce10e71849 None admin] RBAC: Adding query filter params (role.id=d082d2b37fd1455ea61819353e8369ed, user.id=d9ed617d0631449b825b4d6ead583194, scope.system=all) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:27.796483 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71f4371-6e9d-41c6-b735-d4ce10e71849 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:27.798939 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71f4371-6e9d-41c6-b735-d4ce10e71849 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:27.818236 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 168/333] 10.222.0.61 () {56 vars in 1308 bytes} [Fri Jun 3 13:02:27 2022] GET /identity/v3/role_assignments?user.id=d9ed617d0631449b825b4d6ead583194&scope.system=all&role.id=d082d2b37fd1455ea61819353e8369ed => generated 510 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:02:27.839585 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8395612b-4430-4af4-a396-7204142d25dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:27.840530 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395612b-4430-4af4-a396-7204142d25dc None admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:27.840815 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395612b-4430-4af4-a396-7204142d25dc None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:27.841091 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395612b-4430-4af4-a396-7204142d25dc None admin] PATH_INFO: `/v3/system/users/b43110f33971412592068c6eded2f3cd/roles/f3c7872a0874484085c534eb05e404eb` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:27.844616 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8395612b-4430-4af4-a396-7204142d25dc None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b43110f33971412592068c6eded2f3cd, role_id=f3c7872a0874484085c534eb05e404eb)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:27.846135 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8395612b-4430-4af4-a396-7204142d25dc None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:27.925795 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 166/334] 10.222.0.61 () {58 vars in 1334 bytes} [Fri Jun 3 13:02:27 2022] PUT /identity/v3/system/users/b43110f33971412592068c6eded2f3cd/roles/f3c7872a0874484085c534eb05e404eb => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:02:29.783928 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182bbe8e-f6fa-455c-ad93-dcc52f1cf2ab None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:29.784467 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182bbe8e-f6fa-455c-ad93-dcc52f1cf2ab None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:29.784564 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182bbe8e-f6fa-455c-ad93-dcc52f1cf2ab None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:29.786329 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 169/335] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:29.791649 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99305b81-60ea-4500-aa11-dee377603022 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:29.792098 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99305b81-60ea-4500-aa11-dee377603022 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:29.792256 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99305b81-60ea-4500-aa11-dee377603022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:29.812438 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-99305b81-60ea-4500-aa11-dee377603022 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:29.813634 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-99305b81-60ea-4500-aa11-dee377603022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:29.854924 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:29.908702 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 167/336] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:02:29.951457 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182bbe8e-f6fa-455c-ad93-dcc52f1cf2ab None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:30.020391 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:30.090062 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182bbe8e-f6fa-455c-ad93-dcc52f1cf2ab None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:30.132568 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e52734-2ee3-461f-8589-9979c6eca71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:30.133367 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e52734-2ee3-461f-8589-9979c6eca71c None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:30.133651 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e52734-2ee3-461f-8589-9979c6eca71c None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:30.133923 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e52734-2ee3-461f-8589-9979c6eca71c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:30.152243 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e52734-2ee3-461f-8589-9979c6eca71c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:02:30.160183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-62e52734-2ee3-461f-8589-9979c6eca71c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 13:02:30.160183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:30.160183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:30.160183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:30.160183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:30.160183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:30.160183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:30.160183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:30.160183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:30.160183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:30.160183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:30.160183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:30.160183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:02:30.160183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:02:30.160183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:02:30.160183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:02:30.161208 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:02:30.161208 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:02:30.161208 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:02:30.161208 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:02:30.161208 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:30.161208 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:30.161208 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:30.161208 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:30.161208 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:30.161208 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:30.161208 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:30.161208 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:30.161208 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:30.161208 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:30.161208 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:30.161208 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:30.161997 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:30.161997 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:30.161997 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:30.161997 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:30.161997 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:02:30.161997 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:02:30.161997 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:02:30.161997 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:02:30.161997 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:02:30.161997 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:02:30.161997 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 13:02:30.161997 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:02:30.164071 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 170/337] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:02:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:30.168970 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99305b81-60ea-4500-aa11-dee377603022 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:30.294676 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99305b81-60ea-4500-aa11-dee377603022 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:30.340237 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4a378-fb77-4dae-9e5f-6588f2834785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:30.340837 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4a378-fb77-4dae-9e5f-6588f2834785 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:30.341121 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4a378-fb77-4dae-9e5f-6588f2834785 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:30.341399 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4a378-fb77-4dae-9e5f-6588f2834785 None admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:30.342170 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d4a378-fb77-4dae-9e5f-6588f2834785 None admin] RBAC: Adding query filter params (name=member) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:30.342479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d4a378-fb77-4dae-9e5f-6588f2834785 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:30.344548 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d4a378-fb77-4dae-9e5f-6588f2834785 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:30.360901 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 168/338] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 13:02:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:30.366753 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e52734-2ee3-461f-8589-9979c6eca71c None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:30.483152 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e52734-2ee3-461f-8589-9979c6eca71c None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:30.491692 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:30.522984 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981afe95-f3fb-4997-b8b2-53ca641c6a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:30.523722 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981afe95-f3fb-4997-b8b2-53ca641c6a40 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:30.524010 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981afe95-f3fb-4997-b8b2-53ca641c6a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:30.524322 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981afe95-f3fb-4997-b8b2-53ca641c6a40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:30.608671 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981afe95-f3fb-4997-b8b2-53ca641c6a40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:30.610838 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981afe95-f3fb-4997-b8b2-53ca641c6a40 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:30.724591 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 171/339] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:02:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:30.730038 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4a378-fb77-4dae-9e5f-6588f2834785 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:30.761921 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:30.850337 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4a378-fb77-4dae-9e5f-6588f2834785 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:30.899765 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b849f9bc-97bb-4af2-88a0-65bb29d9a9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:30.900561 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849f9bc-97bb-4af2-88a0-65bb29d9a9ca None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:30.900844 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849f9bc-97bb-4af2-88a0-65bb29d9a9ca None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:30.901124 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849f9bc-97bb-4af2-88a0-65bb29d9a9ca None admin] PATH_INFO: `/v3/projects/69bee49150564ea3abbe7a2301dea4d8` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:30.904884 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b849f9bc-97bb-4af2-88a0-65bb29d9a9ca None admin] RBAC: Authorizing `identity:get_project(project_id=69bee49150564ea3abbe7a2301dea4d8)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:30.906629 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b849f9bc-97bb-4af2-88a0-65bb29d9a9ca None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:30.909049 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 169/340] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:02:30 2022] GET /identity/v3/projects/69bee49150564ea3abbe7a2301dea4d8 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:30.914722 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981afe95-f3fb-4997-b8b2-53ca641c6a40 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:30.921206 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8022a2b-dc64-45d8-aad3-c254a53460b7 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:30.921656 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8022a2b-dc64-45d8-aad3-c254a53460b7 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:30.922339 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8022a2b-dc64-45d8-aad3-c254a53460b7 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:30.924337 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 170/341] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 13:02:30.929084 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:30.929994 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc4c37-8f8e-4aa0-85d9-3586e6b2886c None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:30.929994 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc4c37-8f8e-4aa0-85d9-3586e6b2886c None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:30.930341 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc4c37-8f8e-4aa0-85d9-3586e6b2886c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:30.963923 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-3bfc4c37-8f8e-4aa0-85d9-3586e6b2886c None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:30.965258 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-3bfc4c37-8f8e-4aa0-85d9-3586e6b2886c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:31.066649 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 171/342] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:02:31.070737 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ced695-9665-42b1-b043-8639c60f20b7 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:31.075540 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ced695-9665-42b1-b043-8639c60f20b7 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:31.076054 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ced695-9665-42b1-b043-8639c60f20b7 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:31.077708 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 172/343] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:31 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:31.083902 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b203611-e78d-4df6-a31e-5eddc93fd93b None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:31.084480 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b203611-e78d-4df6-a31e-5eddc93fd93b None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:31.084977 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b203611-e78d-4df6-a31e-5eddc93fd93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:31.121272 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-0b203611-e78d-4df6-a31e-5eddc93fd93b None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:31.122930 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-0b203611-e78d-4df6-a31e-5eddc93fd93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:31.128471 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981afe95-f3fb-4997-b8b2-53ca641c6a40 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:31.146899 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:31.173764 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8d966-c149-4df2-8783-07259680cebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:31.174211 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8d966-c149-4df2-8783-07259680cebf None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:31.174492 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8d966-c149-4df2-8783-07259680cebf None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:31.174762 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8d966-c149-4df2-8783-07259680cebf None admin] PATH_INFO: `/v3/groups/8459835d4cef40c3bf0369753312956b` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:31.181382 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d8d966-c149-4df2-8783-07259680cebf None admin] RBAC: Authorizing `identity:get_group(group_id=8459835d4cef40c3bf0369753312956b)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:31.182944 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d8d966-c149-4df2-8783-07259680cebf None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:31.186184 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 172/344] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Jun 3 13:02:30 2022] GET /identity/v3/groups/8459835d4cef40c3bf0369753312956b => generated 226 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:31.186988 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8d966-c149-4df2-8783-07259680cebf None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:31.222576 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 173/345] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 13:02:31.226579 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a1437-9404-4749-9344-313b6d349a14 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:31.227121 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a1437-9404-4749-9344-313b6d349a14 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:31.227614 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a1437-9404-4749-9344-313b6d349a14 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:31.229441 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 174/346] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:31.230366 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a1437-9404-4749-9344-313b6d349a14 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:31.270683 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:31.303069 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8d966-c149-4df2-8783-07259680cebf None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:31.338794 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042a338-944a-4550-aa74-d66c9680cc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:31.339591 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042a338-944a-4550-aa74-d66c9680cc2f None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:31.339877 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042a338-944a-4550-aa74-d66c9680cc2f None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:31.340169 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042a338-944a-4550-aa74-d66c9680cc2f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:31.350496 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a1437-9404-4749-9344-313b6d349a14 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:31.351739 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042a338-944a-4550-aa74-d66c9680cc2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:02:31.359867 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-2042a338-944a-4550-aa74-d66c9680cc2f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 13:02:31.359867 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:31.359867 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:31.359867 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:31.359867 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:31.359867 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:31.359867 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:31.359867 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:31.359867 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:31.359867 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:31.359867 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:31.359867 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:31.359867 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:02:31.359867 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:02:31.359867 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:02:31.359867 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:02:31.360780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:02:31.360780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:02:31.360780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:02:31.360780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:02:31.360780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:31.360780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:31.360780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:31.360780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:31.360780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:31.360780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:31.360780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:31.360780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:31.360780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:31.360780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:31.360780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:31.360780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:31.361615 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:31.361615 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:31.361615 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:31.361615 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:31.361615 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:02:31.361615 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:02:31.361615 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:02:31.361615 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:02:31.361615 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:02:31.361615 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:02:31.361615 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 13:02:31.361615 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:02:31.362775 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 173/347] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:02:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:31.363896 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b73400-d679-4718-bc3b-82f8dc843880 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:31.364229 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b73400-d679-4718-bc3b-82f8dc843880 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:31.364530 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b73400-d679-4718-bc3b-82f8dc843880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:31.382066 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-b8b73400-d679-4718-bc3b-82f8dc843880 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:31.383304 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-b8b73400-d679-4718-bc3b-82f8dc843880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:31.392770 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd3043a-84d2-4394-b362-9a96521af29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:31.393732 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd3043a-84d2-4394-b362-9a96521af29d None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:31.394258 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd3043a-84d2-4394-b362-9a96521af29d None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:31.394742 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd3043a-84d2-4394-b362-9a96521af29d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:31.395862 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd3043a-84d2-4394-b362-9a96521af29d None admin] RBAC: Adding query filter params (group.id=8459835d4cef40c3bf0369753312956b, role.id=d082d2b37fd1455ea61819353e8369ed, scope.project.id=69bee49150564ea3abbe7a2301dea4d8) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:31.396403 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd3043a-84d2-4394-b362-9a96521af29d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:31.398181 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd3043a-84d2-4394-b362-9a96521af29d None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:31.404598 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 175/348] 10.222.0.61 () {56 vars in 1376 bytes} [Fri Jun 3 13:02:31 2022] GET /identity/v3/role_assignments?group.id=8459835d4cef40c3bf0369753312956b&scope.project.id=69bee49150564ea3abbe7a2301dea4d8&role.id=d082d2b37fd1455ea61819353e8369ed => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:31.405647 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd3043a-84d2-4394-b362-9a96521af29d None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:31.438802 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:31.483970 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 174/349] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:02:31.485479 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b73400-d679-4718-bc3b-82f8dc843880 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:31.607031 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd3043a-84d2-4394-b362-9a96521af29d None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:31.644067 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:31.692895 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a09d9-8cd2-4bfc-956d-39f31bc5bba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:31.694043 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a09d9-8cd2-4bfc-956d-39f31bc5bba6 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:31.694723 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a09d9-8cd2-4bfc-956d-39f31bc5bba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:31.696092 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a09d9-8cd2-4bfc-956d-39f31bc5bba6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:31.721226 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72a09d9-8cd2-4bfc-956d-39f31bc5bba6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:02:31.723164 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b73400-d679-4718-bc3b-82f8dc843880 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:31.733730 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-b72a09d9-8cd2-4bfc-956d-39f31bc5bba6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 13:02:31.733730 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:31.733730 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:31.733730 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:31.733730 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:31.733730 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:31.733730 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:31.733730 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:31.733730 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:31.733730 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:31.733730 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:31.733730 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:31.733730 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:02:31.733730 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:02:31.733730 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:02:31.733730 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:02:31.735246 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:02:31.735246 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:02:31.735246 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:02:31.735246 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:02:31.735246 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:31.735246 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:31.735246 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:31.735246 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:31.735246 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:31.735246 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:31.735246 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:31.735246 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:31.735246 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:31.735246 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:31.735246 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:31.735246 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:31.736054 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:31.736054 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:31.736054 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:31.736054 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:31.736054 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:02:31.736054 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:02:31.736054 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:02:31.736054 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:02:31.736054 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:02:31.736054 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:02:31.736054 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 13:02:31.736054 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:02:31.738795 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 176/350] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jun 3 13:02:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:31.744883 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a09d9-8cd2-4bfc-956d-39f31bc5bba6 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:31.761960 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14500e81-93c2-4963-acd8-6c4c175ec943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:31.762566 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14500e81-93c2-4963-acd8-6c4c175ec943 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:31.762846 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14500e81-93c2-4963-acd8-6c4c175ec943 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:31.763119 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14500e81-93c2-4963-acd8-6c4c175ec943 None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:31.763886 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14500e81-93c2-4963-acd8-6c4c175ec943 None admin] RBAC: Adding query filter params (name=member) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:31.764236 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14500e81-93c2-4963-acd8-6c4c175ec943 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:31.765695 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14500e81-93c2-4963-acd8-6c4c175ec943 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:31.776335 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 175/351] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 13:02:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:31.777327 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14500e81-93c2-4963-acd8-6c4c175ec943 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:31.840623 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:31.866812 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a09d9-8cd2-4bfc-956d-39f31bc5bba6 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:31.913828 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14500e81-93c2-4963-acd8-6c4c175ec943 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:31.919095 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a69fd-ec3a-4162-857a-cfce77a764e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:31.919914 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a69fd-ec3a-4162-857a-cfce77a764e6 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:31.920236 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a69fd-ec3a-4162-857a-cfce77a764e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:31.920512 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a69fd-ec3a-4162-857a-cfce77a764e6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:31.935695 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a69fd-ec3a-4162-857a-cfce77a764e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:02:31.939855 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:31.951780 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-746a69fd-ec3a-4162-857a-cfce77a764e6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 13:02:31.951780 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:31.951780 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:31.951780 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:31.951780 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:31.951780 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:31.951780 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:31.951780 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:31.951780 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:31.951780 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:31.951780 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:31.951780 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:31.951780 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:02:31.951780 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:02:31.951780 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:02:31.951780 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:02:31.952713 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:02:31.952713 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:02:31.952713 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:02:31.952713 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:02:31.952713 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:31.952713 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:31.952713 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:31.952713 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:31.952713 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:31.952713 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:31.952713 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:31.952713 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:31.952713 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:31.952713 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:31.952713 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:31.952713 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:31.953543 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:31.953543 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:31.953543 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:31.953543 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:31.953543 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:02:31.953543 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:02:31.953543 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:02:31.953543 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:02:31.953543 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:02:31.953543 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:02:31.953543 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 13:02:31.953543 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:02:31.953543 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 177/352] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jun 3 13:02:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:31.953543 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a69fd-ec3a-4162-857a-cfce77a764e6 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:31.954250 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf841c-e454-43a1-90ed-82ba8e290420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:31.954250 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf841c-e454-43a1-90ed-82ba8e290420 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:31.954250 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf841c-e454-43a1-90ed-82ba8e290420 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:31.954250 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf841c-e454-43a1-90ed-82ba8e290420 None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:31.954508 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf841c-e454-43a1-90ed-82ba8e290420 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:31.954508 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf841c-e454-43a1-90ed-82ba8e290420 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:31.955960 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf841c-e454-43a1-90ed-82ba8e290420 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:31.965326 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 176/353] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:02:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:31.966806 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b78a1e-3a86-4ea1-853f-d7e8500d8310 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:31.967094 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b78a1e-3a86-4ea1-853f-d7e8500d8310 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:31.967367 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b78a1e-3a86-4ea1-853f-d7e8500d8310 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:31.969272 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 177/354] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:31.970036 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b78a1e-3a86-4ea1-853f-d7e8500d8310 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:32.100016 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a69fd-ec3a-4162-857a-cfce77a764e6 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:32.109886 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b78a1e-3a86-4ea1-853f-d7e8500d8310 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:32.141387 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9585c93-f134-45dd-b851-d311d00c34c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:32.142043 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9585c93-f134-45dd-b851-d311d00c34c1 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:32.142328 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9585c93-f134-45dd-b851-d311d00c34c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:32.142603 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9585c93-f134-45dd-b851-d311d00c34c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:32.152913 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:32.154813 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a48135-dddb-4030-88d1-f529adfb7cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:32.155854 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a48135-dddb-4030-88d1-f529adfb7cbe None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:32.156188 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a48135-dddb-4030-88d1-f529adfb7cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:32.156477 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a48135-dddb-4030-88d1-f529adfb7cbe None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:32.157742 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a48135-dddb-4030-88d1-f529adfb7cbe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:32.158331 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a48135-dddb-4030-88d1-f529adfb7cbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:32.159877 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a48135-dddb-4030-88d1-f529adfb7cbe None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:32.171284 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 178/355] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:02:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:32.172887 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a48135-dddb-4030-88d1-f529adfb7cbe None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:32.225838 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9585c93-f134-45dd-b851-d311d00c34c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:32.227331 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9585c93-f134-45dd-b851-d311d00c34c1 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:32.236663 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:32.306917 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a48135-dddb-4030-88d1-f529adfb7cbe None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:32.347022 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970a9ad-33d3-4428-bfd5-3e0505ff39b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:32.347929 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970a9ad-33d3-4428-bfd5-3e0505ff39b4 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:32.348234 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970a9ad-33d3-4428-bfd5-3e0505ff39b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:32.348511 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970a9ad-33d3-4428-bfd5-3e0505ff39b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:32.359332 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 178/356] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:02:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:32.360878 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061f38c-8d30-45d8-80fb-9a7b49c0e63a None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:32.361172 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061f38c-8d30-45d8-80fb-9a7b49c0e63a None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:32.361448 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061f38c-8d30-45d8-80fb-9a7b49c0e63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:32.382785 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-a061f38c-8d30-45d8-80fb-9a7b49c0e63a None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:32.383998 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-a061f38c-8d30-45d8-80fb-9a7b49c0e63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:32.417894 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:32.428353 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0970a9ad-33d3-4428-bfd5-3e0505ff39b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:32.429834 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0970a9ad-33d3-4428-bfd5-3e0505ff39b4 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:32.463661 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 179/357] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:02:32.464557 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a061f38c-8d30-45d8-80fb-9a7b49c0e63a None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:32.487532 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:32.563597 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 179/358] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:02:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:32.564598 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970a9ad-33d3-4428-bfd5-3e0505ff39b4 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:32.600465 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a061f38c-8d30-45d8-80fb-9a7b49c0e63a None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:32.655483 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a12a3-23a2-4bbe-8e97-e93bdcee176e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:32.657553 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a12a3-23a2-4bbe-8e97-e93bdcee176e None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:32.659501 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a12a3-23a2-4bbe-8e97-e93bdcee176e None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:32.659501 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a12a3-23a2-4bbe-8e97-e93bdcee176e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:32.693529 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970a9ad-33d3-4428-bfd5-3e0505ff39b4 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:32.711328 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:32.737900 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9cb4c-a655-43db-b1a0-57d88cd735cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:32.739014 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9cb4c-a655-43db-b1a0-57d88cd735cb None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:32.739478 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9cb4c-a655-43db-b1a0-57d88cd735cb None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:32.739905 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9cb4c-a655-43db-b1a0-57d88cd735cb None admin] PATH_INFO: `/v3/projects/25310838cd094a4aba3f8ea2a06ff3c4` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:32.741676 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae9cb4c-a655-43db-b1a0-57d88cd735cb None admin] RBAC: Authorizing `identity:get_project(project_id=25310838cd094a4aba3f8ea2a06ff3c4)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:32.743117 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae9cb4c-a655-43db-b1a0-57d88cd735cb None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:32.745169 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 180/359] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:02:32 2022] GET /identity/v3/projects/25310838cd094a4aba3f8ea2a06ff3c4 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:32.746451 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbaed35-41aa-4b56-8483-c631b8dab84d None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:32.746730 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbaed35-41aa-4b56-8483-c631b8dab84d None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:32.747001 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbaed35-41aa-4b56-8483-c631b8dab84d None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:32.749383 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 181/360] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:32.750237 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbaed35-41aa-4b56-8483-c631b8dab84d None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:32.757816 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a12a3-23a2-4bbe-8e97-e93bdcee176e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:32.760216 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a12a3-23a2-4bbe-8e97-e93bdcee176e None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:32.772184 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:32.895686 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 180/361] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:02:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:32.896683 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a12a3-23a2-4bbe-8e97-e93bdcee176e None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:32.899185 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbaed35-41aa-4b56-8483-c631b8dab84d None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:32.945709 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6549ab-86ea-4e8f-a888-e1ca4838deb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:32.946520 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6549ab-86ea-4e8f-a888-e1ca4838deb4 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:32.946799 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6549ab-86ea-4e8f-a888-e1ca4838deb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:32.947071 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6549ab-86ea-4e8f-a888-e1ca4838deb4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:32.964029 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6549ab-86ea-4e8f-a888-e1ca4838deb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:02:32.973956 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-8e6549ab-86ea-4e8f-a888-e1ca4838deb4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 13:02:32.973956 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:32.973956 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:32.973956 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:32.973956 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:32.973956 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:32.973956 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:32.973956 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:32.973956 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:32.973956 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:32.973956 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:32.973956 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:32.973956 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:02:32.973956 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:02:32.973956 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:02:32.973956 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:02:32.974910 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:02:32.974910 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:02:32.974910 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:02:32.974910 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:02:32.974910 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:32.974910 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:32.974910 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:32.974910 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:32.974910 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:32.974910 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:32.974910 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:32.974910 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:32.974910 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:32.974910 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:32.974910 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:32.974910 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:32.975709 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:32.975709 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:32.975709 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:32.975709 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:32.975709 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:02:32.975709 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:02:32.975709 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:02:32.975709 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:02:32.975709 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:02:32.975709 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:02:32.975709 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 13:02:32.975709 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:02:32.975709 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 182/362] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:02:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:32.976474 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6549ab-86ea-4e8f-a888-e1ca4838deb4 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:32.988302 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:33.032297 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a12a3-23a2-4bbe-8e97-e93bdcee176e None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:33.075938 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:33.082065 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b463a4e2-f4ab-4e53-93c4-5299346ff7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:33.083380 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463a4e2-f4ab-4e53-93c4-5299346ff7ac None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:33.083871 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463a4e2-f4ab-4e53-93c4-5299346ff7ac None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:33.084164 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463a4e2-f4ab-4e53-93c4-5299346ff7ac None admin] PATH_INFO: `/v3/projects/69bee49150564ea3abbe7a2301dea4d8` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:33.085400 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b463a4e2-f4ab-4e53-93c4-5299346ff7ac None admin] RBAC: Authorizing `identity:get_project(project_id=69bee49150564ea3abbe7a2301dea4d8)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:33.086843 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b463a4e2-f4ab-4e53-93c4-5299346ff7ac None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:33.088881 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 181/363] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:02:32 2022] GET /identity/v3/projects/69bee49150564ea3abbe7a2301dea4d8 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:33.093069 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca941f94-4446-4e63-9c5d-3413f7bc60bc None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:33.094319 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca941f94-4446-4e63-9c5d-3413f7bc60bc None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:33.095021 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca941f94-4446-4e63-9c5d-3413f7bc60bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:33.108346 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6549ab-86ea-4e8f-a888-e1ca4838deb4 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:33.117092 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-ca941f94-4446-4e63-9c5d-3413f7bc60bc None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:33.118338 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-ca941f94-4446-4e63-9c5d-3413f7bc60bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:33.155371 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d76ca1-9fbb-48bd-9ba6-f54728ce89b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:33.157144 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d76ca1-9fbb-48bd-9ba6-f54728ce89b7 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:33.157602 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d76ca1-9fbb-48bd-9ba6-f54728ce89b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:33.158047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d76ca1-9fbb-48bd-9ba6-f54728ce89b7 None admin] PATH_INFO: `/v3/groups/8459835d4cef40c3bf0369753312956b` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:33.159426 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d76ca1-9fbb-48bd-9ba6-f54728ce89b7 None admin] RBAC: Authorizing `identity:get_group(group_id=8459835d4cef40c3bf0369753312956b)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:33.161081 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d76ca1-9fbb-48bd-9ba6-f54728ce89b7 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:33.163176 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 183/364] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Jun 3 13:02:32 2022] GET /identity/v3/groups/8459835d4cef40c3bf0369753312956b => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:33.164117 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d76ca1-9fbb-48bd-9ba6-f54728ce89b7 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:33.207094 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 182/365] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:02:33.207094 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca941f94-4446-4e63-9c5d-3413f7bc60bc None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:33.286203 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:33.302237 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d76ca1-9fbb-48bd-9ba6-f54728ce89b7 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:33.333960 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca941f94-4446-4e63-9c5d-3413f7bc60bc None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:33.344396 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de594e-a5cd-4423-ac4e-1eca6bc71ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:33.345401 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de594e-a5cd-4423-ac4e-1eca6bc71ff2 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:33.346123 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de594e-a5cd-4423-ac4e-1eca6bc71ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:33.346123 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de594e-a5cd-4423-ac4e-1eca6bc71ff2 None admin] PATH_INFO: `/v3/projects/25310838cd094a4aba3f8ea2a06ff3c4` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:33.347663 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de594e-a5cd-4423-ac4e-1eca6bc71ff2 None admin] RBAC: Authorizing `identity:get_project(project_id=25310838cd094a4aba3f8ea2a06ff3c4)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:33.349149 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de594e-a5cd-4423-ac4e-1eca6bc71ff2 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:33.351319 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 184/366] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:02:33 2022] GET /identity/v3/projects/25310838cd094a4aba3f8ea2a06ff3c4 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:33.352099 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de594e-a5cd-4423-ac4e-1eca6bc71ff2 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:33.368974 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:33.383374 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cbfbba-14a8-461c-a63c-c97342da1f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:33.384067 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbfbba-14a8-461c-a63c-c97342da1f4e None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:33.384418 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbfbba-14a8-461c-a63c-c97342da1f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:33.387159 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbfbba-14a8-461c-a63c-c97342da1f4e None admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:33.387159 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cbfbba-14a8-461c-a63c-c97342da1f4e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:33.387159 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cbfbba-14a8-461c-a63c-c97342da1f4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:33.388871 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cbfbba-14a8-461c-a63c-c97342da1f4e None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:33.399382 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 183/367] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 13:02:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:33.399917 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cbfbba-14a8-461c-a63c-c97342da1f4e None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:33.488386 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de594e-a5cd-4423-ac4e-1eca6bc71ff2 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:33.535305 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67667916-c482-4f86-9290-bcc406c4b764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:33.536515 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67667916-c482-4f86-9290-bcc406c4b764 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:33.536967 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67667916-c482-4f86-9290-bcc406c4b764 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:33.537403 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67667916-c482-4f86-9290-bcc406c4b764 None admin] PATH_INFO: `/v3/groups/8459835d4cef40c3bf0369753312956b` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:33.539862 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67667916-c482-4f86-9290-bcc406c4b764 None admin] RBAC: Authorizing `identity:get_group(group_id=8459835d4cef40c3bf0369753312956b)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:33.541523 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67667916-c482-4f86-9290-bcc406c4b764 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:33.543518 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 185/368] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Jun 3 13:02:33 2022] GET /identity/v3/groups/8459835d4cef40c3bf0369753312956b => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:33.544214 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cbfbba-14a8-461c-a63c-c97342da1f4e None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:33.548427 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67667916-c482-4f86-9290-bcc406c4b764 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:33.574191 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:33.582581 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba23f130-7330-4f3d-8f3e-2c84c6eeb02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:33.583319 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23f130-7330-4f3d-8f3e-2c84c6eeb02e None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:33.584819 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23f130-7330-4f3d-8f3e-2c84c6eeb02e None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:33.584819 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23f130-7330-4f3d-8f3e-2c84c6eeb02e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:33.584991 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba23f130-7330-4f3d-8f3e-2c84c6eeb02e None admin] RBAC: Adding query filter params (group.id=8459835d4cef40c3bf0369753312956b, role.id=d082d2b37fd1455ea61819353e8369ed, scope.project.id=25310838cd094a4aba3f8ea2a06ff3c4) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:33.585286 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba23f130-7330-4f3d-8f3e-2c84c6eeb02e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:33.586776 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba23f130-7330-4f3d-8f3e-2c84c6eeb02e None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:33.596706 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 184/369] 10.222.0.61 () {56 vars in 1376 bytes} [Fri Jun 3 13:02:33 2022] GET /identity/v3/role_assignments?group.id=8459835d4cef40c3bf0369753312956b&scope.project.id=25310838cd094a4aba3f8ea2a06ff3c4&role.id=d082d2b37fd1455ea61819353e8369ed => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:33.597917 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba23f130-7330-4f3d-8f3e-2c84c6eeb02e None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:33.668251 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:33.704924 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67667916-c482-4f86-9290-bcc406c4b764 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:33.734022 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba23f130-7330-4f3d-8f3e-2c84c6eeb02e None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:33.755484 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b26fde1-62c1-4b67-ab6a-23630a537f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:33.756621 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26fde1-62c1-4b67-ab6a-23630a537f28 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:33.757278 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26fde1-62c1-4b67-ab6a-23630a537f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:33.757703 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26fde1-62c1-4b67-ab6a-23630a537f28 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:33.774272 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b26fde1-62c1-4b67-ab6a-23630a537f28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:02:33.780844 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93984159-021f-4cb0-b72b-691517a8f701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:33.782522 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93984159-021f-4cb0-b72b-691517a8f701 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:33.782899 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93984159-021f-4cb0-b72b-691517a8f701 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:33.784323 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93984159-021f-4cb0-b72b-691517a8f701 None admin] PATH_INFO: `/v3/groups/8459835d4cef40c3bf0369753312956b` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:33.785374 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-4b26fde1-62c1-4b67-ab6a-23630a537f28 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:02:33.785374 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:33.785374 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:33.785374 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:33.785374 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:33.785374 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:33.785374 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:33.785374 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:33.785374 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:33.785374 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:33.785374 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:33.785374 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:33.785374 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:02:33.785374 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:02:33.785374 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:02:33.785374 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:02:33.786426 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:02:33.786426 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:02:33.786426 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:02:33.786426 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:02:33.786426 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:33.786426 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:33.786426 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:33.786426 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:33.786426 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:33.786426 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:33.786426 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:33.786426 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:33.786426 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:33.786426 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:33.786426 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:33.786426 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:33.787429 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:33.787429 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:33.787429 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:33.787429 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:33.787429 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:02:33.787429 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:02:33.787429 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:02:33.787429 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:02:33.787429 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:02:33.787429 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:02:33.787429 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:02:33.787429 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:02:33.788357 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93984159-021f-4cb0-b72b-691517a8f701 None admin] RBAC: Authorizing `identity:get_group(group_id=8459835d4cef40c3bf0369753312956b)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:33.790051 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93984159-021f-4cb0-b72b-691517a8f701 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:33.790210 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 186/370] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 13:02:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:33.791168 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b26fde1-62c1-4b67-ab6a-23630a537f28 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:33.796212 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 185/371] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Jun 3 13:02:33 2022] GET /identity/v3/groups/8459835d4cef40c3bf0369753312956b => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:33.796212 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93984159-021f-4cb0-b72b-691517a8f701 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:33.873946 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:33.925666 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b26fde1-62c1-4b67-ab6a-23630a537f28 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:33.934883 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93984159-021f-4cb0-b72b-691517a8f701 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:33.969430 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc890a04-552c-4313-9282-1c93994a226f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:33.970555 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc890a04-552c-4313-9282-1c93994a226f None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:33.971243 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc890a04-552c-4313-9282-1c93994a226f None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:33.971591 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc890a04-552c-4313-9282-1c93994a226f None admin] PATH_INFO: `/v3/users/b43110f33971412592068c6eded2f3cd` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:33.973459 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc890a04-552c-4313-9282-1c93994a226f None admin] RBAC: Authorizing `identity:get_user(user_id=b43110f33971412592068c6eded2f3cd)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:33.975177 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc890a04-552c-4313-9282-1c93994a226f None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:33.977772 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 187/372] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 13:02:33 2022] GET /identity/v3/users/b43110f33971412592068c6eded2f3cd => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:33.978702 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc890a04-552c-4313-9282-1c93994a226f None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:33.980637 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be534522-0a1b-4fa0-973f-ec4f2dabaace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:33.981304 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be534522-0a1b-4fa0-973f-ec4f2dabaace None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:33.981813 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be534522-0a1b-4fa0-973f-ec4f2dabaace None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:33.982100 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be534522-0a1b-4fa0-973f-ec4f2dabaace None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:33.983889 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be534522-0a1b-4fa0-973f-ec4f2dabaace None admin] RBAC: Adding query filter params (group.id=8459835d4cef40c3bf0369753312956b, role.id=7476baf91a50401596c34535d2c79a4f, scope.project.id=69bee49150564ea3abbe7a2301dea4d8) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:33.984299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be534522-0a1b-4fa0-973f-ec4f2dabaace None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:33.988452 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:33.992882 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be534522-0a1b-4fa0-973f-ec4f2dabaace None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:34.004351 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 186/373] 10.222.0.61 () {56 vars in 1376 bytes} [Fri Jun 3 13:02:33 2022] GET /identity/v3/role_assignments?group.id=8459835d4cef40c3bf0369753312956b&scope.project.id=69bee49150564ea3abbe7a2301dea4d8&role.id=7476baf91a50401596c34535d2c79a4f => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:34.005289 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be534522-0a1b-4fa0-973f-ec4f2dabaace None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:34.120200 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc890a04-552c-4313-9282-1c93994a226f None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:34.133779 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be534522-0a1b-4fa0-973f-ec4f2dabaace None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:34.162753 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b362222-d243-4e62-9a72-036e14dd9ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:34.163377 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b362222-d243-4e62-9a72-036e14dd9ea2 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:34.163688 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b362222-d243-4e62-9a72-036e14dd9ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:34.163965 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b362222-d243-4e62-9a72-036e14dd9ea2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:34.164883 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:34.165913 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b362222-d243-4e62-9a72-036e14dd9ea2 None admin] RBAC: Adding query filter params (group.id=8459835d4cef40c3bf0369753312956b, role.id=7476baf91a50401596c34535d2c79a4f, scope.project.id=25310838cd094a4aba3f8ea2a06ff3c4) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:34.166306 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b362222-d243-4e62-9a72-036e14dd9ea2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:34.167795 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b362222-d243-4e62-9a72-036e14dd9ea2 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:34.174899 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 188/374] 10.222.0.61 () {56 vars in 1376 bytes} [Fri Jun 3 13:02:33 2022] GET /identity/v3/role_assignments?group.id=8459835d4cef40c3bf0369753312956b&scope.project.id=25310838cd094a4aba3f8ea2a06ff3c4&role.id=7476baf91a50401596c34535d2c79a4f => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:34.175859 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b362222-d243-4e62-9a72-036e14dd9ea2 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:34.177846 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece97b39-2662-4729-aa49-b06d80f7f5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:34.178892 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece97b39-2662-4729-aa49-b06d80f7f5b1 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:34.179446 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece97b39-2662-4729-aa49-b06d80f7f5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:34.179914 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece97b39-2662-4729-aa49-b06d80f7f5b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:34.180989 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece97b39-2662-4729-aa49-b06d80f7f5b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:34.181539 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece97b39-2662-4729-aa49-b06d80f7f5b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:34.183249 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece97b39-2662-4729-aa49-b06d80f7f5b1 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:34.194738 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 187/375] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:02:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:34.196609 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5d983-966d-47f4-b886-c7e7841dc947 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:34.197210 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5d983-966d-47f4-b886-c7e7841dc947 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:34.197821 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5d983-966d-47f4-b886-c7e7841dc947 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:34.199736 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 188/376] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:34.200794 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5d983-966d-47f4-b886-c7e7841dc947 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:34.269613 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:34.308671 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b362222-d243-4e62-9a72-036e14dd9ea2 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:34.323904 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5d983-966d-47f4-b886-c7e7841dc947 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:34.365878 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b564414-e0f2-45d9-9204-2c6e5e06ed30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:34.366930 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b564414-e0f2-45d9-9204-2c6e5e06ed30 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:34.367431 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b564414-e0f2-45d9-9204-2c6e5e06ed30 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:34.367898 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b564414-e0f2-45d9-9204-2c6e5e06ed30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:34.385597 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8b7a8-8d2d-4eba-b45e-9919da746bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:34.386175 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8b7a8-8d2d-4eba-b45e-9919da746bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:34.386455 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8b7a8-8d2d-4eba-b45e-9919da746bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:34.386728 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8b7a8-8d2d-4eba-b45e-9919da746bd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:34.387563 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8b7a8-8d2d-4eba-b45e-9919da746bd0 None admin] RBAC: Adding query filter params (role.id=f3c7872a0874484085c534eb05e404eb, user.id=b43110f33971412592068c6eded2f3cd, scope.system=all) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:34.387871 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8b7a8-8d2d-4eba-b45e-9919da746bd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:34.389328 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8b7a8-8d2d-4eba-b45e-9919da746bd0 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:34.423792 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 189/377] 10.222.0.61 () {56 vars in 1308 bytes} [Fri Jun 3 13:02:34 2022] GET /identity/v3/role_assignments?user.id=b43110f33971412592068c6eded2f3cd&scope.system=all&role.id=f3c7872a0874484085c534eb05e404eb => generated 510 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:34.424954 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20b86a-a660-496c-8f12-77cf1c6d3b2e None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:34.425239 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20b86a-a660-496c-8f12-77cf1c6d3b2e None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:34.425514 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20b86a-a660-496c-8f12-77cf1c6d3b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:34.435684 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:34.449896 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b564414-e0f2-45d9-9204-2c6e5e06ed30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:34.451881 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b564414-e0f2-45d9-9204-2c6e5e06ed30 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:34.465570 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-ea20b86a-a660-496c-8f12-77cf1c6d3b2e None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:34.466520 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-ea20b86a-a660-496c-8f12-77cf1c6d3b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:34.613784 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 189/378] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:02:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:34.618832 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 190/379] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:02:34.621285 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b564414-e0f2-45d9-9204-2c6e5e06ed30 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:34.660180 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20b86a-a660-496c-8f12-77cf1c6d3b2e None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:34.748786 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:34.767385 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:34.792171 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b564414-e0f2-45d9-9204-2c6e5e06ed30 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:34.818791 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20b86a-a660-496c-8f12-77cf1c6d3b2e None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:34.834039 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d8c99-bd70-424d-9407-3b12b5751bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:34.834932 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d8c99-bd70-424d-9407-3b12b5751bf1 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:34.835212 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d8c99-bd70-424d-9407-3b12b5751bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:34.835486 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d8c99-bd70-424d-9407-3b12b5751bf1 None admin] PATH_INFO: `/v3/projects/ade16b49bacd4a0789895b9341a45a4d` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:34.836723 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d8c99-bd70-424d-9407-3b12b5751bf1 None admin] RBAC: Authorizing `identity:get_project(project_id=ade16b49bacd4a0789895b9341a45a4d)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:34.838366 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d8c99-bd70-424d-9407-3b12b5751bf1 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:34.840856 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 190/380] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:02:34 2022] GET /identity/v3/projects/ade16b49bacd4a0789895b9341a45a4d => generated 344 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:34.849214 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d8c99-bd70-424d-9407-3b12b5751bf1 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:34.879620 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238040c5-2dc6-4e95-bfce-f744e5abe9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:34.880893 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238040c5-2dc6-4e95-bfce-f744e5abe9f2 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:34.881421 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238040c5-2dc6-4e95-bfce-f744e5abe9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:34.881941 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238040c5-2dc6-4e95-bfce-f744e5abe9f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:34.902588 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238040c5-2dc6-4e95-bfce-f744e5abe9f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:02:34.916078 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-238040c5-2dc6-4e95-bfce-f744e5abe9f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 13:02:34.916078 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:34.916078 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:34.916078 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:34.916078 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:34.916078 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:34.916078 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:34.916078 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:34.916078 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:34.916078 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:34.916078 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:34.916078 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:34.916078 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:02:34.916078 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:02:34.916078 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:02:34.916078 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:02:34.917047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:02:34.917047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:02:34.917047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:02:34.917047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:02:34.917047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:34.917047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:34.917047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:34.917047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:34.917047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:34.917047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:34.917047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:34.917047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:34.917047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:34.917047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:34.917047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:34.917047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:34.917844 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:34.917844 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:34.917844 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:34.917844 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:34.917844 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:02:34.917844 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:02:34.917844 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:02:34.917844 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:02:34.917844 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:02:34.917844 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:02:34.917844 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 13:02:34.917844 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:02:34.920980 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 191/381] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:02:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:02:34.927487 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238040c5-2dc6-4e95-bfce-f744e5abe9f2 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:34.973403 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d8c99-bd70-424d-9407-3b12b5751bf1 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:35.063199 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238040c5-2dc6-4e95-bfce-f744e5abe9f2 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:35.100044 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d73f0-3099-4ce2-9133-ff3cab87956b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:35.101593 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d73f0-3099-4ce2-9133-ff3cab87956b None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:35.101879 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d73f0-3099-4ce2-9133-ff3cab87956b None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:35.102152 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d73f0-3099-4ce2-9133-ff3cab87956b None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:35.102897 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772d73f0-3099-4ce2-9133-ff3cab87956b None admin] RBAC: Adding query filter params (name=member) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:35.103199 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772d73f0-3099-4ce2-9133-ff3cab87956b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:35.104606 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772d73f0-3099-4ce2-9133-ff3cab87956b None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:35.112570 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:35.114785 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 192/382] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 13:02:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:02:35.116236 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff391b21-fadd-404b-807d-46ad57263cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:35.117115 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff391b21-fadd-404b-807d-46ad57263cee None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:35.117397 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff391b21-fadd-404b-807d-46ad57263cee None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:35.117671 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff391b21-fadd-404b-807d-46ad57263cee None admin] PATH_INFO: `/v3/groups/30d7fc392109474b9478ddd1997b1149` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:35.120285 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d73f0-3099-4ce2-9133-ff3cab87956b None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:35.137553 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff391b21-fadd-404b-807d-46ad57263cee None admin] RBAC: Authorizing `identity:get_group(group_id=30d7fc392109474b9478ddd1997b1149)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:35.139024 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff391b21-fadd-404b-807d-46ad57263cee None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:35.145347 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 191/383] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Jun 3 13:02:34 2022] GET /identity/v3/groups/30d7fc392109474b9478ddd1997b1149 => generated 229 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:35.151224 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff391b21-fadd-404b-807d-46ad57263cee None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:35.208653 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:35.232754 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d73f0-3099-4ce2-9133-ff3cab87956b None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:35.270097 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea7ecc-7dd9-4603-a124-1d8e73f0f47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:35.271580 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea7ecc-7dd9-4603-a124-1d8e73f0f47f None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:35.272078 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea7ecc-7dd9-4603-a124-1d8e73f0f47f None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:35.272401 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea7ecc-7dd9-4603-a124-1d8e73f0f47f None admin] PATH_INFO: `/v3/groups/8459835d4cef40c3bf0369753312956b` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:35.275867 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea7ecc-7dd9-4603-a124-1d8e73f0f47f None admin] RBAC: Authorizing `identity:get_group(group_id=8459835d4cef40c3bf0369753312956b)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:35.277362 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea7ecc-7dd9-4603-a124-1d8e73f0f47f None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:35.279301 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 193/384] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Jun 3 13:02:35 2022] GET /identity/v3/groups/8459835d4cef40c3bf0369753312956b => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:02:35.287645 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea7ecc-7dd9-4603-a124-1d8e73f0f47f None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:35.348631 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff391b21-fadd-404b-807d-46ad57263cee None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:35.379032 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:35.420980 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db49f4-ae7f-4e49-b0e1-c31b5e02306f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:35.423460 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db49f4-ae7f-4e49-b0e1-c31b5e02306f None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:35.423747 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db49f4-ae7f-4e49-b0e1-c31b5e02306f None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:35.424026 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db49f4-ae7f-4e49-b0e1-c31b5e02306f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:35.424899 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db49f4-ae7f-4e49-b0e1-c31b5e02306f None admin] RBAC: Adding query filter params (group.id=30d7fc392109474b9478ddd1997b1149, role.id=bbd5f3e0c18e4992886fcfb4a3feb426, scope.project.id=ade16b49bacd4a0789895b9341a45a4d) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:35.425212 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db49f4-ae7f-4e49-b0e1-c31b5e02306f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:35.426670 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db49f4-ae7f-4e49-b0e1-c31b5e02306f None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:35.442546 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 192/385] 10.222.0.61 () {56 vars in 1376 bytes} [Fri Jun 3 13:02:35 2022] GET /identity/v3/role_assignments?group.id=30d7fc392109474b9478ddd1997b1149&scope.project.id=ade16b49bacd4a0789895b9341a45a4d&role.id=bbd5f3e0c18e4992886fcfb4a3feb426 => generated 260 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:02:35.465128 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea7ecc-7dd9-4603-a124-1d8e73f0f47f None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:35.503747 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0ecb4-de36-4604-a3f8-d8a28d201b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:35.504658 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0ecb4-de36-4604-a3f8-d8a28d201b7f None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:35.504943 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0ecb4-de36-4604-a3f8-d8a28d201b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:35.505219 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0ecb4-de36-4604-a3f8-d8a28d201b7f None admin] PATH_INFO: `/v3/projects/69bee49150564ea3abbe7a2301dea4d8` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:35.506437 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb0ecb4-de36-4604-a3f8-d8a28d201b7f None admin] RBAC: Authorizing `identity:get_project(project_id=69bee49150564ea3abbe7a2301dea4d8)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:35.507877 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb0ecb4-de36-4604-a3f8-d8a28d201b7f None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:35.510130 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 194/386] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:02:35 2022] GET /identity/v3/projects/69bee49150564ea3abbe7a2301dea4d8 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:02:35.515473 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db49f4-ae7f-4e49-b0e1-c31b5e02306f None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:35.616248 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:35.637612 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db49f4-ae7f-4e49-b0e1-c31b5e02306f None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:35.675664 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe77aa2-9dfb-40d7-9182-ef7dbc9e05aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:35.676597 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe77aa2-9dfb-40d7-9182-ef7dbc9e05aa None admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:35.676885 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe77aa2-9dfb-40d7-9182-ef7dbc9e05aa None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:35.677161 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe77aa2-9dfb-40d7-9182-ef7dbc9e05aa None admin] PATH_INFO: `/v3/projects/69bee49150564ea3abbe7a2301dea4d8/groups/8459835d4cef40c3bf0369753312956b/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:35.679248 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe77aa2-9dfb-40d7-9182-ef7dbc9e05aa None admin] RBAC: Authorizing `identity:create_grant(project_id=69bee49150564ea3abbe7a2301dea4d8, group_id=8459835d4cef40c3bf0369753312956b, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:35.680765 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe77aa2-9dfb-40d7-9182-ef7dbc9e05aa None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:35.770661 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 193/387] 10.222.0.61 () {58 vars in 1442 bytes} [Fri Jun 3 13:02:35 2022] PUT /identity/v3/projects/69bee49150564ea3abbe7a2301dea4d8/groups/8459835d4cef40c3bf0369753312956b/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:36.628293 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36a55b-f2c4-4b5c-bbcf-a07caf7edda8 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:36.628838 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36a55b-f2c4-4b5c-bbcf-a07caf7edda8 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:36.628838 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36a55b-f2c4-4b5c-bbcf-a07caf7edda8 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:36.630320 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 195/388] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:36.636279 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154a307-c20f-4a73-9e8d-eb6db56a862f None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:36.637222 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154a307-c20f-4a73-9e8d-eb6db56a862f None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:36.637701 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154a307-c20f-4a73-9e8d-eb6db56a862f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:36.655980 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-1154a307-c20f-4a73-9e8d-eb6db56a862f None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:36.658074 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-1154a307-c20f-4a73-9e8d-eb6db56a862f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:36.728337 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 194/389] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:02:36.753255 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36a55b-f2c4-4b5c-bbcf-a07caf7edda8 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:36.889799 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36a55b-f2c4-4b5c-bbcf-a07caf7edda8 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:36.915990 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:36.940882 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be79ca-b53a-4c1b-842c-e92f478229a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:36.941713 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be79ca-b53a-4c1b-842c-e92f478229a1 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:36.942044 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be79ca-b53a-4c1b-842c-e92f478229a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:36.942227 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be79ca-b53a-4c1b-842c-e92f478229a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:36.958860 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be79ca-b53a-4c1b-842c-e92f478229a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:02:36.973156 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-37be79ca-b53a-4c1b-842c-e92f478229a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 13:02:36.973156 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:36.973156 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:36.973156 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:36.973156 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:36.973156 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:36.973156 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:36.973156 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:36.973156 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:36.973156 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:36.973156 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:36.973156 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:36.973156 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:02:36.973156 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:02:36.973156 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:02:36.973156 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:02:36.974085 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:02:36.974085 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:02:36.974085 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:02:36.974085 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:02:36.974085 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:36.974085 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:36.974085 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:36.974085 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:36.974085 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:36.974085 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:36.974085 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:36.974085 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:36.974085 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:36.974085 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:36.974085 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:36.974085 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:36.974959 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:36.974959 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:36.974959 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:36.974959 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:36.974959 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:02:36.974959 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:02:36.974959 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:02:36.974959 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:02:36.974959 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:02:36.974959 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:02:36.974959 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 13:02:36.974959 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:02:36.974959 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 196/390] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:02:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:36.981829 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154a307-c20f-4a73-9e8d-eb6db56a862f None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:37.103667 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49a3a6-5c6e-469a-917e-5676b3915491 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:37.104002 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49a3a6-5c6e-469a-917e-5676b3915491 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:37.104298 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49a3a6-5c6e-469a-917e-5676b3915491 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:37.105708 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 197/391] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:37.112619 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb142f-4f22-496b-8c3e-61ce8708a5c0 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:37.112952 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb142f-4f22-496b-8c3e-61ce8708a5c0 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:37.113198 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb142f-4f22-496b-8c3e-61ce8708a5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:37.136517 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-17fb142f-4f22-496b-8c3e-61ce8708a5c0 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:37.138117 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-17fb142f-4f22-496b-8c3e-61ce8708a5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:37.215905 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 198/392] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:02:37.233331 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:37.243978 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb142f-4f22-496b-8c3e-61ce8708a5c0 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:37.307714 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154a307-c20f-4a73-9e8d-eb6db56a862f None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:37.361891 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb142f-4f22-496b-8c3e-61ce8708a5c0 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:37.370408 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:37.393831 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcab36c-f06c-4cac-9829-95866d314340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:37.394519 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcab36c-f06c-4cac-9829-95866d314340 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:37.394799 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcab36c-f06c-4cac-9829-95866d314340 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:37.395075 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcab36c-f06c-4cac-9829-95866d314340 None admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:37.395993 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcab36c-f06c-4cac-9829-95866d314340 None admin] RBAC: Adding query filter params (name=member) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:37.396169 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcab36c-f06c-4cac-9829-95866d314340 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:37.397597 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcab36c-f06c-4cac-9829-95866d314340 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:37.405800 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff1232d-48f9-4844-89a6-148b70a9d1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:37.407465 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1232d-48f9-4844-89a6-148b70a9d1cf None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:37.407897 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1232d-48f9-4844-89a6-148b70a9d1cf None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:37.408374 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1232d-48f9-4844-89a6-148b70a9d1cf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:37.418219 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 195/393] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 13:02:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 437 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:37.426297 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcab36c-f06c-4cac-9829-95866d314340 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:37.442949 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff1232d-48f9-4844-89a6-148b70a9d1cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:02:37.457158 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-5ff1232d-48f9-4844-89a6-148b70a9d1cf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 13:02:37.457158 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:37.457158 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:37.457158 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:37.457158 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:37.457158 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:37.457158 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:37.457158 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:37.457158 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:37.457158 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:37.457158 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:37.457158 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:37.457158 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:02:37.457158 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:02:37.457158 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:02:37.457158 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:02:37.458283 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:02:37.458283 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:02:37.458283 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:02:37.458283 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:02:37.458283 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:37.458283 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:37.458283 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:37.458283 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:37.458283 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:37.458283 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:37.458283 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:37.458283 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:37.458283 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:37.458283 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:37.458283 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:37.458283 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:37.459294 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:37.459294 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:37.459294 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:37.459294 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:37.459294 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:02:37.459294 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:02:37.459294 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:02:37.459294 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:02:37.459294 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:02:37.459294 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:02:37.459294 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 13:02:37.459294 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:02:37.464420 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 199/394] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jun 3 13:02:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:02:37.471373 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff1232d-48f9-4844-89a6-148b70a9d1cf None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:37.600665 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff1232d-48f9-4844-89a6-148b70a9d1cf None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:37.630493 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcab36c-f06c-4cac-9829-95866d314340 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:37.640057 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e3313-459f-47a3-8465-5ff973d125ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:37.642035 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e3313-459f-47a3-8465-5ff973d125ea None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:37.642474 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e3313-459f-47a3-8465-5ff973d125ea None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:37.642898 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e3313-459f-47a3-8465-5ff973d125ea None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:37.643821 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9e3313-459f-47a3-8465-5ff973d125ea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:37.644310 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9e3313-459f-47a3-8465-5ff973d125ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:37.645844 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9e3313-459f-47a3-8465-5ff973d125ea None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:37.655116 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 200/395] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:02:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:37.657343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2df2f-a737-4a5e-b135-33553dfa3c7c None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:37.657886 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2df2f-a737-4a5e-b135-33553dfa3c7c None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:37.658367 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2df2f-a737-4a5e-b135-33553dfa3c7c None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:37.659862 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 201/396] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:37.667276 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2df2f-a737-4a5e-b135-33553dfa3c7c None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:37.673062 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9526e-9018-4772-b121-32f0ef438233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:37.673933 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9526e-9018-4772-b121-32f0ef438233 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:37.674211 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9526e-9018-4772-b121-32f0ef438233 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:37.674483 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9526e-9018-4772-b121-32f0ef438233 None admin] PATH_INFO: `/v3/groups/8459835d4cef40c3bf0369753312956b` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:37.676273 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c9526e-9018-4772-b121-32f0ef438233 None admin] RBAC: Authorizing `identity:get_group(group_id=8459835d4cef40c3bf0369753312956b)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:37.678157 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c9526e-9018-4772-b121-32f0ef438233 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:37.680794 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 196/397] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Jun 3 13:02:37 2022] GET /identity/v3/groups/8459835d4cef40c3bf0369753312956b => generated 226 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:02:37.682318 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ce558-5372-467b-9b2b-7b870406e22c None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:37.682607 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ce558-5372-467b-9b2b-7b870406e22c None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:37.682923 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ce558-5372-467b-9b2b-7b870406e22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:37.701276 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:37.706333 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-c89ce558-5372-467b-9b2b-7b870406e22c None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:37.707707 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-c89ce558-5372-467b-9b2b-7b870406e22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:37.711871 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:37.782054 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2df2f-a737-4a5e-b135-33553dfa3c7c None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:37.798476 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 197/398] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:02:37.799277 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ce558-5372-467b-9b2b-7b870406e22c None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:37.840946 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac6c51-14b9-4918-8c9c-6b966291ea62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:37.841995 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac6c51-14b9-4918-8c9c-6b966291ea62 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:37.842354 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac6c51-14b9-4918-8c9c-6b966291ea62 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:37.842699 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac6c51-14b9-4918-8c9c-6b966291ea62 None admin] PATH_INFO: `/v3/groups/8459835d4cef40c3bf0369753312956b` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:37.844768 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac6c51-14b9-4918-8c9c-6b966291ea62 None admin] RBAC: Authorizing `identity:get_group(group_id=8459835d4cef40c3bf0369753312956b)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:37.846339 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac6c51-14b9-4918-8c9c-6b966291ea62 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:37.848810 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 202/399] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Jun 3 13:02:37 2022] GET /identity/v3/groups/8459835d4cef40c3bf0369753312956b => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:37.849767 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac6c51-14b9-4918-8c9c-6b966291ea62 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:37.919572 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ce558-5372-467b-9b2b-7b870406e22c None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:37.960709 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:37.964214 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:37.966721 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac6c51-14b9-4918-8c9c-6b966291ea62 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:37.971241 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a5885-4e84-41b8-bcbc-b58e24280a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:37.972589 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a5885-4e84-41b8-bcbc-b58e24280a7d None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:37.973021 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a5885-4e84-41b8-bcbc-b58e24280a7d None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:37.973466 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a5885-4e84-41b8-bcbc-b58e24280a7d None admin] PATH_INFO: `/v3/projects/25310838cd094a4aba3f8ea2a06ff3c4` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:37.975208 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a5885-4e84-41b8-bcbc-b58e24280a7d None admin] RBAC: Authorizing `identity:get_project(project_id=25310838cd094a4aba3f8ea2a06ff3c4)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:37.976990 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a5885-4e84-41b8-bcbc-b58e24280a7d None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:37.978702 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 198/400] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:02:37 2022] GET /identity/v3/projects/25310838cd094a4aba3f8ea2a06ff3c4 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:37.979460 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a5885-4e84-41b8-bcbc-b58e24280a7d None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:38.019294 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b106ed-f1fa-4517-9c2b-a7bd43d8d737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:38.020098 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b106ed-f1fa-4517-9c2b-a7bd43d8d737 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:38.020617 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b106ed-f1fa-4517-9c2b-a7bd43d8d737 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:38.020735 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b106ed-f1fa-4517-9c2b-a7bd43d8d737 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:38.032024 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b106ed-f1fa-4517-9c2b-a7bd43d8d737 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:02:38.040448 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-c1b106ed-f1fa-4517-9c2b-a7bd43d8d737 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 13:02:38.040448 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:38.040448 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:38.040448 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:38.040448 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:38.040448 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:38.040448 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:38.040448 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:38.040448 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:38.040448 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:38.040448 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:38.040448 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:38.040448 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:02:38.040448 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:02:38.040448 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:02:38.040448 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:02:38.041531 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:02:38.041531 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:02:38.041531 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:02:38.041531 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:02:38.041531 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:38.041531 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:38.041531 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:38.041531 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:38.041531 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:38.041531 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:38.041531 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:38.041531 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:38.041531 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:38.041531 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:38.041531 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:38.041531 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:38.042533 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:38.042533 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:38.042533 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:38.042533 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:38.042533 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:02:38.042533 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:02:38.042533 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:02:38.042533 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:02:38.042533 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:02:38.042533 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:02:38.042533 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 13:02:38.042533 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:02:38.042533 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 203/401] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jun 3 13:02:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:38.043616 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b106ed-f1fa-4517-9c2b-a7bd43d8d737 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:38.119031 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a5885-4e84-41b8-bcbc-b58e24280a7d None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:38.149499 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b106ed-f1fa-4517-9c2b-a7bd43d8d737 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:38.164695 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c8abe-91e0-45d0-99c1-f0f9a040a2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:38.166078 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c8abe-91e0-45d0-99c1-f0f9a040a2f6 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:38.166699 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c8abe-91e0-45d0-99c1-f0f9a040a2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:38.167185 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c8abe-91e0-45d0-99c1-f0f9a040a2f6 None admin] PATH_INFO: `/v3/projects/69bee49150564ea3abbe7a2301dea4d8` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:38.168847 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6c8abe-91e0-45d0-99c1-f0f9a040a2f6 None admin] RBAC: Authorizing `identity:get_project(project_id=69bee49150564ea3abbe7a2301dea4d8)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:38.170465 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6c8abe-91e0-45d0-99c1-f0f9a040a2f6 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:38.174954 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 199/402] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:02:37 2022] GET /identity/v3/projects/69bee49150564ea3abbe7a2301dea4d8 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:38.178847 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c8abe-91e0-45d0-99c1-f0f9a040a2f6 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:38.189043 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c01f5-45f5-4628-adb9-0fab1b7337e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:38.189941 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c01f5-45f5-4628-adb9-0fab1b7337e1 None admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:38.190228 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c01f5-45f5-4628-adb9-0fab1b7337e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:38.190874 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c01f5-45f5-4628-adb9-0fab1b7337e1 None admin] PATH_INFO: `/v3/projects/25310838cd094a4aba3f8ea2a06ff3c4/groups/8459835d4cef40c3bf0369753312956b/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:38.193253 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c01f5-45f5-4628-adb9-0fab1b7337e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=25310838cd094a4aba3f8ea2a06ff3c4, group_id=8459835d4cef40c3bf0369753312956b, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:38.194702 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c01f5-45f5-4628-adb9-0fab1b7337e1 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:38.248065 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:38.281912 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 204/403] 10.222.0.61 () {58 vars in 1442 bytes} [Fri Jun 3 13:02:38 2022] PUT /identity/v3/projects/25310838cd094a4aba3f8ea2a06ff3c4/groups/8459835d4cef40c3bf0369753312956b/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:38.281912 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c63a2e-2f91-4410-a991-b39c78b62d1c None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:38.281912 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c63a2e-2f91-4410-a991-b39c78b62d1c None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:38.281912 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c63a2e-2f91-4410-a991-b39c78b62d1c None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:38.282325 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c8abe-91e0-45d0-99c1-f0f9a040a2f6 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:38.284341 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 205/404] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:38.286535 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c63a2e-2f91-4410-a991-b39c78b62d1c None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:38.323921 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d0ebe5-8d2c-4172-909c-a4958ec572d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:38.324593 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0ebe5-8d2c-4172-909c-a4958ec572d3 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:38.324928 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0ebe5-8d2c-4172-909c-a4958ec572d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:38.325212 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:38.325337 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0ebe5-8d2c-4172-909c-a4958ec572d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:38.325988 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d0ebe5-8d2c-4172-909c-a4958ec572d3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:38.326391 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d0ebe5-8d2c-4172-909c-a4958ec572d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:38.328479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d0ebe5-8d2c-4172-909c-a4958ec572d3 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:38.342557 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 200/405] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:02:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:38.342557 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c53e4-887f-4355-b6e0-5f5f1cc92db1 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:38.342557 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c53e4-887f-4355-b6e0-5f5f1cc92db1 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:38.342557 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c53e4-887f-4355-b6e0-5f5f1cc92db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:38.361468 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-304c53e4-887f-4355-b6e0-5f5f1cc92db1 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:38.362740 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-304c53e4-887f-4355-b6e0-5f5f1cc92db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:38.456559 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 201/406] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:02:38.456559 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c53e4-887f-4355-b6e0-5f5f1cc92db1 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:38.463061 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c63a2e-2f91-4410-a991-b39c78b62d1c None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:38.526124 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24c08f-bd7e-4157-b005-a4b560aef7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:38.527745 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24c08f-bd7e-4157-b005-a4b560aef7d6 None admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:38.528279 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24c08f-bd7e-4157-b005-a4b560aef7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:38.528817 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24c08f-bd7e-4157-b005-a4b560aef7d6 None admin] PATH_INFO: `/v3/projects/69bee49150564ea3abbe7a2301dea4d8/groups/8459835d4cef40c3bf0369753312956b/roles/7476baf91a50401596c34535d2c79a4f` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:38.532862 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c24c08f-bd7e-4157-b005-a4b560aef7d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=69bee49150564ea3abbe7a2301dea4d8, group_id=8459835d4cef40c3bf0369753312956b, role_id=7476baf91a50401596c34535d2c79a4f)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:38.535160 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c24c08f-bd7e-4157-b005-a4b560aef7d6 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:38.538188 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:38.581431 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c53e4-887f-4355-b6e0-5f5f1cc92db1 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:38.617310 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd4c29-5398-49c6-a271-c25ec005572a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:38.618170 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd4c29-5398-49c6-a271-c25ec005572a None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:38.618738 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd4c29-5398-49c6-a271-c25ec005572a None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:38.618738 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd4c29-5398-49c6-a271-c25ec005572a None admin] PATH_INFO: `/v3/groups/8459835d4cef40c3bf0369753312956b` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:38.619917 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd4c29-5398-49c6-a271-c25ec005572a None admin] RBAC: Authorizing `identity:get_group(group_id=8459835d4cef40c3bf0369753312956b)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:38.621377 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd4c29-5398-49c6-a271-c25ec005572a None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:38.627006 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 202/407] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Jun 3 13:02:38 2022] GET /identity/v3/groups/8459835d4cef40c3bf0369753312956b => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:38.627006 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd4c29-5398-49c6-a271-c25ec005572a None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:38.653442 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 206/408] 10.222.0.61 () {58 vars in 1442 bytes} [Fri Jun 3 13:02:38 2022] PUT /identity/v3/projects/69bee49150564ea3abbe7a2301dea4d8/groups/8459835d4cef40c3bf0369753312956b/roles/7476baf91a50401596c34535d2c79a4f => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:38.659518 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24c08f-bd7e-4157-b005-a4b560aef7d6 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:38.799420 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd4c29-5398-49c6-a271-c25ec005572a None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:38.803354 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:38.835597 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:38.837208 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24c08f-bd7e-4157-b005-a4b560aef7d6 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:38.844272 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04a08b-ebb8-4111-9b7e-95023f12197b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:38.845204 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04a08b-ebb8-4111-9b7e-95023f12197b None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:38.845482 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04a08b-ebb8-4111-9b7e-95023f12197b None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:38.845752 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04a08b-ebb8-4111-9b7e-95023f12197b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:38.858798 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c04a08b-ebb8-4111-9b7e-95023f12197b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:02:38.867519 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-0c04a08b-ebb8-4111-9b7e-95023f12197b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:02:38.867519 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:38.867519 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:38.867519 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:38.867519 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:38.867519 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:38.867519 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:38.867519 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:38.867519 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:38.867519 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:38.867519 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:38.867519 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:38.867519 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:02:38.867519 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:02:38.867519 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:02:38.867519 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:02:38.868525 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:02:38.868525 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:02:38.868525 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:02:38.868525 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:02:38.868525 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:38.868525 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:38.868525 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:38.868525 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:38.868525 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:38.868525 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:38.868525 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:38.868525 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:38.868525 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:38.868525 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:38.868525 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:38.868525 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:38.869399 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:38.869399 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:38.869399 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:38.869399 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:38.869399 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:02:38.869399 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:02:38.869399 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:02:38.869399 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:02:38.869399 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:02:38.869399 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:02:38.869399 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:02:38.869399 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:02:38.869399 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 203/409] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 13:02:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:38.870049 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8bd0ee-5618-4091-94a7-7f3c1227deb4 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:38.870878 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8bd0ee-5618-4091-94a7-7f3c1227deb4 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:38.870878 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8bd0ee-5618-4091-94a7-7f3c1227deb4 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:38.872302 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 204/410] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:38.877175 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3352f-4221-4ca2-97c2-ffe3a98bbe48 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:38.877666 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3352f-4221-4ca2-97c2-ffe3a98bbe48 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:38.878145 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3352f-4221-4ca2-97c2-ffe3a98bbe48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:38.881893 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06496bc0-667a-40f8-9569-fa8ea577380d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:38.882769 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06496bc0-667a-40f8-9569-fa8ea577380d None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:38.883050 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06496bc0-667a-40f8-9569-fa8ea577380d None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:38.883324 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06496bc0-667a-40f8-9569-fa8ea577380d None admin] PATH_INFO: `/v3/projects/25310838cd094a4aba3f8ea2a06ff3c4` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:38.884644 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06496bc0-667a-40f8-9569-fa8ea577380d None admin] RBAC: Authorizing `identity:get_project(project_id=25310838cd094a4aba3f8ea2a06ff3c4)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:38.886677 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06496bc0-667a-40f8-9569-fa8ea577380d None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:38.888290 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 207/411] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:02:38 2022] GET /identity/v3/projects/25310838cd094a4aba3f8ea2a06ff3c4 => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:38.889164 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06496bc0-667a-40f8-9569-fa8ea577380d None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:38.898975 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-37f3352f-4221-4ca2-97c2-ffe3a98bbe48 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:38.906665 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-37f3352f-4221-4ca2-97c2-ffe3a98bbe48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:38.985097 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 205/412] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:02:38.985999 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3352f-4221-4ca2-97c2-ffe3a98bbe48 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:39.030550 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06496bc0-667a-40f8-9569-fa8ea577380d None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:39.077294 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82f536-50ed-4043-a0a2-fecdd5a32ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:39.078971 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82f536-50ed-4043-a0a2-fecdd5a32ffe None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:39.079529 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82f536-50ed-4043-a0a2-fecdd5a32ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:39.079811 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82f536-50ed-4043-a0a2-fecdd5a32ffe None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:39.080601 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce82f536-50ed-4043-a0a2-fecdd5a32ffe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:39.080906 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce82f536-50ed-4043-a0a2-fecdd5a32ffe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:39.082538 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce82f536-50ed-4043-a0a2-fecdd5a32ffe None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:39.094685 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 208/413] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:02:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:39.095916 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82f536-50ed-4043-a0a2-fecdd5a32ffe None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:39.111808 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:39.129202 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3352f-4221-4ca2-97c2-ffe3a98bbe48 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:39.153566 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:39.179841 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12571565-16d6-46a7-9a50-c4d5f09268dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:39.181452 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12571565-16d6-46a7-9a50-c4d5f09268dd None admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:39.181744 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12571565-16d6-46a7-9a50-c4d5f09268dd None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:39.182024 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12571565-16d6-46a7-9a50-c4d5f09268dd None admin] PATH_INFO: `/v3/projects/25310838cd094a4aba3f8ea2a06ff3c4/groups/8459835d4cef40c3bf0369753312956b/roles/7476baf91a50401596c34535d2c79a4f` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:39.185202 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12571565-16d6-46a7-9a50-c4d5f09268dd None admin] RBAC: Authorizing `identity:create_grant(project_id=25310838cd094a4aba3f8ea2a06ff3c4, group_id=8459835d4cef40c3bf0369753312956b, role_id=7476baf91a50401596c34535d2c79a4f)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:39.186954 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12571565-16d6-46a7-9a50-c4d5f09268dd None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:39.224358 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82f536-50ed-4043-a0a2-fecdd5a32ffe None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:39.260738 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3edee-3d65-43e2-a8d2-362dd97cf98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:39.261530 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3edee-3d65-43e2-a8d2-362dd97cf98b None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:39.261812 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3edee-3d65-43e2-a8d2-362dd97cf98b None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:39.262089 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3edee-3d65-43e2-a8d2-362dd97cf98b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:39.272279 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 206/414] 10.222.0.61 () {58 vars in 1442 bytes} [Fri Jun 3 13:02:38 2022] PUT /identity/v3/projects/25310838cd094a4aba3f8ea2a06ff3c4/groups/8459835d4cef40c3bf0369753312956b/roles/7476baf91a50401596c34535d2c79a4f => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:39.273609 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12571565-16d6-46a7-9a50-c4d5f09268dd None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:39.284330 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a3edee-3d65-43e2-a8d2-362dd97cf98b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:02:39.300183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-c3a3edee-3d65-43e2-a8d2-362dd97cf98b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 13:02:39.300183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:39.300183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:39.300183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:39.300183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:39.300183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:39.300183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:39.300183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:39.300183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:39.300183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:39.300183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:39.300183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:39.300183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:02:39.300183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:02:39.300183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:02:39.300183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:02:39.301179 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:02:39.301179 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:02:39.301179 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:02:39.301179 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:02:39.301179 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:39.301179 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:39.301179 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:39.301179 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:39.301179 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:39.301179 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:39.301179 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:39.301179 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:39.301179 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:39.301179 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:39.301179 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:39.301179 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:39.301985 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:39.301985 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:39.301985 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:39.301985 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:39.301985 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:02:39.301985 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:02:39.301985 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:02:39.301985 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:02:39.301985 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:02:39.301985 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:02:39.301985 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 13:02:39.301985 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:02:39.301985 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 209/415] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:02:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:39.301985 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3edee-3d65-43e2-a8d2-362dd97cf98b None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:39.428086 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:39.483425 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12571565-16d6-46a7-9a50-c4d5f09268dd None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:39.518423 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3edee-3d65-43e2-a8d2-362dd97cf98b None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:39.526702 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97304179-c932-4046-9191-05f77a80ffa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:39.527736 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97304179-c932-4046-9191-05f77a80ffa2 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:39.528125 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97304179-c932-4046-9191-05f77a80ffa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:39.528530 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97304179-c932-4046-9191-05f77a80ffa2 None admin] PATH_INFO: `/v3/groups/30d7fc392109474b9478ddd1997b1149` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:39.529858 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97304179-c932-4046-9191-05f77a80ffa2 None admin] RBAC: Authorizing `identity:get_group(group_id=30d7fc392109474b9478ddd1997b1149)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:39.532598 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97304179-c932-4046-9191-05f77a80ffa2 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:39.534839 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 207/416] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Jun 3 13:02:39 2022] GET /identity/v3/groups/30d7fc392109474b9478ddd1997b1149 => generated 229 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:39.541614 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97304179-c932-4046-9191-05f77a80ffa2 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:39.571329 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd65287-942f-4614-8d04-fde9a05cb6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:39.571998 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd65287-942f-4614-8d04-fde9a05cb6c9 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:39.572347 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd65287-942f-4614-8d04-fde9a05cb6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:39.572626 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd65287-942f-4614-8d04-fde9a05cb6c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:39.573377 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd65287-942f-4614-8d04-fde9a05cb6c9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:39.573734 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd65287-942f-4614-8d04-fde9a05cb6c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:39.575121 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd65287-942f-4614-8d04-fde9a05cb6c9 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:39.585502 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 210/417] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 13:02:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:39.590980 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd65287-942f-4614-8d04-fde9a05cb6c9 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:39.604102 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:39.670943 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97304179-c932-4046-9191-05f77a80ffa2 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:39.713228 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44695ac9-e453-4936-8893-d5a073b43b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:39.714161 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44695ac9-e453-4936-8893-d5a073b43b32 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:39.714445 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44695ac9-e453-4936-8893-d5a073b43b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:39.714773 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44695ac9-e453-4936-8893-d5a073b43b32 None admin] PATH_INFO: `/v3/projects/ade16b49bacd4a0789895b9341a45a4d` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:39.716088 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44695ac9-e453-4936-8893-d5a073b43b32 None admin] RBAC: Authorizing `identity:get_project(project_id=ade16b49bacd4a0789895b9341a45a4d)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:39.719079 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44695ac9-e453-4936-8893-d5a073b43b32 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:39.720819 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 208/418] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:02:39 2022] GET /identity/v3/projects/ade16b49bacd4a0789895b9341a45a4d => generated 344 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:39.726762 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44695ac9-e453-4936-8893-d5a073b43b32 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:39.755407 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd65287-942f-4614-8d04-fde9a05cb6c9 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:39.803982 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:39.818226 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca6a57-0d2f-4e9a-bde9-84bcba2e5a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:39.818880 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca6a57-0d2f-4e9a-bde9-84bcba2e5a0f None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:39.819160 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca6a57-0d2f-4e9a-bde9-84bcba2e5a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:39.819440 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca6a57-0d2f-4e9a-bde9-84bcba2e5a0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:39.841524 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44695ac9-e453-4936-8893-d5a073b43b32 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:39.865555 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:39.901057 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ca6a57-0d2f-4e9a-bde9-84bcba2e5a0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:39.902518 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ca6a57-0d2f-4e9a-bde9-84bcba2e5a0f None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:39.912884 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a1b2d-6711-4ac7-8a2a-8116e8f62b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:39.913776 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a1b2d-6711-4ac7-8a2a-8116e8f62b83 None admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:39.914056 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a1b2d-6711-4ac7-8a2a-8116e8f62b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:39.914329 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a1b2d-6711-4ac7-8a2a-8116e8f62b83 None admin] PATH_INFO: `/v3/projects/ade16b49bacd4a0789895b9341a45a4d/groups/30d7fc392109474b9478ddd1997b1149/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:39.916641 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a1b2d-6711-4ac7-8a2a-8116e8f62b83 None admin] RBAC: Authorizing `identity:create_grant(project_id=ade16b49bacd4a0789895b9341a45a4d, group_id=30d7fc392109474b9478ddd1997b1149, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:39.918111 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a1b2d-6711-4ac7-8a2a-8116e8f62b83 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:40.016049 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 211/419] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:02:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:40.022147 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca6a57-0d2f-4e9a-bde9-84bcba2e5a0f None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:40.027635 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 209/420] 10.222.0.61 () {58 vars in 1442 bytes} [Fri Jun 3 13:02:39 2022] PUT /identity/v3/projects/ade16b49bacd4a0789895b9341a45a4d/groups/30d7fc392109474b9478ddd1997b1149/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:02:40.075438 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:40.177520 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca6a57-0d2f-4e9a-bde9-84bcba2e5a0f None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:40.229186 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a3803-e653-4b13-ae74-e17eeb60f863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:40.230077 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a3803-e653-4b13-ae74-e17eeb60f863 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:40.230359 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a3803-e653-4b13-ae74-e17eeb60f863 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:40.230637 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a3803-e653-4b13-ae74-e17eeb60f863 None admin] PATH_INFO: `/v3/projects/69bee49150564ea3abbe7a2301dea4d8` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:40.237104 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a3803-e653-4b13-ae74-e17eeb60f863 None admin] RBAC: Authorizing `identity:get_project(project_id=69bee49150564ea3abbe7a2301dea4d8)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:40.238607 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a3803-e653-4b13-ae74-e17eeb60f863 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:40.240796 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 212/421] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:02:40 2022] GET /identity/v3/projects/69bee49150564ea3abbe7a2301dea4d8 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:02:40.246404 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a1b2d-6711-4ac7-8a2a-8116e8f62b83 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:40.355252 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a1b2d-6711-4ac7-8a2a-8116e8f62b83 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:40.392064 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666849a0-0ba4-4aab-9ef4-3d5120bbd299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:40.392995 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666849a0-0ba4-4aab-9ef4-3d5120bbd299 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:40.393279 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666849a0-0ba4-4aab-9ef4-3d5120bbd299 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:40.393556 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666849a0-0ba4-4aab-9ef4-3d5120bbd299 None admin] PATH_INFO: `/v3/groups/8459835d4cef40c3bf0369753312956b` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:40.394900 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666849a0-0ba4-4aab-9ef4-3d5120bbd299 None admin] RBAC: Authorizing `identity:get_group(group_id=8459835d4cef40c3bf0369753312956b)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:40.396429 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666849a0-0ba4-4aab-9ef4-3d5120bbd299 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:40.398468 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 210/422] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Jun 3 13:02:40 2022] GET /identity/v3/groups/8459835d4cef40c3bf0369753312956b => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:40.404606 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a3803-e653-4b13-ae74-e17eeb60f863 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:40.519376 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:40.528444 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a3803-e653-4b13-ae74-e17eeb60f863 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:40.569446 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd372f9-85ab-48c0-b901-30003e3a1ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:40.570100 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd372f9-85ab-48c0-b901-30003e3a1ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:40.570384 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd372f9-85ab-48c0-b901-30003e3a1ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:40.570661 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd372f9-85ab-48c0-b901-30003e3a1ee7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:40.571493 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd372f9-85ab-48c0-b901-30003e3a1ee7 None admin] RBAC: Adding query filter params (group.id=8459835d4cef40c3bf0369753312956b, role.id=d082d2b37fd1455ea61819353e8369ed, scope.project.id=69bee49150564ea3abbe7a2301dea4d8) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:40.571800 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd372f9-85ab-48c0-b901-30003e3a1ee7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:40.573275 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd372f9-85ab-48c0-b901-30003e3a1ee7 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:40.581422 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 213/423] 10.222.0.61 () {56 vars in 1376 bytes} [Fri Jun 3 13:02:40 2022] GET /identity/v3/role_assignments?group.id=8459835d4cef40c3bf0369753312956b&scope.project.id=69bee49150564ea3abbe7a2301dea4d8&role.id=d082d2b37fd1455ea61819353e8369ed => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:40.747540 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb5ebd-78bf-46cb-84a7-c64d87af46e4 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:40.747916 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb5ebd-78bf-46cb-84a7-c64d87af46e4 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:40.748092 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb5ebd-78bf-46cb-84a7-c64d87af46e4 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:40.750331 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 211/424] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:40.758128 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe821254-6faf-477c-a8b8-96eaae1fb395 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:40.758638 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe821254-6faf-477c-a8b8-96eaae1fb395 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:40.758742 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe821254-6faf-477c-a8b8-96eaae1fb395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:40.781756 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-fe821254-6faf-477c-a8b8-96eaae1fb395 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:40.782973 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-fe821254-6faf-477c-a8b8-96eaae1fb395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:40.884986 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 214/425] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:02:40.909946 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb5ebd-78bf-46cb-84a7-c64d87af46e4 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:40.970576 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:41.038552 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb5ebd-78bf-46cb-84a7-c64d87af46e4 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:41.079708 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf48e0b-6094-4813-8b2a-47371e654b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:41.080590 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf48e0b-6094-4813-8b2a-47371e654b33 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:41.080871 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf48e0b-6094-4813-8b2a-47371e654b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:41.081141 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf48e0b-6094-4813-8b2a-47371e654b33 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:41.095542 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf48e0b-6094-4813-8b2a-47371e654b33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:02:41.103658 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-bbf48e0b-6094-4813-8b2a-47371e654b33 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 13:02:41.103658 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:41.103658 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:41.103658 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:41.103658 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:41.103658 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:41.103658 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:41.103658 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:41.103658 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:41.103658 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:41.103658 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:41.103658 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:41.103658 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:02:41.103658 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:02:41.103658 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:02:41.103658 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:02:41.104542 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:02:41.104542 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:02:41.104542 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:02:41.104542 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:02:41.104542 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:41.104542 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:41.104542 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:41.104542 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:41.104542 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:41.104542 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:41.104542 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:41.104542 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:41.104542 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:41.104542 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:41.104542 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:41.104542 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:41.105373 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:41.105373 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:41.105373 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:41.105373 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:41.105373 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:02:41.105373 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:02:41.105373 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:02:41.105373 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:02:41.105373 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:02:41.105373 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:02:41.105373 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 13:02:41.105373 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:02:41.105373 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 212/426] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:02:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:41.113076 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe821254-6faf-477c-a8b8-96eaae1fb395 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:41.200082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69d84a-5ab5-470c-887a-4cd531f3e73c None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:41.200446 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69d84a-5ab5-470c-887a-4cd531f3e73c None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:41.200660 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69d84a-5ab5-470c-887a-4cd531f3e73c None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:41.202277 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 213/427] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:41.208317 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a991fb1-c063-4f48-a2d7-03f775c79496 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:41.208714 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a991fb1-c063-4f48-a2d7-03f775c79496 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:41.209262 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a991fb1-c063-4f48-a2d7-03f775c79496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:41.230510 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-4a991fb1-c063-4f48-a2d7-03f775c79496 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:41.231858 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-4a991fb1-c063-4f48-a2d7-03f775c79496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:41.241702 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:41.252639 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe821254-6faf-477c-a8b8-96eaae1fb395 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:41.294062 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14baa3-bac8-4d23-a4ea-93ed33228372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:41.294756 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14baa3-bac8-4d23-a4ea-93ed33228372 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:41.295038 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14baa3-bac8-4d23-a4ea-93ed33228372 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:41.295313 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14baa3-bac8-4d23-a4ea-93ed33228372 None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:41.296065 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14baa3-bac8-4d23-a4ea-93ed33228372 None admin] RBAC: Adding query filter params (name=member) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:41.296447 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14baa3-bac8-4d23-a4ea-93ed33228372 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:41.297979 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14baa3-bac8-4d23-a4ea-93ed33228372 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:41.314565 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 215/428] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 13:02:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:41.316166 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14baa3-bac8-4d23-a4ea-93ed33228372 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:41.319803 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 214/429] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:02:41.345162 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a991fb1-c063-4f48-a2d7-03f775c79496 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:41.383644 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:41.455391 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14baa3-bac8-4d23-a4ea-93ed33228372 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:41.466614 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a991fb1-c063-4f48-a2d7-03f775c79496 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:41.500651 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c61d9-f222-44a4-baf7-4aff903eb38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:41.501685 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c61d9-f222-44a4-baf7-4aff903eb38b None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:41.501971 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c61d9-f222-44a4-baf7-4aff903eb38b None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:41.502246 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c61d9-f222-44a4-baf7-4aff903eb38b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:41.506907 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2c196-17b6-4a3b-bb84-0cf676fc715f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:41.507948 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2c196-17b6-4a3b-bb84-0cf676fc715f None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:41.508501 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2c196-17b6-4a3b-bb84-0cf676fc715f None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:41.508970 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2c196-17b6-4a3b-bb84-0cf676fc715f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:41.522658 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b2c196-17b6-4a3b-bb84-0cf676fc715f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:02:41.527935 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:41.532511 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-49b2c196-17b6-4a3b-bb84-0cf676fc715f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 13:02:41.532511 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:41.532511 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:41.532511 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:41.532511 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:41.532511 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:41.532511 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:41.532511 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:41.532511 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:41.532511 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:41.532511 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:41.532511 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:41.532511 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:02:41.532511 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:02:41.532511 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:02:41.532511 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:02:41.533380 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:02:41.533380 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:02:41.533380 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:02:41.533380 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:02:41.533380 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:41.533380 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:41.533380 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:41.533380 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:41.533380 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:41.533380 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:41.533380 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:41.533380 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:41.533380 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:41.533380 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:41.533380 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:41.533380 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:41.534211 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:41.534211 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:41.534211 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:41.534211 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:41.534211 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:02:41.534211 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:02:41.534211 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:02:41.534211 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:02:41.534211 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:02:41.534211 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:02:41.534211 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 13:02:41.534211 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:02:41.536896 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 215/430] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jun 3 13:02:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:41.542649 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2c196-17b6-4a3b-bb84-0cf676fc715f None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:41.585742 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56c61d9-f222-44a4-baf7-4aff903eb38b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:41.587196 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56c61d9-f222-44a4-baf7-4aff903eb38b None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:41.648642 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:41.658770 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2c196-17b6-4a3b-bb84-0cf676fc715f None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:41.696744 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ff45d-bd4f-413a-8753-f803360c53bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:41.697418 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ff45d-bd4f-413a-8753-f803360c53bb None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:41.697702 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ff45d-bd4f-413a-8753-f803360c53bb None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:41.697978 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ff45d-bd4f-413a-8753-f803360c53bb None admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:41.698727 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ff45d-bd4f-413a-8753-f803360c53bb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:41.699035 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ff45d-bd4f-413a-8753-f803360c53bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:41.700056 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 216/431] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:02:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:41.700463 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ff45d-bd4f-413a-8753-f803360c53bb None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:41.707546 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c61d9-f222-44a4-baf7-4aff903eb38b None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:41.709876 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 216/432] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:02:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:02:41.717237 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ff45d-bd4f-413a-8753-f803360c53bb None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:41.768041 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:41.825256 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c61d9-f222-44a4-baf7-4aff903eb38b None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:41.861909 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ff45d-bd4f-413a-8753-f803360c53bb None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:41.863101 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c868d-9565-4da1-95c7-c9af64f7d0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:41.863969 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c868d-9565-4da1-95c7-c9af64f7d0e8 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:41.864296 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c868d-9565-4da1-95c7-c9af64f7d0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:41.864576 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c868d-9565-4da1-95c7-c9af64f7d0e8 None admin] PATH_INFO: `/v3/projects/25310838cd094a4aba3f8ea2a06ff3c4` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:41.865843 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190c868d-9565-4da1-95c7-c9af64f7d0e8 None admin] RBAC: Authorizing `identity:get_project(project_id=25310838cd094a4aba3f8ea2a06ff3c4)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:41.867390 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190c868d-9565-4da1-95c7-c9af64f7d0e8 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:41.873559 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 217/433] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:02:41 2022] GET /identity/v3/projects/25310838cd094a4aba3f8ea2a06ff3c4 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:41.875048 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c868d-9565-4da1-95c7-c9af64f7d0e8 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:41.907976 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf62652-0151-4111-8c83-c96d51a72d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:41.909200 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf62652-0151-4111-8c83-c96d51a72d02 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:41.915209 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf62652-0151-4111-8c83-c96d51a72d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:41.915209 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf62652-0151-4111-8c83-c96d51a72d02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:41.941226 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:41.995116 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c868d-9565-4da1-95c7-c9af64f7d0e8 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:42.013903 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf62652-0151-4111-8c83-c96d51a72d02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:42.017500 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf62652-0151-4111-8c83-c96d51a72d02 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:42.023361 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:42.040924 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4102b3-da5e-4e92-8239-b4d4046b38f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:42.042362 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4102b3-da5e-4e92-8239-b4d4046b38f9 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:42.042795 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4102b3-da5e-4e92-8239-b4d4046b38f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:42.043551 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4102b3-da5e-4e92-8239-b4d4046b38f9 None admin] PATH_INFO: `/v3/groups/8459835d4cef40c3bf0369753312956b` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:42.045476 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4102b3-da5e-4e92-8239-b4d4046b38f9 None admin] RBAC: Authorizing `identity:get_group(group_id=8459835d4cef40c3bf0369753312956b)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:42.047999 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4102b3-da5e-4e92-8239-b4d4046b38f9 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:42.056267 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 218/434] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Jun 3 13:02:41 2022] GET /identity/v3/groups/8459835d4cef40c3bf0369753312956b => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:02:42.058033 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4102b3-da5e-4e92-8239-b4d4046b38f9 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:42.142508 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 217/435] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:02:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:42.149936 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf62652-0151-4111-8c83-c96d51a72d02 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:42.174146 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4102b3-da5e-4e92-8239-b4d4046b38f9 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:42.215824 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:42.222028 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112dbf5-f117-468d-8bfc-91c12d702a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:42.222951 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112dbf5-f117-468d-8bfc-91c12d702a94 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:42.223233 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112dbf5-f117-468d-8bfc-91c12d702a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:42.223509 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112dbf5-f117-468d-8bfc-91c12d702a94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:42.224377 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112dbf5-f117-468d-8bfc-91c12d702a94 None admin] RBAC: Adding query filter params (group.id=8459835d4cef40c3bf0369753312956b, role.id=d082d2b37fd1455ea61819353e8369ed, scope.project.id=25310838cd094a4aba3f8ea2a06ff3c4) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:42.224756 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112dbf5-f117-468d-8bfc-91c12d702a94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:42.226303 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112dbf5-f117-468d-8bfc-91c12d702a94 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:42.240182 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 219/436] 10.222.0.61 () {56 vars in 1376 bytes} [Fri Jun 3 13:02:42 2022] GET /identity/v3/role_assignments?group.id=8459835d4cef40c3bf0369753312956b&scope.project.id=25310838cd094a4aba3f8ea2a06ff3c4&role.id=d082d2b37fd1455ea61819353e8369ed => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:42.275721 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf62652-0151-4111-8c83-c96d51a72d02 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:42.314398 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2776de-cc2b-4353-bd6d-ffe096d884cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:42.315296 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2776de-cc2b-4353-bd6d-ffe096d884cd None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:42.315582 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2776de-cc2b-4353-bd6d-ffe096d884cd None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:42.315860 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2776de-cc2b-4353-bd6d-ffe096d884cd None admin] PATH_INFO: `/v3/projects/69bee49150564ea3abbe7a2301dea4d8` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:42.317166 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2776de-cc2b-4353-bd6d-ffe096d884cd None admin] RBAC: Authorizing `identity:get_project(project_id=69bee49150564ea3abbe7a2301dea4d8)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:42.318669 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2776de-cc2b-4353-bd6d-ffe096d884cd None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:42.320850 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 218/437] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:02:42 2022] GET /identity/v3/projects/69bee49150564ea3abbe7a2301dea4d8 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:42.326522 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112dbf5-f117-468d-8bfc-91c12d702a94 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:42.376657 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc7d71-aca3-4ac2-8c5b-865c07753448 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:42.376981 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc7d71-aca3-4ac2-8c5b-865c07753448 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:42.377220 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc7d71-aca3-4ac2-8c5b-865c07753448 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:42.379323 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 219/438] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:42.384816 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695f71a-cc8c-4719-bdc5-7463c570932c None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:42.385119 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695f71a-cc8c-4719-bdc5-7463c570932c None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:42.385404 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695f71a-cc8c-4719-bdc5-7463c570932c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:42.390923 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:42.406244 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-8695f71a-cc8c-4719-bdc5-7463c570932c None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:42.407835 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-8695f71a-cc8c-4719-bdc5-7463c570932c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:42.444056 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112dbf5-f117-468d-8bfc-91c12d702a94 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:42.486917 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf9aa3f-44c1-428f-b2b9-361886e6480e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:42.491298 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9aa3f-44c1-428f-b2b9-361886e6480e None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:42.491584 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9aa3f-44c1-428f-b2b9-361886e6480e None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:42.491891 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9aa3f-44c1-428f-b2b9-361886e6480e None admin] PATH_INFO: `/v3/groups/8459835d4cef40c3bf0369753312956b` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:42.495188 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf9aa3f-44c1-428f-b2b9-361886e6480e None admin] RBAC: Authorizing `identity:get_group(group_id=8459835d4cef40c3bf0369753312956b)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:42.497815 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf9aa3f-44c1-428f-b2b9-361886e6480e None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:42.498240 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 220/439] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Jun 3 13:02:42 2022] GET /identity/v3/groups/8459835d4cef40c3bf0369753312956b => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:42.503885 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf9aa3f-44c1-428f-b2b9-361886e6480e None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:42.511150 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 220/440] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 13:02:42.544957 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695f71a-cc8c-4719-bdc5-7463c570932c None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:42.601496 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:42.616597 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf9aa3f-44c1-428f-b2b9-361886e6480e None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:42.639277 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:42.651882 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695f71a-cc8c-4719-bdc5-7463c570932c None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:42.654232 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3832dd3a-921a-41da-9da5-89816141ca4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:42.654892 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832dd3a-921a-41da-9da5-89816141ca4d None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:42.655176 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832dd3a-921a-41da-9da5-89816141ca4d None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:42.655450 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832dd3a-921a-41da-9da5-89816141ca4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:42.656887 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3832dd3a-921a-41da-9da5-89816141ca4d None admin] RBAC: Adding query filter params (group.id=8459835d4cef40c3bf0369753312956b, role.id=7476baf91a50401596c34535d2c79a4f, scope.project.id=69bee49150564ea3abbe7a2301dea4d8) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:42.657200 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3832dd3a-921a-41da-9da5-89816141ca4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:42.658639 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3832dd3a-921a-41da-9da5-89816141ca4d None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:42.665576 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 221/441] 10.222.0.61 () {56 vars in 1376 bytes} [Fri Jun 3 13:02:42 2022] GET /identity/v3/role_assignments?group.id=8459835d4cef40c3bf0369753312956b&scope.project.id=69bee49150564ea3abbe7a2301dea4d8&role.id=7476baf91a50401596c34535d2c79a4f => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:42.698536 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5b7a5-79ba-4515-99cf-266bd78e2d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:42.699371 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5b7a5-79ba-4515-99cf-266bd78e2d2d None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:42.699655 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5b7a5-79ba-4515-99cf-266bd78e2d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:42.700003 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5b7a5-79ba-4515-99cf-266bd78e2d2d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:42.713294 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d5b7a5-79ba-4515-99cf-266bd78e2d2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:02:42.722624 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-a5d5b7a5-79ba-4515-99cf-266bd78e2d2d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 13:02:42.722624 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:42.722624 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:42.722624 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:42.722624 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:42.722624 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:42.722624 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:42.722624 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:42.722624 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:42.722624 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:42.722624 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:42.722624 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:42.722624 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:02:42.722624 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:02:42.722624 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:02:42.722624 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:02:42.723653 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:02:42.723653 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:02:42.723653 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:02:42.723653 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:02:42.723653 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:42.723653 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:42.723653 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:42.723653 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:42.723653 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:42.723653 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:42.723653 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:42.723653 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:42.723653 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:42.723653 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:42.723653 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:42.723653 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:42.724497 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:42.724497 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:42.724497 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:42.724497 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:42.724497 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:02:42.724497 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:02:42.724497 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:02:42.724497 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:02:42.724497 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:02:42.724497 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:02:42.724497 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 13:02:42.724497 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:02:42.724497 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 221/442] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jun 3 13:02:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:02:42.733564 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3832dd3a-921a-41da-9da5-89816141ca4d None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:42.795318 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c4765-2781-4699-96a3-7095d12b5f07 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:42.795510 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c4765-2781-4699-96a3-7095d12b5f07 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:42.795787 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c4765-2781-4699-96a3-7095d12b5f07 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:42.797478 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 222/443] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 13:02:42.802934 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb3b40-d6d4-41c0-bfad-6130b93123bd None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:42.803224 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb3b40-d6d4-41c0-bfad-6130b93123bd None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:42.803510 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb3b40-d6d4-41c0-bfad-6130b93123bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:42.823465 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-a8fb3b40-d6d4-41c0-bfad-6130b93123bd None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:42.824734 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-a8fb3b40-d6d4-41c0-bfad-6130b93123bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:42.847676 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3832dd3a-921a-41da-9da5-89816141ca4d None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:42.886228 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb692ca-1ef7-4176-9a62-d0eafc21be67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:42.886895 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb692ca-1ef7-4176-9a62-d0eafc21be67 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:42.887178 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb692ca-1ef7-4176-9a62-d0eafc21be67 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:42.887450 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb692ca-1ef7-4176-9a62-d0eafc21be67 None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:42.889935 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb692ca-1ef7-4176-9a62-d0eafc21be67 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:42.889935 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb692ca-1ef7-4176-9a62-d0eafc21be67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:42.889935 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb692ca-1ef7-4176-9a62-d0eafc21be67 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:42.901965 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 222/444] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:02:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:42.903832 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 223/445] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 13:02:42.907572 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb692ca-1ef7-4176-9a62-d0eafc21be67 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:42.927683 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb3b40-d6d4-41c0-bfad-6130b93123bd None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:42.964865 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:42.982969 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:43.033689 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb692ca-1ef7-4176-9a62-d0eafc21be67 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:43.055710 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb3b40-d6d4-41c0-bfad-6130b93123bd None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:43.079656 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7137275-bed4-42bb-86a9-88f68cbf0f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:43.080408 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7137275-bed4-42bb-86a9-88f68cbf0f94 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:43.080698 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7137275-bed4-42bb-86a9-88f68cbf0f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:43.081832 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7137275-bed4-42bb-86a9-88f68cbf0f94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:43.098866 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c66baa-bacf-4e2f-a756-2e7284423c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:43.100039 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c66baa-bacf-4e2f-a756-2e7284423c15 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:43.100492 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c66baa-bacf-4e2f-a756-2e7284423c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:43.100915 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c66baa-bacf-4e2f-a756-2e7284423c15 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:43.114724 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c66baa-bacf-4e2f-a756-2e7284423c15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:02:43.121487 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-48c66baa-bacf-4e2f-a756-2e7284423c15 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:02:43.121487 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:43.121487 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:43.121487 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:43.121487 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:43.121487 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:43.121487 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:43.121487 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:43.121487 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:43.121487 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:43.121487 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:43.121487 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:43.121487 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:02:43.121487 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:02:43.121487 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:02:43.121487 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:02:43.122714 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:02:43.122714 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:02:43.122714 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:02:43.122714 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:02:43.122714 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:43.122714 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:43.122714 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:43.122714 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:43.122714 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:43.122714 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:43.122714 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:43.122714 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:43.122714 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:43.122714 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:43.122714 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:43.122714 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:43.123764 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:43.123764 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:43.123764 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:43.123764 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:43.123764 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:02:43.123764 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:02:43.123764 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:02:43.123764 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:02:43.123764 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:02:43.123764 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:02:43.123764 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:02:43.123764 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:02:43.123764 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 224/446] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 13:02:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:02:43.128720 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c66baa-bacf-4e2f-a756-2e7284423c15 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:43.161122 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7137275-bed4-42bb-86a9-88f68cbf0f94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:43.162606 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7137275-bed4-42bb-86a9-88f68cbf0f94 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:43.219536 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:43.255245 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c66baa-bacf-4e2f-a756-2e7284423c15 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:43.256971 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:43.281544 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 223/447] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:02:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 03 13:02:43.287317 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7137275-bed4-42bb-86a9-88f68cbf0f94 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:43.291329 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56b231-535b-4e80-bbaa-1a411ec03ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:43.292072 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56b231-535b-4e80-bbaa-1a411ec03ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:43.292455 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56b231-535b-4e80-bbaa-1a411ec03ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:43.292738 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56b231-535b-4e80-bbaa-1a411ec03ab2 None admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:43.293491 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a56b231-535b-4e80-bbaa-1a411ec03ab2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:43.293799 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a56b231-535b-4e80-bbaa-1a411ec03ab2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:43.295231 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a56b231-535b-4e80-bbaa-1a411ec03ab2 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:43.308622 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 225/448] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:02:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:02:43.309656 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56b231-535b-4e80-bbaa-1a411ec03ab2 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:43.383534 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7137275-bed4-42bb-86a9-88f68cbf0f94 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:43.408901 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56b231-535b-4e80-bbaa-1a411ec03ab2 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:43.416551 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b87a2-0ecd-45c8-a45b-59db168030f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:43.417403 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b87a2-0ecd-45c8-a45b-59db168030f0 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:43.417680 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b87a2-0ecd-45c8-a45b-59db168030f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:43.417949 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b87a2-0ecd-45c8-a45b-59db168030f0 None admin] PATH_INFO: `/v3/projects/25310838cd094a4aba3f8ea2a06ff3c4` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:43.419101 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80b87a2-0ecd-45c8-a45b-59db168030f0 None admin] RBAC: Authorizing `identity:get_project(project_id=25310838cd094a4aba3f8ea2a06ff3c4)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:43.420545 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80b87a2-0ecd-45c8-a45b-59db168030f0 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:43.422783 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 224/449] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:02:43 2022] GET /identity/v3/projects/25310838cd094a4aba3f8ea2a06ff3c4 => generated 302 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:02:43.428126 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b87a2-0ecd-45c8-a45b-59db168030f0 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:43.442755 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9481f-6c6c-4621-84e5-d4fe350afd23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:43.443026 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:43.443965 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9481f-6c6c-4621-84e5-d4fe350afd23 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:43.444521 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9481f-6c6c-4621-84e5-d4fe350afd23 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:43.445025 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9481f-6c6c-4621-84e5-d4fe350afd23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:43.477037 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:43.516826 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf9481f-6c6c-4621-84e5-d4fe350afd23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:43.518292 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf9481f-6c6c-4621-84e5-d4fe350afd23 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:43.526188 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b87a2-0ecd-45c8-a45b-59db168030f0 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:43.559345 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268dc83-551a-4725-ba6f-153678468b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:43.560126 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268dc83-551a-4725-ba6f-153678468b33 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:43.560441 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268dc83-551a-4725-ba6f-153678468b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:43.560718 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268dc83-551a-4725-ba6f-153678468b33 None admin] PATH_INFO: `/v3/groups/8459835d4cef40c3bf0369753312956b` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:43.561894 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d268dc83-551a-4725-ba6f-153678468b33 None admin] RBAC: Authorizing `identity:get_group(group_id=8459835d4cef40c3bf0369753312956b)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:43.564010 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d268dc83-551a-4725-ba6f-153678468b33 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:43.565662 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 225/450] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Jun 3 13:02:43 2022] GET /identity/v3/groups/8459835d4cef40c3bf0369753312956b => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:02:43.571456 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268dc83-551a-4725-ba6f-153678468b33 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:43.614708 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 226/451] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:02:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:43.619879 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9481f-6c6c-4621-84e5-d4fe350afd23 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:43.650332 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:43.667592 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268dc83-551a-4725-ba6f-153678468b33 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:43.680754 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:43.702951 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c8860-2e47-476c-a875-0f85d059c2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:43.703606 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c8860-2e47-476c-a875-0f85d059c2c7 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:43.703888 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c8860-2e47-476c-a875-0f85d059c2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:43.704186 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c8860-2e47-476c-a875-0f85d059c2c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:43.705013 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6c8860-2e47-476c-a875-0f85d059c2c7 None admin] RBAC: Adding query filter params (group.id=8459835d4cef40c3bf0369753312956b, role.id=7476baf91a50401596c34535d2c79a4f, scope.project.id=25310838cd094a4aba3f8ea2a06ff3c4) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:43.705327 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6c8860-2e47-476c-a875-0f85d059c2c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:43.706817 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6c8860-2e47-476c-a875-0f85d059c2c7 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:43.712956 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 226/452] 10.222.0.61 () {56 vars in 1376 bytes} [Fri Jun 3 13:02:43 2022] GET /identity/v3/role_assignments?group.id=8459835d4cef40c3bf0369753312956b&scope.project.id=25310838cd094a4aba3f8ea2a06ff3c4&role.id=7476baf91a50401596c34535d2c79a4f => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:02:43.717298 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9481f-6c6c-4621-84e5-d4fe350afd23 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:43.755631 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c160f1c-0183-4077-9cc7-de66ef0ed9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:43.756724 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c160f1c-0183-4077-9cc7-de66ef0ed9f6 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:43.757012 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c160f1c-0183-4077-9cc7-de66ef0ed9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:43.757292 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c160f1c-0183-4077-9cc7-de66ef0ed9f6 None admin] PATH_INFO: `/v3/projects/ade16b49bacd4a0789895b9341a45a4d` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:43.758575 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c160f1c-0183-4077-9cc7-de66ef0ed9f6 None admin] RBAC: Authorizing `identity:get_project(project_id=ade16b49bacd4a0789895b9341a45a4d)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:43.760053 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c160f1c-0183-4077-9cc7-de66ef0ed9f6 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:43.761835 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 227/453] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:02:43 2022] GET /identity/v3/projects/ade16b49bacd4a0789895b9341a45a4d => generated 344 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:02:43.767672 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c8860-2e47-476c-a875-0f85d059c2c7 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:43.872136 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c8860-2e47-476c-a875-0f85d059c2c7 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:43.908245 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc6cb14-303e-4150-85d6-7217967a845e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:43.909111 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6cb14-303e-4150-85d6-7217967a845e None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:43.909392 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6cb14-303e-4150-85d6-7217967a845e None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:43.909662 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6cb14-303e-4150-85d6-7217967a845e None admin] PATH_INFO: `/v3/groups/30d7fc392109474b9478ddd1997b1149` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:43.910863 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc6cb14-303e-4150-85d6-7217967a845e None admin] RBAC: Authorizing `identity:get_group(group_id=30d7fc392109474b9478ddd1997b1149)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:43.912386 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc6cb14-303e-4150-85d6-7217967a845e None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:43.914195 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 227/454] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Jun 3 13:02:43 2022] GET /identity/v3/groups/30d7fc392109474b9478ddd1997b1149 => generated 229 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:43.919993 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c160f1c-0183-4077-9cc7-de66ef0ed9f6 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:44.025675 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c160f1c-0183-4077-9cc7-de66ef0ed9f6 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:44.056020 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:44.061546 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e025336-b02f-48b1-a151-e481f0e22838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:44.062808 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e025336-b02f-48b1-a151-e481f0e22838 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:44.063353 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e025336-b02f-48b1-a151-e481f0e22838 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:44.063643 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e025336-b02f-48b1-a151-e481f0e22838 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:44.064523 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e025336-b02f-48b1-a151-e481f0e22838 None admin] RBAC: Adding query filter params (group.id=30d7fc392109474b9478ddd1997b1149, role.id=bbd5f3e0c18e4992886fcfb4a3feb426, scope.project.id=ade16b49bacd4a0789895b9341a45a4d) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:44.064844 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e025336-b02f-48b1-a151-e481f0e22838 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:44.066339 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e025336-b02f-48b1-a151-e481f0e22838 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:44.072551 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 228/455] 10.222.0.61 () {56 vars in 1376 bytes} [Fri Jun 3 13:02:43 2022] GET /identity/v3/role_assignments?group.id=30d7fc392109474b9478ddd1997b1149&scope.project.id=ade16b49bacd4a0789895b9341a45a4d&role.id=bbd5f3e0c18e4992886fcfb4a3feb426 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:46.760184 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b6e1e-e6d9-4159-bb39-20451147ffca None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:46.760711 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b6e1e-e6d9-4159-bb39-20451147ffca None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:46.760711 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b6e1e-e6d9-4159-bb39-20451147ffca None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:46.762313 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 228/456] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:46.767991 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494ec3f-4eec-4fae-9ebf-ab56a592c586 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:46.768441 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494ec3f-4eec-4fae-9ebf-ab56a592c586 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:46.768582 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494ec3f-4eec-4fae-9ebf-ab56a592c586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:46.805171 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-2494ec3f-4eec-4fae-9ebf-ab56a592c586 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:46.806368 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-2494ec3f-4eec-4fae-9ebf-ab56a592c586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:46.856481 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ea3ef-e32a-474f-8a3c-7d481122cd68 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:46.857343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ea3ef-e32a-474f-8a3c-7d481122cd68 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:46.857620 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ea3ef-e32a-474f-8a3c-7d481122cd68 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:46.860434 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 229/457] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:46.865548 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798594c5-3da6-4ac6-bc35-a39d1d65d7c4 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:46.871630 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798594c5-3da6-4ac6-bc35-a39d1d65d7c4 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:46.871630 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798594c5-3da6-4ac6-bc35-a39d1d65d7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:46.904848 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-798594c5-3da6-4ac6-bc35-a39d1d65d7c4 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:46.906685 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-798594c5-3da6-4ac6-bc35-a39d1d65d7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:46.910242 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 229/458] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 13:02:46.928502 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:46.982819 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494ec3f-4eec-4fae-9ebf-ab56a592c586 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:47.032222 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 230/459] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 13:02:47.059448 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798594c5-3da6-4ac6-bc35-a39d1d65d7c4 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:47.156990 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494ec3f-4eec-4fae-9ebf-ab56a592c586 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:47.189427 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:47.201684 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e395ca-2d0b-412d-b222-d2b6d7ce0c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:47.203093 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e395ca-2d0b-412d-b222-d2b6d7ce0c60 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:47.203547 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e395ca-2d0b-412d-b222-d2b6d7ce0c60 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:47.204126 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e395ca-2d0b-412d-b222-d2b6d7ce0c60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:47.227370 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e395ca-2d0b-412d-b222-d2b6d7ce0c60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:47.229202 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e395ca-2d0b-412d-b222-d2b6d7ce0c60 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:47.240613 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798594c5-3da6-4ac6-bc35-a39d1d65d7c4 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:47.268926 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-b8e395ca-2d0b-412d-b222-d2b6d7ce0c60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:02:47.268926 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:47.268926 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:47.268926 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:47.268926 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:47.268926 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:47.268926 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:47.268926 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:47.268926 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:47.268926 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:47.268926 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:47.268926 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:47.268926 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:02:47.268926 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:02:47.268926 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:02:47.269863 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:02:47.269863 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:47.269863 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:47.269863 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:47.269863 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:47.269863 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:47.269863 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:47.269863 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:47.269863 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:47.269863 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:47.269863 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:47.269863 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:47.269863 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:47.269863 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:47.269863 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:47.269863 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:47.269863 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:47.270694 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:02:47.270694 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:02:47.270694 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:02:47.270694 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:02:47.273904 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 230/460] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:02:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:02:47.278463 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e395ca-2d0b-412d-b222-d2b6d7ce0c60 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:47.279219 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b532e66-74fc-4507-96f5-63daa7beeedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:47.280405 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b532e66-74fc-4507-96f5-63daa7beeedc None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:47.281103 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b532e66-74fc-4507-96f5-63daa7beeedc None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:47.281471 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b532e66-74fc-4507-96f5-63daa7beeedc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:47.293525 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b532e66-74fc-4507-96f5-63daa7beeedc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:47.297448 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b532e66-74fc-4507-96f5-63daa7beeedc None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:47.298686 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:47.319318 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-4b532e66-74fc-4507-96f5-63daa7beeedc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:02:47.319318 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:47.319318 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:47.319318 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:47.319318 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:47.319318 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:47.319318 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:47.319318 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:47.319318 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:47.319318 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:47.319318 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:47.319318 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:47.319318 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:02:47.319318 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:02:47.319318 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:02:47.320266 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:02:47.320266 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:47.320266 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:47.320266 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:47.320266 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:47.320266 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:47.320266 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:47.320266 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:47.320266 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:47.320266 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:47.320266 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:47.320266 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:47.320266 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:47.320266 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:47.320266 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:47.320266 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:47.320266 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:47.321295 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:02:47.321295 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:02:47.321295 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:02:47.321295 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:02:47.321295 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 231/461] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:02:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:02:47.327110 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b532e66-74fc-4507-96f5-63daa7beeedc None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:47.424231 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e395ca-2d0b-412d-b222-d2b6d7ce0c60 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:47.458166 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b532e66-74fc-4507-96f5-63daa7beeedc None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:47.459543 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee2fac-7e9e-4119-8be9-b2e10adf7d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:47.460236 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee2fac-7e9e-4119-8be9-b2e10adf7d9d None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:47.460518 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee2fac-7e9e-4119-8be9-b2e10adf7d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:47.460790 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee2fac-7e9e-4119-8be9-b2e10adf7d9d None admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:47.461510 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee2fac-7e9e-4119-8be9-b2e10adf7d9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:47.461814 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee2fac-7e9e-4119-8be9-b2e10adf7d9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:47.463183 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee2fac-7e9e-4119-8be9-b2e10adf7d9d None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:47.480922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 231/462] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:02:47.482190 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb5c9a-c514-408e-a6eb-5235908f4af8 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:47.482482 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb5c9a-c514-408e-a6eb-5235908f4af8 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:47.482757 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb5c9a-c514-408e-a6eb-5235908f4af8 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:47.486555 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 232/463] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:47.486555 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9abfa0-e695-4ab7-8b64-76e1a859825f None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:47.486555 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9abfa0-e695-4ab7-8b64-76e1a859825f None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:47.486555 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9abfa0-e695-4ab7-8b64-76e1a859825f None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:47.487726 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 233/464] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:47.492335 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9abfa0-e695-4ab7-8b64-76e1a859825f None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:47.503162 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f48d76d-d0ec-4e71-8cd7-261147676e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:47.504051 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48d76d-d0ec-4e71-8cd7-261147676e5e None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:47.504507 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48d76d-d0ec-4e71-8cd7-261147676e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:47.504931 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48d76d-d0ec-4e71-8cd7-261147676e5e None admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:47.505803 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f48d76d-d0ec-4e71-8cd7-261147676e5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:47.506112 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f48d76d-d0ec-4e71-8cd7-261147676e5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:47.507545 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f48d76d-d0ec-4e71-8cd7-261147676e5e None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:47.523436 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 232/465] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:47.523436 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6bc3f-83d8-4190-a189-d4f18459390b None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:47.523436 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6bc3f-83d8-4190-a189-d4f18459390b None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:47.523436 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6bc3f-83d8-4190-a189-d4f18459390b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:47.539073 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-e4a6bc3f-83d8-4190-a189-d4f18459390b None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:47.540264 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-e4a6bc3f-83d8-4190-a189-d4f18459390b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:47.542227 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:47.600664 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:47.605223 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9abfa0-e695-4ab7-8b64-76e1a859825f None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:47.624284 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 233/466] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:02:47.625614 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48297c9-821c-435f-a101-a67e42b1c030 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:47.625902 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48297c9-821c-435f-a101-a67e42b1c030 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:47.626220 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48297c9-821c-435f-a101-a67e42b1c030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:47.642967 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-a48297c9-821c-435f-a101-a67e42b1c030 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:47.644175 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-a48297c9-821c-435f-a101-a67e42b1c030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:47.657986 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afebfa31-e5f7-4cac-8abf-4852c9d05952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:47.658655 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebfa31-e5f7-4cac-8abf-4852c9d05952 None admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:47.658938 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebfa31-e5f7-4cac-8abf-4852c9d05952 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:47.659214 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebfa31-e5f7-4cac-8abf-4852c9d05952 None admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:47.659911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afebfa31-e5f7-4cac-8abf-4852c9d05952 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:47.661391 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afebfa31-e5f7-4cac-8abf-4852c9d05952 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:47.714163 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 234/467] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:02:47.714995 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48297c9-821c-435f-a101-a67e42b1c030 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:47.748186 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 234/468] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jun 3 13:02:47 2022] POST /identity/v3/users => generated 246 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:47.749464 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afebfa31-e5f7-4cac-8abf-4852c9d05952 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:47.843984 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48297c9-821c-435f-a101-a67e42b1c030 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:47.866447 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:47.881925 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:47.887464 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50ee33-e3ce-474f-90db-f8331d035fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:47.888480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50ee33-e3ce-474f-90db-f8331d035fb4 None admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:47.889011 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50ee33-e3ce-474f-90db-f8331d035fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:47.889488 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50ee33-e3ce-474f-90db-f8331d035fb4 None admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:47.890673 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afebfa31-e5f7-4cac-8abf-4852c9d05952 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:47.891379 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec50ee33-e3ce-474f-90db-f8331d035fb4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:47.893170 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec50ee33-e3ce-474f-90db-f8331d035fb4 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:47.931189 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b54d281-934b-4f04-ac3c-87b331118a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:47.931992 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54d281-934b-4f04-ac3c-87b331118a44 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:47.932300 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54d281-934b-4f04-ac3c-87b331118a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:47.932573 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54d281-934b-4f04-ac3c-87b331118a44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:47.944190 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b54d281-934b-4f04-ac3c-87b331118a44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:47.945677 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b54d281-934b-4f04-ac3c-87b331118a44 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:47.965875 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-5b54d281-934b-4f04-ac3c-87b331118a44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:02:47.965875 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:47.965875 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:47.965875 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:47.965875 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:47.965875 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:47.965875 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:47.965875 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:47.965875 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:47.965875 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:47.965875 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:47.965875 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:47.965875 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:02:47.965875 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:02:47.965875 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:02:47.966836 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:02:47.966836 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:47.966836 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:47.966836 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:47.966836 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:47.966836 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:47.966836 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:47.966836 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:47.966836 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:47.966836 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:47.966836 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:47.966836 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:47.966836 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:47.966836 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:47.966836 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:47.966836 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:47.966836 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:47.969077 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:02:47.969077 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:02:47.969077 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:02:47.969077 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:02:47.969077 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 235/469] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:02:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:47.969077 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b54d281-934b-4f04-ac3c-87b331118a44 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:47.986988 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 235/470] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jun 3 13:02:47 2022] POST /identity/v3/users => generated 248 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:47.988331 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50ee33-e3ce-474f-90db-f8331d035fb4 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:48.121417 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b54d281-934b-4f04-ac3c-87b331118a44 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:48.151428 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50ee33-e3ce-474f-90db-f8331d035fb4 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:48.164003 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d08eb-48cc-4cb2-b936-5041ad25aa77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:48.164874 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d08eb-48cc-4cb2-b936-5041ad25aa77 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:48.165158 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d08eb-48cc-4cb2-b936-5041ad25aa77 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:48.165435 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d08eb-48cc-4cb2-b936-5041ad25aa77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:48.179959 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d08eb-48cc-4cb2-b936-5041ad25aa77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:48.181550 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d08eb-48cc-4cb2-b936-5041ad25aa77 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:48.189748 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:48.202298 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-665d08eb-48cc-4cb2-b936-5041ad25aa77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:02:48.202298 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:48.202298 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:48.202298 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:48.202298 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:48.202298 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:48.202298 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:48.202298 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:48.202298 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:48.202298 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:48.202298 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:48.202298 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:48.202298 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:02:48.202298 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:02:48.202298 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:02:48.203298 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:02:48.203298 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:48.203298 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:48.203298 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:48.203298 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:48.203298 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:48.203298 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:48.203298 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:48.203298 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:48.203298 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:48.203298 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:48.203298 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:48.203298 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:48.203298 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:48.203298 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:48.203298 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:48.203298 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:48.204126 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:02:48.204126 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:02:48.204126 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:02:48.204126 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:02:48.204126 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 236/471] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:02:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:48.204443 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb6582-ac1a-43ca-96ea-dae500753451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:48.207865 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb6582-ac1a-43ca-96ea-dae500753451 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:48.207865 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb6582-ac1a-43ca-96ea-dae500753451 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:48.207865 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb6582-ac1a-43ca-96ea-dae500753451 None admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:48.207865 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb6582-ac1a-43ca-96ea-dae500753451 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:48.207865 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb6582-ac1a-43ca-96ea-dae500753451 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:48.208303 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb6582-ac1a-43ca-96ea-dae500753451 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:48.212237 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d08eb-48cc-4cb2-b936-5041ad25aa77 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:48.226399 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 236/472] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:48.232471 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb6582-ac1a-43ca-96ea-dae500753451 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:48.275390 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:48.349382 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d08eb-48cc-4cb2-b936-5041ad25aa77 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:48.360606 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb6582-ac1a-43ca-96ea-dae500753451 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:48.394402 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ec6a5-c255-45e7-a32a-35b727598c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:48.395800 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ec6a5-c255-45e7-a32a-35b727598c3c None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:48.396418 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ec6a5-c255-45e7-a32a-35b727598c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:48.397014 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ec6a5-c255-45e7-a32a-35b727598c3c None admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:48.398226 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ec6a5-c255-45e7-a32a-35b727598c3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:48.398715 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b034e85-06bd-484b-b3fa-a84539460834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:48.398968 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ec6a5-c255-45e7-a32a-35b727598c3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:48.399380 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b034e85-06bd-484b-b3fa-a84539460834 None admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:48.399664 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b034e85-06bd-484b-b3fa-a84539460834 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:48.399940 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b034e85-06bd-484b-b3fa-a84539460834 None admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:48.400720 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b034e85-06bd-484b-b3fa-a84539460834 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:48.401486 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ec6a5-c255-45e7-a32a-35b727598c3c None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:48.402152 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b034e85-06bd-484b-b3fa-a84539460834 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:48.423089 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 237/473] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:02:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:02:48.424686 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ec6a5-c255-45e7-a32a-35b727598c3c None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:48.478855 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 237/474] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jun 3 13:02:48 2022] POST /identity/v3/users => generated 248 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:48.499044 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50511a-fae1-45de-b665-5fdc058b2cca None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:48.499368 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50511a-fae1-45de-b665-5fdc058b2cca None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:48.499649 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50511a-fae1-45de-b665-5fdc058b2cca None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:48.501437 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 238/475] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 13:02:48.507985 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6d5bf-7dfa-4d1c-8d82-ce925fa5cf14 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:48.508660 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6d5bf-7dfa-4d1c-8d82-ce925fa5cf14 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:48.509163 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6d5bf-7dfa-4d1c-8d82-ce925fa5cf14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:48.515299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:48.528313 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-acb6d5bf-7dfa-4d1c-8d82-ce925fa5cf14 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:48.529946 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-acb6d5bf-7dfa-4d1c-8d82-ce925fa5cf14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:48.573603 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ec6a5-c255-45e7-a32a-35b727598c3c None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:48.614744 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995a983-4acb-42f4-b2e7-6c2d5b961773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:48.615401 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995a983-4acb-42f4-b2e7-6c2d5b961773 None admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:48.615680 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995a983-4acb-42f4-b2e7-6c2d5b961773 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:48.615952 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995a983-4acb-42f4-b2e7-6c2d5b961773 None admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:48.616699 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995a983-4acb-42f4-b2e7-6c2d5b961773 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:48.618151 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995a983-4acb-42f4-b2e7-6c2d5b961773 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:48.628340 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 239/476] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 13:02:48.657535 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6d5bf-7dfa-4d1c-8d82-ce925fa5cf14 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:48.675113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:48.752551 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 238/477] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jun 3 13:02:48 2022] POST /identity/v3/users => generated 249 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:48.770112 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6d5bf-7dfa-4d1c-8d82-ce925fa5cf14 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:48.814667 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc62abf-bd0f-43f7-9f04-ff5766131feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:48.815716 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc62abf-bd0f-43f7-9f04-ff5766131feb None admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:48.816343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc62abf-bd0f-43f7-9f04-ff5766131feb None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:48.817817 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc62abf-bd0f-43f7-9f04-ff5766131feb None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:48.818735 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc62abf-bd0f-43f7-9f04-ff5766131feb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:48.820332 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc62abf-bd0f-43f7-9f04-ff5766131feb None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:48.861496 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.sql.core [None req-9cc62abf-bd0f-43f7-9f04-ff5766131feb None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 03 13:02:48.861496 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 03 13:02:48.861496 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [parameters: {'id': 'a40061b65b4a4765b7dca8047a03f786', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 03 13:02:48.861496 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80571) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 03 13:02:48.879754 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-9cc62abf-bd0f-43f7-9f04-ff5766131feb None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 03 13:02:48.879754 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:48.879754 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 03 13:02:48.879754 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 03 13:02:48.879754 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 03 13:02:48.879754 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 03 13:02:48.879754 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 03 13:02:48.879754 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application result = self._query(query) Jun 03 13:02:48.879754 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 03 13:02:48.879754 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application conn.query(q) Jun 03 13:02:48.879754 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 03 13:02:48.879754 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 03 13:02:48.879754 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 03 13:02:48.879754 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application result.read() Jun 03 13:02:48.879754 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 03 13:02:48.880868 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 03 13:02:48.880868 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 03 13:02:48.880868 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 03 13:02:48.880868 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 03 13:02:48.880868 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 03 13:02:48.880868 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 03 13:02:48.880868 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 03 13:02:48.880868 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 03 13:02:48.880868 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:02:48.880868 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 03 13:02:48.880868 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:02:48.880868 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:48.880868 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 03 13:02:48.880868 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 03 13:02:48.880868 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 03 13:02:48.880868 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return ref.to_dict() Jun 03 13:02:48.880868 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 03 13:02:48.880868 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application next(self.gen) Jun 03 13:02:48.881982 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 03 13:02:48.881982 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application yield resource Jun 03 13:02:48.881982 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 03 13:02:48.881982 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application next(self.gen) Jun 03 13:02:48.881982 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 03 13:02:48.881982 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application self.session.rollback() Jun 03 13:02:48.881982 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 03 13:02:48.881982 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application self.force_reraise() Jun 03 13:02:48.881982 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 03 13:02:48.881982 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise self.value Jun 03 13:02:48.881982 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 03 13:02:48.881982 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 03 13:02:48.881982 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 03 13:02:48.881982 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application session.commit() Jun 03 13:02:48.881982 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 03 13:02:48.881982 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 03 13:02:48.881982 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 03 13:02:48.883030 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application self._prepare_impl() Jun 03 13:02:48.883030 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 03 13:02:48.883030 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application self.session.flush() Jun 03 13:02:48.883030 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 03 13:02:48.883030 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application self._flush(objects) Jun 03 13:02:48.883030 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 03 13:02:48.883030 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 03 13:02:48.883030 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 03 13:02:48.883030 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application compat.raise_( Jun 03 13:02:48.883030 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 03 13:02:48.883030 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception Jun 03 13:02:48.883030 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 03 13:02:48.883030 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application flush_context.execute() Jun 03 13:02:48.883030 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 03 13:02:48.883030 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rec.execute(self) Jun 03 13:02:48.883030 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 03 13:02:48.883030 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 03 13:02:48.884328 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 03 13:02:48.884328 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 03 13:02:48.884328 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 03 13:02:48.884328 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 03 13:02:48.884328 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 03 13:02:48.884328 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 03 13:02:48.884328 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 03 13:02:48.884328 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 03 13:02:48.884328 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 03 13:02:48.884328 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 03 13:02:48.884328 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 03 13:02:48.884328 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 03 13:02:48.884328 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 03 13:02:48.884328 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 03 13:02:48.884328 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 03 13:02:48.884328 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception Jun 03 13:02:48.885590 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 03 13:02:48.885590 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 03 13:02:48.885590 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 03 13:02:48.885590 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 03 13:02:48.885590 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 03 13:02:48.885590 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application result = self._query(query) Jun 03 13:02:48.885590 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 03 13:02:48.885590 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application conn.query(q) Jun 03 13:02:48.885590 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 03 13:02:48.885590 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 03 13:02:48.885590 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 03 13:02:48.885590 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application result.read() Jun 03 13:02:48.885590 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 03 13:02:48.885590 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 03 13:02:48.885590 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 03 13:02:48.885590 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 03 13:02:48.886638 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 03 13:02:48.886638 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 03 13:02:48.886638 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 03 13:02:48.886638 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 03 13:02:48.886638 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 03 13:02:48.886638 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 03 13:02:48.886638 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [parameters: {'id': 'a40061b65b4a4765b7dca8047a03f786', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 03 13:02:48.886638 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 03 13:02:48.886638 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:02:48.886638 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 13:02:48.886638 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:02:48.886638 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:48.886638 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:48.886638 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:48.886638 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:48.886638 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:48.887608 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:48.887608 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:48.887608 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:48.887608 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:48.887608 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:48.887608 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:48.887608 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 03 13:02:48.887608 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 03 13:02:48.887608 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:48.887608 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:48.887608 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 03 13:02:48.887608 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 03 13:02:48.887608 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 03 13:02:48.887608 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 03 13:02:48.887608 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 03 13:02:48.887608 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:02:48.891262 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 240/478] 10.222.0.61 () {60 vars in 1131 bytes} [Fri Jun 3 13:02:48 2022] POST /identity/v3/roles => generated 144 bytes in 239 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:02:48.897418 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995a983-4acb-42f4-b2e7-6c2d5b961773 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:49.031716 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995a983-4acb-42f4-b2e7-6c2d5b961773 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:49.047346 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:49.067489 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327028b-68b5-4d36-ace2-ea037a83da88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:49.068338 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327028b-68b5-4d36-ace2-ea037a83da88 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:49.068621 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327028b-68b5-4d36-ace2-ea037a83da88 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:49.068894 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327028b-68b5-4d36-ace2-ea037a83da88 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:49.081121 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1327028b-68b5-4d36-ace2-ea037a83da88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:02:49.090736 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-1327028b-68b5-4d36-ace2-ea037a83da88 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 13:02:49.090736 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:49.090736 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:49.090736 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:49.090736 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:49.090736 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:49.090736 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:49.090736 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:49.090736 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:49.090736 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:49.090736 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:49.090736 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:49.090736 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:02:49.090736 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:02:49.090736 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:02:49.090736 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:02:49.091816 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:02:49.091816 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:02:49.091816 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:02:49.091816 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:02:49.091816 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:49.091816 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:49.091816 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:49.091816 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:49.091816 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:49.091816 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:49.091816 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:49.091816 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:49.091816 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:49.091816 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:49.091816 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:49.091816 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:49.092663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:49.092663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:49.092663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:49.092663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:49.092663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:02:49.092663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:02:49.092663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:02:49.092663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:02:49.092663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:02:49.092663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:02:49.092663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 13:02:49.092663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:02:49.093798 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 239/479] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jun 3 13:02:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:49.099416 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc62abf-bd0f-43f7-9f04-ff5766131feb None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:49.185755 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:49.205748 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc62abf-bd0f-43f7-9f04-ff5766131feb None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:49.241445 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dcd3f1-8788-4cea-9ca9-0ecd17e741b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:49.242116 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dcd3f1-8788-4cea-9ca9-0ecd17e741b1 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:49.242394 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dcd3f1-8788-4cea-9ca9-0ecd17e741b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:49.242667 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dcd3f1-8788-4cea-9ca9-0ecd17e741b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:49.243414 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dcd3f1-8788-4cea-9ca9-0ecd17e741b1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:49.243719 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dcd3f1-8788-4cea-9ca9-0ecd17e741b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:49.245123 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dcd3f1-8788-4cea-9ca9-0ecd17e741b1 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:49.256477 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 241/480] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:02:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:50.566723 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfea708-f64d-48db-89aa-609d59028911 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:50.567295 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfea708-f64d-48db-89aa-609d59028911 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:50.567295 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfea708-f64d-48db-89aa-609d59028911 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:50.569059 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 240/481] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:50.574547 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf279475-ea4a-4aa9-89a7-f37b6e401979 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:50.575009 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf279475-ea4a-4aa9-89a7-f37b6e401979 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:50.575084 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf279475-ea4a-4aa9-89a7-f37b6e401979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:50.596666 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-bf279475-ea4a-4aa9-89a7-f37b6e401979 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:50.598104 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-bf279475-ea4a-4aa9-89a7-f37b6e401979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:50.685766 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 242/482] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:02:50.720945 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfea708-f64d-48db-89aa-609d59028911 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:50.833227 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfea708-f64d-48db-89aa-609d59028911 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:50.880576 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632d9cb-8e93-4abc-8f37-222643fd741f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:50.881378 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632d9cb-8e93-4abc-8f37-222643fd741f None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:50.881663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632d9cb-8e93-4abc-8f37-222643fd741f None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:50.881943 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632d9cb-8e93-4abc-8f37-222643fd741f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:50.903160 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3632d9cb-8e93-4abc-8f37-222643fd741f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:02:50.911752 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-3632d9cb-8e93-4abc-8f37-222643fd741f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 13:02:50.911752 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:50.911752 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:50.911752 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:50.911752 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:50.911752 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:50.911752 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:50.911752 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:50.911752 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:50.911752 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:50.911752 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:50.911752 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:50.911752 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:02:50.911752 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:02:50.911752 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:02:50.911752 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:02:50.913184 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:02:50.913184 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:02:50.913184 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:02:50.913184 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:02:50.913184 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:50.913184 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:50.913184 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:50.913184 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:50.913184 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:50.913184 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:50.913184 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:50.913184 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:50.913184 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:50.913184 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:50.913184 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:50.913184 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:50.914151 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:50.914151 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:50.914151 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:50.914151 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:50.914151 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:02:50.914151 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:02:50.914151 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:02:50.914151 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:02:50.914151 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:02:50.914151 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:02:50.914151 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 13:02:50.914151 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:02:50.915138 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 241/483] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jun 3 13:02:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:50.919864 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf279475-ea4a-4aa9-89a7-f37b6e401979 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:50.996179 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc129e-1664-4fe3-8107-9d4d3691f40c None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:50.996461 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc129e-1664-4fe3-8107-9d4d3691f40c None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:50.996741 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc129e-1664-4fe3-8107-9d4d3691f40c None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:50.998408 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 242/484] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:51.009578 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf536109-fa47-457d-a651-aafb2f3446bd None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:51.009876 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf536109-fa47-457d-a651-aafb2f3446bd None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:51.010153 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf536109-fa47-457d-a651-aafb2f3446bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:51.024708 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:51.048747 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf279475-ea4a-4aa9-89a7-f37b6e401979 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:51.049210 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-cf536109-fa47-457d-a651-aafb2f3446bd None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:51.050417 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-cf536109-fa47-457d-a651-aafb2f3446bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:51.095387 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:51.113201 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842dcbb0-9686-4b0d-b7db-c6a0654c34ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:51.116334 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842dcbb0-9686-4b0d-b7db-c6a0654c34ef None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:51.116334 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842dcbb0-9686-4b0d-b7db-c6a0654c34ef None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:51.116334 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842dcbb0-9686-4b0d-b7db-c6a0654c34ef None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:51.116334 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842dcbb0-9686-4b0d-b7db-c6a0654c34ef None admin] RBAC: Adding query filter params (name=service) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:51.116334 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842dcbb0-9686-4b0d-b7db-c6a0654c34ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:51.116793 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842dcbb0-9686-4b0d-b7db-c6a0654c34ef None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:51.134652 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 243/485] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jun 3 13:02:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:51.141001 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842dcbb0-9686-4b0d-b7db-c6a0654c34ef None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:51.170150 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 243/486] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:02:51.208276 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf536109-fa47-457d-a651-aafb2f3446bd None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:51.295665 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842dcbb0-9686-4b0d-b7db-c6a0654c34ef None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:51.361127 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508efe88-85a7-42de-b13e-66ea9d3fe9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:51.361845 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508efe88-85a7-42de-b13e-66ea9d3fe9f5 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:51.362128 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508efe88-85a7-42de-b13e-66ea9d3fe9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:51.362398 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508efe88-85a7-42de-b13e-66ea9d3fe9f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:51.370649 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:51.383261 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf536109-fa47-457d-a651-aafb2f3446bd None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:51.393612 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508efe88-85a7-42de-b13e-66ea9d3fe9f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:51.395089 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508efe88-85a7-42de-b13e-66ea9d3fe9f5 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:51.419453 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-508efe88-85a7-42de-b13e-66ea9d3fe9f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:02:51.419453 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:51.419453 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:51.419453 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:51.419453 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:51.419453 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:51.419453 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:51.419453 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:51.419453 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:51.419453 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:51.419453 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:51.419453 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:51.419453 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:02:51.419453 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:02:51.419453 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:02:51.420403 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:02:51.420403 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:51.420403 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:51.420403 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:51.420403 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:51.420403 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:51.420403 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:51.420403 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:51.420403 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:51.420403 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:51.420403 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:51.420403 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:51.420403 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:51.420403 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:51.420403 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:51.420403 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:51.420403 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:51.421354 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:02:51.421354 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:02:51.421354 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:02:51.421354 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:02:51.421354 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 244/487] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:02:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:51.431417 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508efe88-85a7-42de-b13e-66ea9d3fe9f5 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:51.454017 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d5d12b-6a46-416c-8656-ff6f72f14172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:51.454832 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5d12b-6a46-416c-8656-ff6f72f14172 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:51.455119 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5d12b-6a46-416c-8656-ff6f72f14172 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:51.455394 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5d12b-6a46-416c-8656-ff6f72f14172 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:51.474494 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d5d12b-6a46-416c-8656-ff6f72f14172 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:02:51.483245 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-15d5d12b-6a46-416c-8656-ff6f72f14172 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 13:02:51.483245 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:51.483245 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:51.483245 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:51.483245 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:51.483245 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:51.483245 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:51.483245 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:51.483245 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:51.483245 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:51.483245 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:51.483245 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:51.483245 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:02:51.483245 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:02:51.483245 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:02:51.483245 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:02:51.484642 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:02:51.484642 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:02:51.484642 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:02:51.484642 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:02:51.484642 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:51.484642 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:51.484642 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:51.484642 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:51.484642 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:51.484642 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:51.484642 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:51.484642 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:51.484642 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:51.484642 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:51.484642 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:51.484642 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:51.485433 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:51.485433 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:51.485433 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:51.485433 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:51.485433 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:02:51.485433 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:02:51.485433 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:02:51.485433 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:02:51.485433 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:02:51.485433 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:02:51.485433 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 13:02:51.485433 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:02:51.488117 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 244/488] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jun 3 13:02:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:02:51.489708 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6dc8ca-e0ec-4a44-a399-91b1a1d9be17 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:51.490194 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6dc8ca-e0ec-4a44-a399-91b1a1d9be17 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:51.490711 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6dc8ca-e0ec-4a44-a399-91b1a1d9be17 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:51.492961 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 245/489] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:51.497862 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6dc8ca-e0ec-4a44-a399-91b1a1d9be17 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:51.527554 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:51.565940 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508efe88-85a7-42de-b13e-66ea9d3fe9f5 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:51.616019 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6dc8ca-e0ec-4a44-a399-91b1a1d9be17 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:51.617296 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a5040-b432-4b21-9a50-519dcd06fb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:51.617969 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a5040-b432-4b21-9a50-519dcd06fb33 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:51.618259 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a5040-b432-4b21-9a50-519dcd06fb33 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:51.618537 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a5040-b432-4b21-9a50-519dcd06fb33 None admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:51.619275 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082a5040-b432-4b21-9a50-519dcd06fb33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:51.619841 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082a5040-b432-4b21-9a50-519dcd06fb33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:51.622203 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082a5040-b432-4b21-9a50-519dcd06fb33 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:51.637517 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 245/490] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:02:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:51.639054 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07159e0e-3c2c-4f19-b9b4-4667fb06204f None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:51.639579 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07159e0e-3c2c-4f19-b9b4-4667fb06204f None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:51.640684 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07159e0e-3c2c-4f19-b9b4-4667fb06204f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:51.660069 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20757065-f4a4-4562-97ad-6093dd7d3d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:51.661191 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20757065-f4a4-4562-97ad-6093dd7d3d4b None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:51.661670 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20757065-f4a4-4562-97ad-6093dd7d3d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:51.662164 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20757065-f4a4-4562-97ad-6093dd7d3d4b None admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:51.662596 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-07159e0e-3c2c-4f19-b9b4-4667fb06204f None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:51.663653 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20757065-f4a4-4562-97ad-6093dd7d3d4b None admin] RBAC: Adding query filter params (name=service) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:51.663758 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-07159e0e-3c2c-4f19-b9b4-4667fb06204f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:51.664325 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20757065-f4a4-4562-97ad-6093dd7d3d4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:51.666114 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20757065-f4a4-4562-97ad-6093dd7d3d4b None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:51.676190 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 246/491] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jun 3 13:02:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:51.677485 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20757065-f4a4-4562-97ad-6093dd7d3d4b None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:51.721237 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:51.757416 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 246/492] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:02:51.758814 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07159e0e-3c2c-4f19-b9b4-4667fb06204f None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:51.798854 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:51.818694 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20757065-f4a4-4562-97ad-6093dd7d3d4b None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:51.861861 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d10d33-12b8-40ec-8b10-1df17c5d9259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:51.863588 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d10d33-12b8-40ec-8b10-1df17c5d9259 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:51.864259 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d10d33-12b8-40ec-8b10-1df17c5d9259 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:51.864991 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d10d33-12b8-40ec-8b10-1df17c5d9259 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:51.875029 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d10d33-12b8-40ec-8b10-1df17c5d9259 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:51.877036 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d10d33-12b8-40ec-8b10-1df17c5d9259 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:51.895244 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07159e0e-3c2c-4f19-b9b4-4667fb06204f None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:51.900225 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-01d10d33-12b8-40ec-8b10-1df17c5d9259 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 13:02:51.900225 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:51.900225 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:51.900225 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:51.900225 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:51.900225 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:51.900225 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:51.900225 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:51.900225 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:51.900225 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:51.900225 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:51.900225 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:51.900225 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 13:02:51.900225 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 13:02:51.900225 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 13:02:51.900225 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 13:02:51.906031 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:51.906031 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:51.906031 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 13:02:51.906031 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:02:51.906031 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 13:02:51.906031 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:02:51.906031 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:51.906031 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:51.906031 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:51.906031 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:51.906031 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:51.906031 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:51.906031 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:51.906031 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:51.906031 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:51.906031 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:51.906031 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:51.906031 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:51.907461 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:51.907461 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:51.907461 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 13:02:51.907461 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 13:02:51.907461 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 13:02:51.907461 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 13:02:51.907461 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 13:02:51.907461 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 13:02:51.907461 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 13:02:51.907461 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:02:51.907461 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 247/493] 10.222.0.61 () {56 vars in 1093 bytes} [Fri Jun 3 13:02:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:51.907461 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d10d33-12b8-40ec-8b10-1df17c5d9259 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:51.940332 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f702a7ba-aeb4-4d68-9dba-5a019e04a1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:51.942219 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702a7ba-aeb4-4d68-9dba-5a019e04a1a8 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:51.943377 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702a7ba-aeb4-4d68-9dba-5a019e04a1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:51.944349 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702a7ba-aeb4-4d68-9dba-5a019e04a1a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:51.960535 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f702a7ba-aeb4-4d68-9dba-5a019e04a1a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:51.962817 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f702a7ba-aeb4-4d68-9dba-5a019e04a1a8 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:51.988200 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-f702a7ba-aeb4-4d68-9dba-5a019e04a1a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:02:51.988200 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:51.988200 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:51.988200 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:51.988200 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:51.988200 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:51.988200 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:51.988200 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:51.988200 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:51.988200 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:51.988200 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:51.988200 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:51.988200 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:02:51.988200 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:02:51.988200 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:02:51.989243 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:02:51.989243 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:51.989243 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:51.989243 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:51.989243 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:51.989243 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:51.989243 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:51.989243 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:51.989243 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:51.989243 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:51.989243 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:51.989243 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:51.989243 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:51.989243 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:51.989243 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:51.989243 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:51.989243 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:51.990081 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:02:51.990081 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:02:51.990081 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:02:51.990081 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:02:51.992493 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 247/494] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:02:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:51.993477 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f702a7ba-aeb4-4d68-9dba-5a019e04a1a8 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:52.039127 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d10d33-12b8-40ec-8b10-1df17c5d9259 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:52.042604 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:52.075657 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c33b2a-d913-44ed-9406-13f0446a57d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:52.076663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c33b2a-d913-44ed-9406-13f0446a57d2 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:52.077245 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c33b2a-d913-44ed-9406-13f0446a57d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:52.078233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c33b2a-d913-44ed-9406-13f0446a57d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:52.090134 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c33b2a-d913-44ed-9406-13f0446a57d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:02:52.098384 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-b3c33b2a-d913-44ed-9406-13f0446a57d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 13:02:52.098384 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:52.098384 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:52.098384 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:52.098384 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:52.098384 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:52.098384 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:52.098384 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:52.098384 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:52.098384 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:52.098384 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:52.098384 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:52.098384 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:02:52.098384 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:02:52.098384 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:02:52.098384 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:02:52.099314 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:02:52.099314 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:02:52.099314 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:02:52.099314 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:02:52.099314 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:52.099314 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:52.099314 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:52.099314 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:52.099314 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:52.099314 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:52.099314 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:52.099314 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:52.099314 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:52.099314 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:52.099314 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:52.099314 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:52.100117 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:52.100117 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:52.100117 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:52.100117 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:52.100117 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:02:52.100117 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:02:52.100117 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:02:52.100117 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:02:52.100117 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:02:52.100117 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:02:52.100117 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 13:02:52.100117 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:02:52.100117 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 248/495] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jun 3 13:02:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:52.100826 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c33b2a-d913-44ed-9406-13f0446a57d2 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:52.110948 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:52.125370 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f702a7ba-aeb4-4d68-9dba-5a019e04a1a8 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:52.158658 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e789fb5-d369-4a25-bfc4-bce12d8aa3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:52.159313 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e789fb5-d369-4a25-bfc4-bce12d8aa3de None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:52.159592 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e789fb5-d369-4a25-bfc4-bce12d8aa3de None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:52.159863 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e789fb5-d369-4a25-bfc4-bce12d8aa3de None admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:52.160722 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e789fb5-d369-4a25-bfc4-bce12d8aa3de None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:52.161030 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e789fb5-d369-4a25-bfc4-bce12d8aa3de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:52.162446 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e789fb5-d369-4a25-bfc4-bce12d8aa3de None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:52.198648 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 248/496] 10.222.0.61 () {56 vars in 1133 bytes} [Fri Jun 3 13:02:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:52.200039 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9a4f0-ad0c-49e1-a7cb-c8a99f47683f None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:52.200361 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9a4f0-ad0c-49e1-a7cb-c8a99f47683f None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:52.200637 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9a4f0-ad0c-49e1-a7cb-c8a99f47683f None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:52.202012 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 249/497] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:52.203843 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6cdd46-d597-45f2-a407-fee7da82c0fb None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:52.204208 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6cdd46-d597-45f2-a407-fee7da82c0fb None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:52.204487 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6cdd46-d597-45f2-a407-fee7da82c0fb None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:52.205712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 250/498] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:52.208941 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6cdd46-d597-45f2-a407-fee7da82c0fb None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:52.213844 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c33b2a-d913-44ed-9406-13f0446a57d2 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:52.247396 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32deb7c-659f-4511-84ff-473d874531ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:52.248050 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32deb7c-659f-4511-84ff-473d874531ff None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:52.248357 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32deb7c-659f-4511-84ff-473d874531ff None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:52.248653 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32deb7c-659f-4511-84ff-473d874531ff None admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:52.249903 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32deb7c-659f-4511-84ff-473d874531ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:52.250220 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32deb7c-659f-4511-84ff-473d874531ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:52.251578 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32deb7c-659f-4511-84ff-473d874531ff None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:52.263153 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 249/499] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:02:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:52.263950 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32deb7c-659f-4511-84ff-473d874531ff None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:52.298156 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:52.310471 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6cdd46-d597-45f2-a407-fee7da82c0fb None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:52.328780 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:52.344441 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f0d2e0-542b-47be-9758-df3583024de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:52.345096 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f0d2e0-542b-47be-9758-df3583024de6 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:52.345377 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f0d2e0-542b-47be-9758-df3583024de6 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:52.345647 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f0d2e0-542b-47be-9758-df3583024de6 None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:52.346401 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f0d2e0-542b-47be-9758-df3583024de6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:52.346683 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f0d2e0-542b-47be-9758-df3583024de6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:52.348336 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f0d2e0-542b-47be-9758-df3583024de6 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:52.356012 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 251/500] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jun 3 13:02:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:52.356012 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2945702-b860-4995-b6ee-82a992eda906 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:52.356012 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2945702-b860-4995-b6ee-82a992eda906 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:52.356012 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2945702-b860-4995-b6ee-82a992eda906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:52.367723 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32deb7c-659f-4511-84ff-473d874531ff None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:52.374174 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-d2945702-b860-4995-b6ee-82a992eda906 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:52.376112 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-d2945702-b860-4995-b6ee-82a992eda906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:52.401863 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d226a70-cca5-4501-9a93-6d39df3650a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:52.402507 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d226a70-cca5-4501-9a93-6d39df3650a6 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:52.402791 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d226a70-cca5-4501-9a93-6d39df3650a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:52.403067 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d226a70-cca5-4501-9a93-6d39df3650a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:52.441709 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 252/501] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:02:52.442998 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebacfa-2803-4768-996b-6fa305942635 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:52.443291 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebacfa-2803-4768-996b-6fa305942635 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:52.443570 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebacfa-2803-4768-996b-6fa305942635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:52.463834 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-69ebacfa-2803-4768-996b-6fa305942635 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:52.465398 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-69ebacfa-2803-4768-996b-6fa305942635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:52.473997 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d226a70-cca5-4501-9a93-6d39df3650a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:52.475464 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d226a70-cca5-4501-9a93-6d39df3650a6 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:52.533226 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 253/502] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:02:52.534070 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ebacfa-2803-4768-996b-6fa305942635 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:52.545291 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:52.555583 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:52.592019 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 250/503] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:02:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:52.592900 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d226a70-cca5-4501-9a93-6d39df3650a6 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:52.636032 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ebacfa-2803-4768-996b-6fa305942635 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:52.669974 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd38f1-ecf3-44c3-8059-c372612912be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:52.670786 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd38f1-ecf3-44c3-8059-c372612912be None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:52.671058 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd38f1-ecf3-44c3-8059-c372612912be None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:52.671921 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd38f1-ecf3-44c3-8059-c372612912be None admin] PATH_INFO: `/v3/users/glance` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:52.680232 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd38f1-ecf3-44c3-8059-c372612912be None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:52.681685 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd38f1-ecf3-44c3-8059-c372612912be None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:52.692980 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d226a70-cca5-4501-9a93-6d39df3650a6 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:52.697853 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-cffd38f1-ecf3-44c3-8059-c372612912be None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 03 13:02:52.697853 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:52.697853 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:52.697853 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:52.697853 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:52.697853 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:52.697853 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:52.697853 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:52.697853 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:52.697853 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:52.697853 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:52.697853 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:52.697853 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 13:02:52.697853 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 13:02:52.697853 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 13:02:52.697853 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 13:02:52.698946 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:52.698946 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:52.698946 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 13:02:52.698946 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:02:52.698946 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 13:02:52.698946 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:02:52.698946 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:52.698946 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:52.698946 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:52.698946 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:52.698946 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:52.698946 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:52.698946 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:52.698946 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:52.698946 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:52.698946 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:52.698946 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:52.698946 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:52.699993 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:52.699993 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:52.699993 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 13:02:52.699993 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 13:02:52.699993 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 13:02:52.699993 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 13:02:52.699993 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 13:02:52.699993 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 13:02:52.699993 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 03 13:02:52.699993 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:02:52.699993 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 254/504] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:02:52 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:52.704320 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd38f1-ecf3-44c3-8059-c372612912be None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:52.727984 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe334d-6964-48fb-97df-d5c2d1305a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:52.728802 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe334d-6964-48fb-97df-d5c2d1305a3c None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:52.729085 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe334d-6964-48fb-97df-d5c2d1305a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:52.729363 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe334d-6964-48fb-97df-d5c2d1305a3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:52.741208 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe334d-6964-48fb-97df-d5c2d1305a3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:52.742676 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe334d-6964-48fb-97df-d5c2d1305a3c None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:52.760905 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-53fe334d-6964-48fb-97df-d5c2d1305a3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:02:52.760905 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:52.760905 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:52.760905 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:52.760905 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:52.760905 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:52.760905 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:52.760905 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:52.760905 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:52.760905 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:52.760905 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:52.760905 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:52.760905 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:02:52.760905 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:02:52.760905 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:02:52.761849 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:02:52.761849 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:52.761849 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:52.761849 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:52.761849 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:52.761849 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:52.761849 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:52.761849 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:52.761849 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:52.761849 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:52.761849 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:52.761849 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:52.761849 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:52.761849 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:52.761849 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:52.761849 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:52.761849 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:52.762679 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:02:52.762679 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:02:52.762679 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:02:52.762679 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:02:52.762679 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 251/505] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:02:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:52.762935 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe334d-6964-48fb-97df-d5c2d1305a3c None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:52.777996 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:52.785750 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:52.807433 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd38f1-ecf3-44c3-8059-c372612912be None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:52.842356 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b29b9d-1858-46c8-b988-62b82153ea93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:52.843754 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b29b9d-1858-46c8-b988-62b82153ea93 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:52.844131 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b29b9d-1858-46c8-b988-62b82153ea93 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:52.844429 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b29b9d-1858-46c8-b988-62b82153ea93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:52.854762 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b29b9d-1858-46c8-b988-62b82153ea93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:52.856248 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b29b9d-1858-46c8-b988-62b82153ea93 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:52.865032 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe334d-6964-48fb-97df-d5c2d1305a3c None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:52.874143 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-72b29b9d-1858-46c8-b988-62b82153ea93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:02:52.874143 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:52.874143 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:52.874143 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:52.874143 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:52.874143 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:52.874143 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:52.874143 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:52.874143 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:52.874143 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:52.874143 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:52.874143 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:52.874143 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:02:52.874143 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:02:52.874143 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:02:52.875521 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:02:52.875521 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:52.875521 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:52.875521 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:52.875521 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:52.875521 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:52.875521 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:52.875521 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:52.875521 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:52.875521 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:52.875521 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:52.875521 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:52.875521 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:52.875521 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:52.875521 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:52.875521 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:52.875521 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:52.876403 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:02:52.876403 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:02:52.876403 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:02:52.876403 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:02:52.876403 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 255/506] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:02:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:52.876403 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b29b9d-1858-46c8-b988-62b82153ea93 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:52.907156 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36f0a4-09f5-4fc7-bae7-3a7cb1f7e595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:52.907882 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36f0a4-09f5-4fc7-bae7-3a7cb1f7e595 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:52.908190 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36f0a4-09f5-4fc7-bae7-3a7cb1f7e595 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:52.908477 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36f0a4-09f5-4fc7-bae7-3a7cb1f7e595 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:52.918482 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b36f0a4-09f5-4fc7-bae7-3a7cb1f7e595 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:02:52.927339 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-1b36f0a4-09f5-4fc7-bae7-3a7cb1f7e595 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 13:02:52.927339 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:52.927339 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:52.927339 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:52.927339 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:52.927339 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:52.927339 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:52.927339 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:52.927339 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:52.927339 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:52.927339 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:52.927339 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:52.927339 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:02:52.927339 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:02:52.927339 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:02:52.927339 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:02:52.928469 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:02:52.928469 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:02:52.928469 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:02:52.928469 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:02:52.928469 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:52.928469 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:52.928469 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:52.928469 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:52.928469 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:52.928469 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:52.928469 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:52.928469 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:52.928469 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:52.928469 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:52.928469 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:52.928469 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:52.929439 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:52.929439 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:52.929439 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:52.929439 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:52.929439 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:02:52.929439 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:02:52.929439 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:02:52.929439 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:02:52.929439 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:02:52.929439 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:02:52.929439 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 13:02:52.929439 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:02:52.929439 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 252/507] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jun 3 13:02:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:52.931087 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36f0a4-09f5-4fc7-bae7-3a7cb1f7e595 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:53.008913 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:53.015839 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b29b9d-1858-46c8-b988-62b82153ea93 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:53.032860 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36f0a4-09f5-4fc7-bae7-3a7cb1f7e595 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:53.040186 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:53.052616 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a920d5-a4be-439e-a1af-34ed0862c287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:53.053404 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a920d5-a4be-439e-a1af-34ed0862c287 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:53.053679 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a920d5-a4be-439e-a1af-34ed0862c287 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:53.053947 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a920d5-a4be-439e-a1af-34ed0862c287 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:53.064392 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a920d5-a4be-439e-a1af-34ed0862c287 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:53.065839 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a920d5-a4be-439e-a1af-34ed0862c287 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:53.068530 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b479b4-b7a6-4190-9297-52c09eaf4a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:53.069198 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b479b4-b7a6-4190-9297-52c09eaf4a8f None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:53.069486 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b479b4-b7a6-4190-9297-52c09eaf4a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:53.069766 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b479b4-b7a6-4190-9297-52c09eaf4a8f None admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:53.070599 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b479b4-b7a6-4190-9297-52c09eaf4a8f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:53.070913 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b479b4-b7a6-4190-9297-52c09eaf4a8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:53.072387 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b479b4-b7a6-4190-9297-52c09eaf4a8f None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:53.083814 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-a0a920d5-a4be-439e-a1af-34ed0862c287 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:02:53.083814 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:53.083814 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:53.083814 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:53.083814 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:53.083814 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:53.083814 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:53.083814 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:53.083814 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:53.083814 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:53.083814 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:53.083814 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:53.083814 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:02:53.083814 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:02:53.083814 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:02:53.084785 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:02:53.084785 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:53.084785 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:53.084785 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:53.084785 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:53.084785 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:53.084785 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:53.084785 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:53.084785 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:53.084785 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:53.084785 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:53.084785 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:53.084785 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:53.084785 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:53.084785 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:53.084785 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:53.084785 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:53.085622 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:02:53.085622 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:02:53.085622 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:02:53.085622 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:02:53.085622 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 256/508] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:02:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:53.085890 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a920d5-a4be-439e-a1af-34ed0862c287 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:53.113496 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 253/509] 10.222.0.61 () {56 vars in 1137 bytes} [Fri Jun 3 13:02:52 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:53.114347 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b479b4-b7a6-4190-9297-52c09eaf4a8f None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:53.188952 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a920d5-a4be-439e-a1af-34ed0862c287 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:53.215656 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b479b4-b7a6-4190-9297-52c09eaf4a8f None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:53.224035 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39c668-12b1-4290-a23c-bbc2c3d39917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:53.224718 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39c668-12b1-4290-a23c-bbc2c3d39917 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:53.224996 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39c668-12b1-4290-a23c-bbc2c3d39917 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:53.225275 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39c668-12b1-4290-a23c-bbc2c3d39917 None admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:53.225986 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a39c668-12b1-4290-a23c-bbc2c3d39917 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:53.226284 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a39c668-12b1-4290-a23c-bbc2c3d39917 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:53.227657 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a39c668-12b1-4290-a23c-bbc2c3d39917 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:53.239558 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 257/510] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:53.240425 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39c668-12b1-4290-a23c-bbc2c3d39917 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:53.249548 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95261c7e-f678-4b2d-ae37-14887e190691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:53.250341 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95261c7e-f678-4b2d-ae37-14887e190691 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:53.250621 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95261c7e-f678-4b2d-ae37-14887e190691 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:53.250894 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95261c7e-f678-4b2d-ae37-14887e190691 None admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:53.251630 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95261c7e-f678-4b2d-ae37-14887e190691 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:53.251937 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95261c7e-f678-4b2d-ae37-14887e190691 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:53.253421 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95261c7e-f678-4b2d-ae37-14887e190691 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:53.256223 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:53.267693 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 254/511] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:53.268622 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95261c7e-f678-4b2d-ae37-14887e190691 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:53.380409 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95261c7e-f678-4b2d-ae37-14887e190691 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:53.400155 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:53.413517 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04bfffd-7f08-4fee-ab08-47277120e30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:53.414170 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04bfffd-7f08-4fee-ab08-47277120e30f None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:53.414448 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04bfffd-7f08-4fee-ab08-47277120e30f None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:53.414715 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04bfffd-7f08-4fee-ab08-47277120e30f None admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:53.415450 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04bfffd-7f08-4fee-ab08-47277120e30f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:53.415724 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04bfffd-7f08-4fee-ab08-47277120e30f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:53.417136 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04bfffd-7f08-4fee-ab08-47277120e30f None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:53.428684 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 255/512] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:53.429469 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04bfffd-7f08-4fee-ab08-47277120e30f None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:53.465637 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39c668-12b1-4290-a23c-bbc2c3d39917 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:53.486191 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:53.500382 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d48b2-c50a-4f02-aee3-144f100578d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:53.501052 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d48b2-c50a-4f02-aee3-144f100578d0 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:53.501336 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d48b2-c50a-4f02-aee3-144f100578d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:53.501612 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d48b2-c50a-4f02-aee3-144f100578d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:53.502352 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d48b2-c50a-4f02-aee3-144f100578d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:53.502660 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d48b2-c50a-4f02-aee3-144f100578d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:53.504034 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d48b2-c50a-4f02-aee3-144f100578d0 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:53.512009 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 258/513] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jun 3 13:02:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:53.517087 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d48b2-c50a-4f02-aee3-144f100578d0 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:53.530116 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04bfffd-7f08-4fee-ab08-47277120e30f None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:53.566399 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c977190-9f0e-4873-a746-d86d8912c887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:53.567036 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c977190-9f0e-4873-a746-d86d8912c887 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:53.567313 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c977190-9f0e-4873-a746-d86d8912c887 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:53.567596 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c977190-9f0e-4873-a746-d86d8912c887 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:53.612357 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:53.617781 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d48b2-c50a-4f02-aee3-144f100578d0 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:53.634211 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c977190-9f0e-4873-a746-d86d8912c887 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:53.635680 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c977190-9f0e-4873-a746-d86d8912c887 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:53.650051 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300e548-4680-4cd5-a44d-9eb8f5fb62cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:53.650833 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300e548-4680-4cd5-a44d-9eb8f5fb62cf None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:53.651110 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300e548-4680-4cd5-a44d-9eb8f5fb62cf None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:53.651382 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300e548-4680-4cd5-a44d-9eb8f5fb62cf None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:53.658909 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c300e548-4680-4cd5-a44d-9eb8f5fb62cf None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:53.660359 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c300e548-4680-4cd5-a44d-9eb8f5fb62cf None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:53.674692 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-c300e548-4680-4cd5-a44d-9eb8f5fb62cf None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 03 13:02:53.674692 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:53.674692 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:53.674692 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:53.674692 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:53.674692 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:53.674692 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:53.674692 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:53.674692 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:53.674692 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:53.674692 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:53.674692 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:53.674692 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 13:02:53.674692 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 13:02:53.674692 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 13:02:53.674692 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 13:02:53.675764 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:53.675764 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:53.675764 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 13:02:53.675764 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:02:53.675764 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 13:02:53.675764 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:02:53.675764 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:53.675764 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:53.675764 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:53.675764 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:53.675764 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:53.675764 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:53.675764 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:53.675764 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:53.675764 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:53.675764 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:53.675764 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:53.675764 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:53.681510 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:53.681510 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:53.681510 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 13:02:53.681510 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 13:02:53.681510 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 13:02:53.681510 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 13:02:53.681510 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 13:02:53.681510 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 13:02:53.681510 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 03 13:02:53.681510 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:02:53.681510 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 259/514] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:02:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:53.681510 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300e548-4680-4cd5-a44d-9eb8f5fb62cf None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:53.696939 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:53.743190 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 256/515] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:02:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:53.744030 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c977190-9f0e-4873-a746-d86d8912c887 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:53.779221 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300e548-4680-4cd5-a44d-9eb8f5fb62cf None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:53.812814 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724aa36-3671-4ae5-acfe-d484202fa2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:53.813479 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724aa36-3671-4ae5-acfe-d484202fa2a4 None admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:53.813760 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724aa36-3671-4ae5-acfe-d484202fa2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:53.814030 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724aa36-3671-4ae5-acfe-d484202fa2a4 None admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:53.814724 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9724aa36-3671-4ae5-acfe-d484202fa2a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:53.816167 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9724aa36-3671-4ae5-acfe-d484202fa2a4 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:53.841100 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c977190-9f0e-4873-a746-d86d8912c887 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:53.875041 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0fc5d-eafe-447c-9592-75858e8d503f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:53.875812 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0fc5d-eafe-447c-9592-75858e8d503f None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:53.876092 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0fc5d-eafe-447c-9592-75858e8d503f None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:53.876458 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0fc5d-eafe-447c-9592-75858e8d503f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:53.883112 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0fc5d-eafe-447c-9592-75858e8d503f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:53.884624 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0fc5d-eafe-447c-9592-75858e8d503f None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:53.899253 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-3ae0fc5d-eafe-447c-9592-75858e8d503f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:02:53.899253 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:53.899253 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:53.899253 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:53.899253 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:53.899253 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:53.899253 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:53.899253 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:53.899253 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:53.899253 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:53.899253 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:53.899253 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:53.899253 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 13:02:53.899253 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 13:02:53.899253 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 13:02:53.900318 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 13:02:53.900318 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:53.900318 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:53.900318 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:53.900318 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:53.900318 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:53.900318 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:53.900318 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:53.900318 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:53.900318 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:53.900318 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:53.900318 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:53.900318 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:53.900318 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:53.900318 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:53.900318 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:53.900318 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:53.907126 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 13:02:53.907126 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 13:02:53.907126 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 13:02:53.907126 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 13:02:53.907126 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 13:02:53.907126 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 13:02:53.907126 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:02:53.907126 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:02:53.907126 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 257/516] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:02:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:53.907126 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0fc5d-eafe-447c-9592-75858e8d503f None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:53.912181 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 260/517] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jun 3 13:02:53 2022] POST /identity/v3/users => generated 247 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:02:53.912181 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724aa36-3671-4ae5-acfe-d484202fa2a4 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:53.927933 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:53.934421 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:54.039547 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724aa36-3671-4ae5-acfe-d484202fa2a4 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:54.041197 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0fc5d-eafe-447c-9592-75858e8d503f None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:54.078802 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c9678-4a11-4e8c-93ca-fa7e25e14c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:54.079572 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c9678-4a11-4e8c-93ca-fa7e25e14c8c None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:54.079854 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c9678-4a11-4e8c-93ca-fa7e25e14c8c None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:54.080126 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c9678-4a11-4e8c-93ca-fa7e25e14c8c None admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:54.080506 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec47ac4-1324-4795-b3d3-8f4f4a48edfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:54.081007 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c9678-4a11-4e8c-93ca-fa7e25e14c8c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:54.081316 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c9678-4a11-4e8c-93ca-fa7e25e14c8c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:54.081411 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec47ac4-1324-4795-b3d3-8f4f4a48edfe None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:54.081597 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec47ac4-1324-4795-b3d3-8f4f4a48edfe None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:54.081871 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec47ac4-1324-4795-b3d3-8f4f4a48edfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:54.082783 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c9678-4a11-4e8c-93ca-fa7e25e14c8c None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:54.094065 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec47ac4-1324-4795-b3d3-8f4f4a48edfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:54.095569 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec47ac4-1324-4795-b3d3-8f4f4a48edfe None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:54.103412 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 261/518] 10.222.0.61 () {56 vars in 1137 bytes} [Fri Jun 3 13:02:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:54.104138 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c9678-4a11-4e8c-93ca-fa7e25e14c8c None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:54.115634 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-5ec47ac4-1324-4795-b3d3-8f4f4a48edfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:02:54.115634 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:54.115634 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:54.115634 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:54.115634 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:54.115634 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:54.115634 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:54.115634 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:54.115634 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:54.115634 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:54.115634 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:54.115634 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:54.115634 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:02:54.115634 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:02:54.115634 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:02:54.116654 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:02:54.116654 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:54.116654 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:54.116654 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:54.116654 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:54.116654 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:54.116654 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:54.116654 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:54.116654 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:54.116654 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:54.116654 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:54.116654 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:54.116654 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:54.116654 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:54.116654 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:54.116654 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:54.116654 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:54.117483 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:02:54.117483 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:02:54.117483 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:02:54.117483 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:02:54.120250 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 258/519] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:02:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:54.121776 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec47ac4-1324-4795-b3d3-8f4f4a48edfe None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:54.182031 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:54.197921 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:54.214838 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c9678-4a11-4e8c-93ca-fa7e25e14c8c None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:54.235763 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec47ac4-1324-4795-b3d3-8f4f4a48edfe None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:54.252014 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b6001-098c-421d-aa3c-f7f3836365ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:54.252917 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b6001-098c-421d-aa3c-f7f3836365ba None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:54.253135 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b6001-098c-421d-aa3c-f7f3836365ba None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:54.253410 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b6001-098c-421d-aa3c-f7f3836365ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:54.263500 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b6001-098c-421d-aa3c-f7f3836365ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:54.265562 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b6001-098c-421d-aa3c-f7f3836365ba None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:54.275557 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f202ea-e336-4030-aff2-7c5a8697690d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:54.276521 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f202ea-e336-4030-aff2-7c5a8697690d None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:54.276984 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f202ea-e336-4030-aff2-7c5a8697690d None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:54.277438 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f202ea-e336-4030-aff2-7c5a8697690d None admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:54.278392 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f202ea-e336-4030-aff2-7c5a8697690d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:54.278878 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f202ea-e336-4030-aff2-7c5a8697690d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:54.280572 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f202ea-e336-4030-aff2-7c5a8697690d None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:54.283470 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-ae2b6001-098c-421d-aa3c-f7f3836365ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:02:54.283470 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:54.283470 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:54.283470 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:54.283470 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:54.283470 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:54.283470 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:54.283470 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:54.283470 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:54.283470 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:54.283470 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:54.283470 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:54.283470 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:02:54.283470 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:02:54.283470 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:02:54.284327 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:02:54.284327 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:54.284327 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:54.284327 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:54.284327 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:54.284327 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:54.284327 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:54.284327 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:54.284327 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:54.284327 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:54.284327 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:54.284327 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:54.284327 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:54.284327 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:54.284327 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:54.284327 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:54.284327 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:54.285460 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:02:54.285460 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:02:54.285460 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:02:54.285460 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:02:54.285460 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 262/520] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:02:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:54.285934 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b6001-098c-421d-aa3c-f7f3836365ba None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:54.305476 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 259/521] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 13:02:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:54.306528 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f202ea-e336-4030-aff2-7c5a8697690d None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:54.394578 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b6001-098c-421d-aa3c-f7f3836365ba None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:54.413962 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f202ea-e336-4030-aff2-7c5a8697690d None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:54.418539 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:54.432457 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7f4a0-d4a0-491c-aa9e-d95db138072e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:54.433108 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7f4a0-d4a0-491c-aa9e-d95db138072e None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:54.433389 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7f4a0-d4a0-491c-aa9e-d95db138072e None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:54.433665 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7f4a0-d4a0-491c-aa9e-d95db138072e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:54.441804 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:54.450151 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807d878-f213-485c-bc30-80b00dc7bd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:54.450812 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807d878-f213-485c-bc30-80b00dc7bd91 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:54.451208 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807d878-f213-485c-bc30-80b00dc7bd91 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:54.451493 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807d878-f213-485c-bc30-80b00dc7bd91 None admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:54.452264 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807d878-f213-485c-bc30-80b00dc7bd91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:54.453161 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807d878-f213-485c-bc30-80b00dc7bd91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:54.454605 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807d878-f213-485c-bc30-80b00dc7bd91 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:54.466049 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 260/522] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:54.466876 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807d878-f213-485c-bc30-80b00dc7bd91 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:54.512588 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7f4a0-d4a0-491c-aa9e-d95db138072e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:54.513948 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7f4a0-d4a0-491c-aa9e-d95db138072e None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:54.568178 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807d878-f213-485c-bc30-80b00dc7bd91 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:54.609570 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc2bb1-674a-44d8-9819-0360b14f6451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:54.610584 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc2bb1-674a-44d8-9819-0360b14f6451 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:54.611059 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc2bb1-674a-44d8-9819-0360b14f6451 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:54.611337 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc2bb1-674a-44d8-9819-0360b14f6451 None admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:54.612056 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc2bb1-674a-44d8-9819-0360b14f6451 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:54.612386 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc2bb1-674a-44d8-9819-0360b14f6451 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:54.613775 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc2bb1-674a-44d8-9819-0360b14f6451 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:54.622288 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 263/523] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:02:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:54.623341 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7f4a0-d4a0-491c-aa9e-d95db138072e None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:54.625870 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 261/524] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:54.626683 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc2bb1-674a-44d8-9819-0360b14f6451 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:54.654478 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:54.681108 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:54.735582 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc2bb1-674a-44d8-9819-0360b14f6451 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:54.738404 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7f4a0-d4a0-491c-aa9e-d95db138072e None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:54.770319 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d31bf65-2baf-4abf-858a-f929ce8f45d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:54.771351 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31bf65-2baf-4abf-858a-f929ce8f45d2 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:54.771632 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31bf65-2baf-4abf-858a-f929ce8f45d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:54.771905 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31bf65-2baf-4abf-858a-f929ce8f45d2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:54.775303 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba795a6b-8468-4b09-b9e6-dc29ff88c1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:54.775963 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba795a6b-8468-4b09-b9e6-dc29ff88c1e9 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:54.776276 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba795a6b-8468-4b09-b9e6-dc29ff88c1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:54.776559 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba795a6b-8468-4b09-b9e6-dc29ff88c1e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:54.777388 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba795a6b-8468-4b09-b9e6-dc29ff88c1e9 None admin] RBAC: Adding query filter params (role.id=eb985092d5f14e92a783e26568bf457b, scope.project.id=c8c0bf799c9f451b8167a646a5c82eda, user.id=066aaba3e9af4f85ab0cba89a3d32e34) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:54.777704 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba795a6b-8468-4b09-b9e6-dc29ff88c1e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:54.779149 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba795a6b-8468-4b09-b9e6-dc29ff88c1e9 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:54.779604 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d31bf65-2baf-4abf-858a-f929ce8f45d2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:54.782133 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d31bf65-2baf-4abf-858a-f929ce8f45d2 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:54.796647 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 264/525] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 13:02:54 2022] GET /identity/v3/role_assignments?user.id=066aaba3e9af4f85ab0cba89a3d32e34&scope.project.id=c8c0bf799c9f451b8167a646a5c82eda&role.id=eb985092d5f14e92a783e26568bf457b => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:54.796647 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba795a6b-8468-4b09-b9e6-dc29ff88c1e9 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:54.806444 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-3d31bf65-2baf-4abf-858a-f929ce8f45d2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 03 13:02:54.806444 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:54.806444 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:54.806444 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:54.806444 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:54.806444 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:54.806444 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:54.806444 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:54.806444 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:54.806444 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:54.806444 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:54.806444 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:54.806444 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 13:02:54.806444 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 13:02:54.806444 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 13:02:54.806444 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 13:02:54.807584 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:54.807584 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:54.807584 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 13:02:54.807584 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:02:54.807584 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 13:02:54.807584 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:02:54.807584 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:54.807584 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:54.807584 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:54.807584 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:54.807584 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:54.807584 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:54.807584 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:54.807584 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:54.807584 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:54.807584 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:54.807584 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:54.807584 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:54.808818 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:54.808818 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:54.808818 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 13:02:54.808818 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 13:02:54.808818 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 13:02:54.808818 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 13:02:54.808818 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 13:02:54.808818 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 13:02:54.808818 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 03 13:02:54.808818 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:02:54.809718 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 262/526] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jun 3 13:02:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:54.815539 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d31bf65-2baf-4abf-858a-f929ce8f45d2 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:54.909751 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:54.926438 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba795a6b-8468-4b09-b9e6-dc29ff88c1e9 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:54.931960 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d31bf65-2baf-4abf-858a-f929ce8f45d2 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:54.942356 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:54.965615 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368dd1ab-9565-4af4-9f2c-dc8b667d7a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:54.966737 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368dd1ab-9565-4af4-9f2c-dc8b667d7a73 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:54.966737 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368dd1ab-9565-4af4-9f2c-dc8b667d7a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:54.967019 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368dd1ab-9565-4af4-9f2c-dc8b667d7a73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:54.973043 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8906a-cb20-4cd1-9e03-d2459ff2e17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:54.974179 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8906a-cb20-4cd1-9e03-d2459ff2e17f None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:54.974774 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8906a-cb20-4cd1-9e03-d2459ff2e17f None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:54.975049 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8906a-cb20-4cd1-9e03-d2459ff2e17f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:54.980004 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368dd1ab-9565-4af4-9f2c-dc8b667d7a73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:54.981564 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368dd1ab-9565-4af4-9f2c-dc8b667d7a73 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:54.983123 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8906a-cb20-4cd1-9e03-d2459ff2e17f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:54.985483 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8906a-cb20-4cd1-9e03-d2459ff2e17f None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:55.002892 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-368dd1ab-9565-4af4-9f2c-dc8b667d7a73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:02:55.002892 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:55.002892 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:55.002892 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:55.002892 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:55.002892 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:55.002892 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:55.002892 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:55.002892 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:55.002892 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:55.002892 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:55.002892 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:55.002892 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:02:55.002892 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:02:55.002892 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:02:55.003895 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:02:55.003895 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:55.003895 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:55.003895 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:55.003895 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:55.003895 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:55.003895 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:55.003895 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:55.003895 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:55.003895 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:55.003895 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:55.003895 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:55.003895 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:55.003895 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:55.003895 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:55.003895 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:55.003895 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:55.005047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:02:55.005047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:02:55.005047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:02:55.005047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:02:55.008808 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 265/527] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:02:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:55.009763 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368dd1ab-9565-4af4-9f2c-dc8b667d7a73 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:55.016003 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-2cc8906a-cb20-4cd1-9e03-d2459ff2e17f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:02:55.016003 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:55.016003 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:55.016003 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:55.016003 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:55.016003 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:55.016003 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:55.016003 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:55.016003 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:55.016003 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:55.016003 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:55.016003 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:55.016003 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 13:02:55.016003 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 13:02:55.016003 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 13:02:55.017548 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 13:02:55.017548 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:55.017548 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:55.017548 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:55.017548 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:55.017548 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:55.017548 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:55.017548 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:55.017548 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:55.017548 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:55.017548 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:55.017548 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:55.017548 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:55.017548 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:55.017548 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:55.017548 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:55.017548 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:55.019438 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 13:02:55.019438 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 13:02:55.019438 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 13:02:55.019438 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 13:02:55.019438 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 13:02:55.019438 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 13:02:55.019438 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:02:55.019438 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:02:55.019438 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 263/528] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:02:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:55.020681 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8906a-cb20-4cd1-9e03-d2459ff2e17f None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:55.118191 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368dd1ab-9565-4af4-9f2c-dc8b667d7a73 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:55.127976 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8906a-cb20-4cd1-9e03-d2459ff2e17f None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:55.153568 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb2035-0bc6-4787-b9d1-08bd7be71b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:55.154242 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb2035-0bc6-4787-b9d1-08bd7be71b09 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:55.154525 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb2035-0bc6-4787-b9d1-08bd7be71b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:55.154795 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb2035-0bc6-4787-b9d1-08bd7be71b09 None admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:55.156228 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affb2035-0bc6-4787-b9d1-08bd7be71b09 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:55.156540 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affb2035-0bc6-4787-b9d1-08bd7be71b09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:55.157969 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affb2035-0bc6-4787-b9d1-08bd7be71b09 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:55.164682 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab851cab-2c33-40d7-8a01-89d72ced01f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:55.165345 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab851cab-2c33-40d7-8a01-89d72ced01f6 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:55.165625 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab851cab-2c33-40d7-8a01-89d72ced01f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:55.165897 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab851cab-2c33-40d7-8a01-89d72ced01f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:55.166617 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab851cab-2c33-40d7-8a01-89d72ced01f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:55.166801 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:55.166967 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab851cab-2c33-40d7-8a01-89d72ced01f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:55.168398 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab851cab-2c33-40d7-8a01-89d72ced01f6 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:55.178454 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 266/529] 10.222.0.61 () {56 vars in 1139 bytes} [Fri Jun 3 13:02:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:55.179313 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb2035-0bc6-4787-b9d1-08bd7be71b09 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:55.188251 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 264/530] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:55.189151 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab851cab-2c33-40d7-8a01-89d72ced01f6 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:55.227790 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:55.322547 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab851cab-2c33-40d7-8a01-89d72ced01f6 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:55.323740 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb2035-0bc6-4787-b9d1-08bd7be71b09 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:55.360854 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5083ec-954f-44fe-a141-ce97ae3735d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:55.361886 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5083ec-954f-44fe-a141-ce97ae3735d1 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:55.362468 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5083ec-954f-44fe-a141-ce97ae3735d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:55.362938 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5083ec-954f-44fe-a141-ce97ae3735d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:55.365647 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0abf86-e437-4622-a700-11b823f22362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:55.366413 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0abf86-e437-4622-a700-11b823f22362 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:55.366701 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0abf86-e437-4622-a700-11b823f22362 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:55.366977 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0abf86-e437-4622-a700-11b823f22362 None admin] PATH_INFO: `/v3/projects` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:55.368177 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0abf86-e437-4622-a700-11b823f22362 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:55.368177 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0abf86-e437-4622-a700-11b823f22362 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:55.369669 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0abf86-e437-4622-a700-11b823f22362 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:55.389594 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 267/531] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 13:02:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:55.390731 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0abf86-e437-4622-a700-11b823f22362 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:55.439380 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5083ec-954f-44fe-a141-ce97ae3735d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:55.441401 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5083ec-954f-44fe-a141-ce97ae3735d1 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:55.451319 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:55.470566 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:55.498028 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0abf86-e437-4622-a700-11b823f22362 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:55.534798 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77031a4-525e-422f-8a84-12aa2c70a0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:55.538022 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77031a4-525e-422f-8a84-12aa2c70a0bc None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:55.538457 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77031a4-525e-422f-8a84-12aa2c70a0bc None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:55.538877 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77031a4-525e-422f-8a84-12aa2c70a0bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:55.547026 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77031a4-525e-422f-8a84-12aa2c70a0bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:55.547317 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 265/532] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:02:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:55.549002 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77031a4-525e-422f-8a84-12aa2c70a0bc None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:55.552709 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5083ec-954f-44fe-a141-ce97ae3735d1 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:55.567066 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-b77031a4-525e-422f-8a84-12aa2c70a0bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:02:55.567066 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:55.567066 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:55.567066 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:55.567066 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:55.567066 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:55.567066 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:55.567066 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:55.567066 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:55.567066 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:55.567066 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:55.567066 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:55.567066 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 13:02:55.567066 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 13:02:55.567066 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 13:02:55.568255 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 13:02:55.568255 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:55.568255 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:55.568255 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:55.568255 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:55.568255 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:55.568255 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:55.568255 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:55.568255 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:55.568255 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:55.568255 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:55.568255 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:55.568255 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:55.568255 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:55.568255 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:55.568255 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:55.568255 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:55.569291 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 13:02:55.569291 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 13:02:55.569291 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 13:02:55.569291 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 13:02:55.569291 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 13:02:55.569291 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 13:02:55.569291 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:02:55.569291 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:02:55.575972 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 268/533] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:02:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:55.577201 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77031a4-525e-422f-8a84-12aa2c70a0bc None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:55.682981 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5083ec-954f-44fe-a141-ce97ae3735d1 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:55.697167 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77031a4-525e-422f-8a84-12aa2c70a0bc None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:55.717570 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:55.717739 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:55.728137 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc3480-86fd-4436-a016-5bcf10ce1ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:55.729264 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc3480-86fd-4436-a016-5bcf10ce1ba7 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:55.729424 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc3480-86fd-4436-a016-5bcf10ce1ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:55.729683 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc3480-86fd-4436-a016-5bcf10ce1ba7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:55.730679 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc3480-86fd-4436-a016-5bcf10ce1ba7 None admin] RBAC: Adding query filter params (role.id=eb985092d5f14e92a783e26568bf457b, scope.project.id=c8c0bf799c9f451b8167a646a5c82eda, user.id=60eeb0b3e37a4604ab8f8b73c2b021f9) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:55.730994 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc3480-86fd-4436-a016-5bcf10ce1ba7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:55.735586 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc3480-86fd-4436-a016-5bcf10ce1ba7 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:55.742512 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2997a-17cd-40e5-b2f2-2765406f6ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:55.742744 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 266/534] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 13:02:55 2022] GET /identity/v3/role_assignments?user.id=60eeb0b3e37a4604ab8f8b73c2b021f9&scope.project.id=c8c0bf799c9f451b8167a646a5c82eda&role.id=eb985092d5f14e92a783e26568bf457b => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:55.743654 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc3480-86fd-4436-a016-5bcf10ce1ba7 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:55.744438 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2997a-17cd-40e5-b2f2-2765406f6ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:55.744897 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2997a-17cd-40e5-b2f2-2765406f6ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:55.745345 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2997a-17cd-40e5-b2f2-2765406f6ba9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:55.760595 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc2997a-17cd-40e5-b2f2-2765406f6ba9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:55.762387 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc2997a-17cd-40e5-b2f2-2765406f6ba9 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:55.801154 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-4bc2997a-17cd-40e5-b2f2-2765406f6ba9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:02:55.801154 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:55.801154 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:55.801154 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:55.801154 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:55.801154 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:55.801154 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:55.801154 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:55.801154 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:55.801154 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:55.801154 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:55.801154 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:55.801154 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:02:55.801154 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:02:55.801154 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:02:55.802092 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:02:55.802092 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:55.802092 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:55.802092 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:55.802092 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:55.802092 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:55.802092 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:55.802092 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:55.802092 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:55.802092 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:55.802092 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:55.802092 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:55.802092 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:55.802092 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:55.802092 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:55.802092 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:55.802092 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:55.802937 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:02:55.802937 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:02:55.802937 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:02:55.802937 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:02:55.812993 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 269/535] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:02:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:55.818814 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2997a-17cd-40e5-b2f2-2765406f6ba9 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:55.979738 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc3480-86fd-4436-a016-5bcf10ce1ba7 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:56.022685 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2997a-17cd-40e5-b2f2-2765406f6ba9 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:56.039317 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d5f0c-469e-4493-8530-28152ddc20b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:56.041334 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d5f0c-469e-4493-8530-28152ddc20b9 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:56.042203 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d5f0c-469e-4493-8530-28152ddc20b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:56.043925 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d5f0c-469e-4493-8530-28152ddc20b9 None admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:56.045238 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151d5f0c-469e-4493-8530-28152ddc20b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:56.045719 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151d5f0c-469e-4493-8530-28152ddc20b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:56.048123 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151d5f0c-469e-4493-8530-28152ddc20b9 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:56.079403 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 267/536] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 13:02:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:56.083570 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d5f0c-469e-4493-8530-28152ddc20b9 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:56.092421 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434bcf72-0edd-4670-bc1c-bd8e02d4611d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:56.093886 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434bcf72-0edd-4670-bc1c-bd8e02d4611d None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:56.096032 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434bcf72-0edd-4670-bc1c-bd8e02d4611d None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:56.096507 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434bcf72-0edd-4670-bc1c-bd8e02d4611d None admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:56.098812 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434bcf72-0edd-4670-bc1c-bd8e02d4611d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:56.099272 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434bcf72-0edd-4670-bc1c-bd8e02d4611d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:56.100864 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434bcf72-0edd-4670-bc1c-bd8e02d4611d None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:56.128396 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 270/537] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:56.133846 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434bcf72-0edd-4670-bc1c-bd8e02d4611d None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:56.178897 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:56.207505 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:56.282100 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434bcf72-0edd-4670-bc1c-bd8e02d4611d None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:56.315364 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d5f0c-469e-4493-8530-28152ddc20b9 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:56.324259 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df2b4f-a35d-4814-9782-2dc7279d5e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:56.325061 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df2b4f-a35d-4814-9782-2dc7279d5e83 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:56.325453 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df2b4f-a35d-4814-9782-2dc7279d5e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:56.325732 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df2b4f-a35d-4814-9782-2dc7279d5e83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:56.333609 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df2b4f-a35d-4814-9782-2dc7279d5e83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:56.335051 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df2b4f-a35d-4814-9782-2dc7279d5e83 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:56.349830 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-81df2b4f-a35d-4814-9782-2dc7279d5e83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:02:56.349830 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:56.349830 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:56.349830 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:56.349830 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:56.349830 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:56.349830 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:56.349830 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:56.349830 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:56.349830 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:56.349830 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:56.349830 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:56.349830 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 13:02:56.349830 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 13:02:56.349830 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 13:02:56.350686 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 13:02:56.350686 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:56.350686 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:56.350686 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:56.350686 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:56.350686 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:56.350686 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:56.350686 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:56.350686 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:56.350686 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:56.350686 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:56.350686 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:56.350686 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:56.350686 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:56.350686 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:56.350686 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:56.350686 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:56.351526 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 13:02:56.351526 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 13:02:56.351526 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 13:02:56.351526 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 13:02:56.351526 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 13:02:56.351526 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 13:02:56.351526 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:02:56.351526 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:02:56.351526 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 271/538] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:02:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:56.352724 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce654bd5-455d-4c83-951e-bbca64fedf00 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:56.353011 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce654bd5-455d-4c83-951e-bbca64fedf00 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:56.353289 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce654bd5-455d-4c83-951e-bbca64fedf00 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:56.354834 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 272/539] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:56.356473 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce654bd5-455d-4c83-951e-bbca64fedf00 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:56.364630 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261428dd-d294-4144-a4a6-197601e95f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:56.365382 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261428dd-d294-4144-a4a6-197601e95f4f None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:56.365729 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261428dd-d294-4144-a4a6-197601e95f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:56.366069 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261428dd-d294-4144-a4a6-197601e95f4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:56.366972 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261428dd-d294-4144-a4a6-197601e95f4f None admin] RBAC: Adding query filter params (role.id=eb985092d5f14e92a783e26568bf457b, scope.project.id=c8c0bf799c9f451b8167a646a5c82eda, user.id=303176c26fc74d4892b2f83c81f01b60) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:56.367864 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261428dd-d294-4144-a4a6-197601e95f4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:56.369895 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261428dd-d294-4144-a4a6-197601e95f4f None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:56.378662 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 268/540] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 13:02:56 2022] GET /identity/v3/role_assignments?user.id=303176c26fc74d4892b2f83c81f01b60&scope.project.id=c8c0bf799c9f451b8167a646a5c82eda&role.id=eb985092d5f14e92a783e26568bf457b => generated 259 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:56.380539 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd9360-e7b5-460c-b10e-c2edbf9f9b82 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:56.380908 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd9360-e7b5-460c-b10e-c2edbf9f9b82 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:56.381249 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd9360-e7b5-460c-b10e-c2edbf9f9b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:56.418636 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-8edd9360-e7b5-460c-b10e-c2edbf9f9b82 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:56.419869 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-8edd9360-e7b5-460c-b10e-c2edbf9f9b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:56.550262 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:56.560417 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 269/541] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:02:56.588903 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd9360-e7b5-460c-b10e-c2edbf9f9b82 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:56.590568 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce654bd5-455d-4c83-951e-bbca64fedf00 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:56.648662 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:56.697151 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646504d-4c80-4c1f-992b-476a1783d706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:56.697844 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646504d-4c80-4c1f-992b-476a1783d706 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:56.698427 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646504d-4c80-4c1f-992b-476a1783d706 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:56.698427 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646504d-4c80-4c1f-992b-476a1783d706 None admin] PATH_INFO: `/v3/projects` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:56.699174 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4646504d-4c80-4c1f-992b-476a1783d706 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:56.699482 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4646504d-4c80-4c1f-992b-476a1783d706 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:56.701019 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4646504d-4c80-4c1f-992b-476a1783d706 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:56.709103 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd9360-e7b5-460c-b10e-c2edbf9f9b82 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:56.732657 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 273/542] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 13:02:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:02:56.739403 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646504d-4c80-4c1f-992b-476a1783d706 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:56.748311 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81794de1-75c5-4e07-aa2c-8b25434ddce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:56.751102 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81794de1-75c5-4e07-aa2c-8b25434ddce6 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:56.751560 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81794de1-75c5-4e07-aa2c-8b25434ddce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:56.751973 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81794de1-75c5-4e07-aa2c-8b25434ddce6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:56.764194 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81794de1-75c5-4e07-aa2c-8b25434ddce6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:02:56.777117 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-81794de1-75c5-4e07-aa2c-8b25434ddce6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 13:02:56.777117 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:56.777117 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:56.777117 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:56.777117 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:56.777117 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:56.777117 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:56.777117 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:56.777117 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:56.777117 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:56.777117 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:56.777117 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:56.777117 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:02:56.777117 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:02:56.777117 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:02:56.777117 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:02:56.778217 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:02:56.778217 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:02:56.778217 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:02:56.778217 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:02:56.778217 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:56.778217 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:56.778217 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:56.778217 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:56.778217 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:56.778217 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:56.778217 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:56.778217 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:56.778217 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:56.778217 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:56.778217 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:56.778217 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:56.779186 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:56.779186 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:56.779186 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:56.779186 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:56.779186 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:02:56.779186 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:02:56.779186 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:02:56.779186 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:02:56.779186 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:02:56.779186 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:02:56.779186 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 13:02:56.779186 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:02:56.783106 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 270/543] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jun 3 13:02:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:02:56.789079 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81794de1-75c5-4e07-aa2c-8b25434ddce6 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:56.897429 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81794de1-75c5-4e07-aa2c-8b25434ddce6 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:56.909514 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:56.939169 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194640ae-a79e-4513-abb5-3bddf4a2bced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:56.940961 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194640ae-a79e-4513-abb5-3bddf4a2bced None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:56.940961 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194640ae-a79e-4513-abb5-3bddf4a2bced None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:56.940961 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194640ae-a79e-4513-abb5-3bddf4a2bced None admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:56.941958 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194640ae-a79e-4513-abb5-3bddf4a2bced None admin] RBAC: Adding query filter params (name=service) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:56.942416 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194640ae-a79e-4513-abb5-3bddf4a2bced None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:56.943983 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194640ae-a79e-4513-abb5-3bddf4a2bced None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:56.954595 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 271/544] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jun 3 13:02:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:56.961903 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194640ae-a79e-4513-abb5-3bddf4a2bced None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:56.970755 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646504d-4c80-4c1f-992b-476a1783d706 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:57.050163 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b3afc4-8d63-4239-a8ae-9f2fde427d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:57.050843 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3afc4-8d63-4239-a8ae-9f2fde427d3b None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:57.051123 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3afc4-8d63-4239-a8ae-9f2fde427d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:57.051393 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3afc4-8d63-4239-a8ae-9f2fde427d3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:57.052268 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b3afc4-8d63-4239-a8ae-9f2fde427d3b None admin] RBAC: Adding query filter params (role.id=eb985092d5f14e92a783e26568bf457b, scope.project.id=c8c0bf799c9f451b8167a646a5c82eda, user.id=bdb5b24bd01c405c93e32ab4b329bcf1) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:57.052577 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b3afc4-8d63-4239-a8ae-9f2fde427d3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:57.054080 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b3afc4-8d63-4239-a8ae-9f2fde427d3b None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:57.071304 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 274/545] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 13:02:56 2022] GET /identity/v3/role_assignments?user.id=bdb5b24bd01c405c93e32ab4b329bcf1&scope.project.id=c8c0bf799c9f451b8167a646a5c82eda&role.id=eb985092d5f14e92a783e26568bf457b => generated 259 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:57.121844 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194640ae-a79e-4513-abb5-3bddf4a2bced None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:57.159567 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e95b3-2e4c-4759-9d3a-32848d58848f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:57.160331 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e95b3-2e4c-4759-9d3a-32848d58848f None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:57.160614 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e95b3-2e4c-4759-9d3a-32848d58848f None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:57.160889 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e95b3-2e4c-4759-9d3a-32848d58848f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:57.175208 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48e95b3-2e4c-4759-9d3a-32848d58848f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:57.176804 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48e95b3-2e4c-4759-9d3a-32848d58848f None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:57.196034 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-d48e95b3-2e4c-4759-9d3a-32848d58848f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:02:57.196034 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:57.196034 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:57.196034 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:57.196034 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:57.196034 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:57.196034 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:57.196034 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:57.196034 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:57.196034 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:57.196034 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:57.196034 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:57.196034 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:02:57.196034 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:02:57.196034 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:02:57.197023 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:02:57.197023 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:57.197023 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:57.197023 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:57.197023 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:57.197023 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:57.197023 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:57.197023 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:57.197023 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:57.197023 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:57.197023 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:57.197023 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:57.197023 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:57.197023 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:57.197023 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:57.197023 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:57.197023 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:57.197902 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:02:57.197902 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:02:57.197902 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:02:57.197902 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:02:57.197902 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 272/546] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:02:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:57.203998 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b3afc4-8d63-4239-a8ae-9f2fde427d3b None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:57.229477 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:57.276068 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e403d69-ec9e-4260-95e1-8f46be3cae68 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:57.276423 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e403d69-ec9e-4260-95e1-8f46be3cae68 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:57.276934 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e403d69-ec9e-4260-95e1-8f46be3cae68 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:57.278262 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 273/547] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 13:02:57.291004 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbcf98-3ae3-48f9-b6c7-63aad91c7ff5 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:57.291354 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbcf98-3ae3-48f9-b6c7-63aad91c7ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:57.293000 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbcf98-3ae3-48f9-b6c7-63aad91c7ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:57.356178 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-3ebbcf98-3ae3-48f9-b6c7-63aad91c7ff5 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:57.356178 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-3ebbcf98-3ae3-48f9-b6c7-63aad91c7ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:57.393750 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:57.470502 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 274/548] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:02:57.511844 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebbcf98-3ae3-48f9-b6c7-63aad91c7ff5 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:57.526944 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b3afc4-8d63-4239-a8ae-9f2fde427d3b None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:57.668195 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb816a-33a6-4ce5-abbe-5d7f602d1977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:57.668195 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb816a-33a6-4ce5-abbe-5d7f602d1977 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:57.668195 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb816a-33a6-4ce5-abbe-5d7f602d1977 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:57.668195 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb816a-33a6-4ce5-abbe-5d7f602d1977 None admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:57.672170 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb816a-33a6-4ce5-abbe-5d7f602d1977 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:57.672170 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb816a-33a6-4ce5-abbe-5d7f602d1977 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:57.674250 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb816a-33a6-4ce5-abbe-5d7f602d1977 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:57.696516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 275/549] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 492 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:02:57.702764 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb816a-33a6-4ce5-abbe-5d7f602d1977 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:57.712118 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebbcf98-3ae3-48f9-b6c7-63aad91c7ff5 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:57.783380 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2eb82-3b8f-4a3e-a932-3435ebcd02f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:57.786034 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2eb82-3b8f-4a3e-a932-3435ebcd02f4 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:57.786313 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2eb82-3b8f-4a3e-a932-3435ebcd02f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:57.786584 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2eb82-3b8f-4a3e-a932-3435ebcd02f4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:57.809992 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba2eb82-3b8f-4a3e-a932-3435ebcd02f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:02:57.818299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-4ba2eb82-3b8f-4a3e-a932-3435ebcd02f4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 13:02:57.818299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:57.818299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:57.818299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:57.818299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:57.818299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:57.818299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:57.818299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:57.818299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:57.818299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:57.818299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:57.818299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:57.818299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:02:57.818299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:02:57.818299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:02:57.818299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:02:57.819218 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:02:57.819218 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:02:57.819218 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:02:57.819218 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:02:57.819218 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:57.819218 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:57.819218 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:57.819218 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:57.819218 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:57.819218 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:57.819218 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:57.819218 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:57.819218 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:57.819218 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:57.819218 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:57.819218 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:57.820069 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:57.820069 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:57.820069 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:57.820069 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:57.820069 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:02:57.820069 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:02:57.820069 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:02:57.820069 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:02:57.820069 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:02:57.820069 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:02:57.820069 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 13:02:57.820069 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:02:57.824814 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:57.828590 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 275/550] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jun 3 13:02:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:57.836880 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2eb82-3b8f-4a3e-a932-3435ebcd02f4 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:57.858976 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:57.891466 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb816a-33a6-4ce5-abbe-5d7f602d1977 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:57.976877 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b4796-778e-4873-885c-f925f8f53b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:57.977697 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b4796-778e-4873-885c-f925f8f53b47 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:57.978038 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b4796-778e-4873-885c-f925f8f53b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:57.978234 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b4796-778e-4873-885c-f925f8f53b47 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:57.983435 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2eb82-3b8f-4a3e-a932-3435ebcd02f4 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:57.996984 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b4796-778e-4873-885c-f925f8f53b47 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:57.998435 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b4796-778e-4873-885c-f925f8f53b47 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:58.021583 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfda1f-7f4e-41b7-b2fd-2e65d0b3f3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:58.022300 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfda1f-7f4e-41b7-b2fd-2e65d0b3f3e3 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:58.022591 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfda1f-7f4e-41b7-b2fd-2e65d0b3f3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:58.022870 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfda1f-7f4e-41b7-b2fd-2e65d0b3f3e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:58.023621 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcfda1f-7f4e-41b7-b2fd-2e65d0b3f3e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:58.023933 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcfda1f-7f4e-41b7-b2fd-2e65d0b3f3e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:58.025418 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcfda1f-7f4e-41b7-b2fd-2e65d0b3f3e3 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:58.035607 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 276/551] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jun 3 13:02:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:02:58.040942 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-994b4796-778e-4873-885c-f925f8f53b47 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 03 13:02:58.040942 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:58.040942 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:58.040942 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:58.040942 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:58.040942 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:58.040942 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:58.040942 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:58.040942 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:58.040942 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:58.040942 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:58.040942 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:58.040942 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 13:02:58.040942 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 13:02:58.040942 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 13:02:58.040942 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 13:02:58.041838 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:58.041838 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:58.041838 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 13:02:58.041838 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:02:58.041838 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 13:02:58.041838 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:02:58.041838 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:58.041838 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:58.041838 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:58.041838 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:58.041838 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:58.041838 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:58.041838 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:58.041838 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:58.041838 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:58.041838 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:58.041838 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:58.041838 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:58.042765 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:58.042765 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:58.042765 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 13:02:58.042765 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 13:02:58.042765 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 13:02:58.042765 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 13:02:58.042765 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 13:02:58.042765 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 13:02:58.042765 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 03 13:02:58.042765 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:02:58.042765 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 276/552] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 13:02:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:58.045151 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfda1f-7f4e-41b7-b2fd-2e65d0b3f3e3 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:58.053171 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b4796-778e-4873-885c-f925f8f53b47 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:58.121127 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:58.152485 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfda1f-7f4e-41b7-b2fd-2e65d0b3f3e3 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:58.189228 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2420ab9-e86e-4b1e-b645-e40d653eb406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:58.190029 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2420ab9-e86e-4b1e-b645-e40d653eb406 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:58.190312 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2420ab9-e86e-4b1e-b645-e40d653eb406 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:58.190588 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2420ab9-e86e-4b1e-b645-e40d653eb406 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:58.207608 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2420ab9-e86e-4b1e-b645-e40d653eb406 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:58.209129 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2420ab9-e86e-4b1e-b645-e40d653eb406 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:58.228829 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-c2420ab9-e86e-4b1e-b645-e40d653eb406 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:02:58.228829 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:58.228829 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:58.228829 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:58.228829 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:58.228829 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:58.228829 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:58.228829 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:58.228829 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:58.228829 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:58.228829 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:58.228829 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:58.228829 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:02:58.228829 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:02:58.228829 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:02:58.229781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:02:58.229781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:58.229781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:58.229781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:58.229781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:58.229781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:58.229781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:58.229781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:58.229781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:58.229781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:58.229781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:58.229781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:58.229781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:58.229781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:58.229781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:58.229781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:58.229781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:58.230656 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:02:58.230656 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:02:58.230656 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:02:58.230656 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:02:58.230656 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 277/553] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:02:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:58.236879 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2420ab9-e86e-4b1e-b645-e40d653eb406 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:58.318457 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b4796-778e-4873-885c-f925f8f53b47 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:58.341274 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2420ab9-e86e-4b1e-b645-e40d653eb406 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:58.366196 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:58.376649 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:58.377027 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9744b-81ff-496d-a08f-17b357fae686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:58.377689 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9744b-81ff-496d-a08f-17b357fae686 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:58.382937 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9744b-81ff-496d-a08f-17b357fae686 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:58.382937 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9744b-81ff-496d-a08f-17b357fae686 None admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:58.382937 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b9744b-81ff-496d-a08f-17b357fae686 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:58.382937 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b9744b-81ff-496d-a08f-17b357fae686 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:58.382937 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b9744b-81ff-496d-a08f-17b357fae686 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:58.387097 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9473bea5-bcfd-4adb-bc46-afea2f889008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:58.388071 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473bea5-bcfd-4adb-bc46-afea2f889008 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:58.388573 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473bea5-bcfd-4adb-bc46-afea2f889008 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:58.389021 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473bea5-bcfd-4adb-bc46-afea2f889008 None admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:58.390564 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9473bea5-bcfd-4adb-bc46-afea2f889008 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:58.391050 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9473bea5-bcfd-4adb-bc46-afea2f889008 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:58.392700 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9473bea5-bcfd-4adb-bc46-afea2f889008 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:58.393727 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 278/554] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:02:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:02:58.399290 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9744b-81ff-496d-a08f-17b357fae686 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:58.427829 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 277/555] 10.222.0.61 () {56 vars in 1135 bytes} [Fri Jun 3 13:02:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:58.433303 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9473bea5-bcfd-4adb-bc46-afea2f889008 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:58.526046 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9744b-81ff-496d-a08f-17b357fae686 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:58.584674 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7694e1-cb70-417a-8b22-0be8b3662213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:58.585924 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7694e1-cb70-417a-8b22-0be8b3662213 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:58.586304 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7694e1-cb70-417a-8b22-0be8b3662213 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:58.586588 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7694e1-cb70-417a-8b22-0be8b3662213 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:58.596597 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7694e1-cb70-417a-8b22-0be8b3662213 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:58.598906 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7694e1-cb70-417a-8b22-0be8b3662213 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:58.621170 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-fd7694e1-cb70-417a-8b22-0be8b3662213 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 13:02:58.621170 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:58.621170 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:58.621170 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:58.621170 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:58.621170 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:58.621170 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:58.621170 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:58.621170 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:58.621170 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:58.621170 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:58.621170 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:58.621170 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 13:02:58.621170 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 13:02:58.621170 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 13:02:58.621170 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 13:02:58.622157 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:58.622157 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:58.622157 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 13:02:58.622157 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:02:58.622157 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 13:02:58.622157 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:02:58.622157 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:58.622157 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:58.622157 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:58.622157 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:58.622157 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:58.622157 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:58.622157 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:58.622157 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:58.622157 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:58.622157 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:58.622157 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:58.622157 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:58.623563 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:58.623563 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:58.623563 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 13:02:58.623563 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 13:02:58.623563 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 13:02:58.623563 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 13:02:58.623563 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 13:02:58.623563 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 13:02:58.623563 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 13:02:58.623563 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:02:58.623563 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 279/556] 10.222.0.61 () {56 vars in 1093 bytes} [Fri Jun 3 13:02:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:58.624243 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f939d-29ed-4b6b-9358-e06e03835812 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:58.624243 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f939d-29ed-4b6b-9358-e06e03835812 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:58.628007 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9473bea5-bcfd-4adb-bc46-afea2f889008 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:58.629208 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f939d-29ed-4b6b-9358-e06e03835812 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:58.630957 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 280/557] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:58.631805 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f939d-29ed-4b6b-9358-e06e03835812 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:58.666346 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf84f73-eabf-4e34-a0e6-7aac1d75ea5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:58.667001 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf84f73-eabf-4e34-a0e6-7aac1d75ea5b None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:58.667283 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf84f73-eabf-4e34-a0e6-7aac1d75ea5b None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:58.667560 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf84f73-eabf-4e34-a0e6-7aac1d75ea5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:58.683193 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:58.744233 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:58.745060 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f939d-29ed-4b6b-9358-e06e03835812 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:58.761603 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf84f73-eabf-4e34-a0e6-7aac1d75ea5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:58.764363 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf84f73-eabf-4e34-a0e6-7aac1d75ea5b None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:58.788186 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca946733-c593-463a-a6de-9fc7d9be9ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:58.788904 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca946733-c593-463a-a6de-9fc7d9be9ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:58.789112 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca946733-c593-463a-a6de-9fc7d9be9ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:58.789401 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca946733-c593-463a-a6de-9fc7d9be9ae1 None admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:58.790294 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca946733-c593-463a-a6de-9fc7d9be9ae1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:58.790542 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca946733-c593-463a-a6de-9fc7d9be9ae1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:58.792296 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca946733-c593-463a-a6de-9fc7d9be9ae1 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:58.817787 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 281/558] 10.222.0.61 () {56 vars in 1133 bytes} [Fri Jun 3 13:02:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:58.819155 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173b8de-a5e6-4692-bb9d-0e4ac4fa11ab None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:58.819450 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173b8de-a5e6-4692-bb9d-0e4ac4fa11ab None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:58.819727 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173b8de-a5e6-4692-bb9d-0e4ac4fa11ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:58.837843 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-1173b8de-a5e6-4692-bb9d-0e4ac4fa11ab None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:58.839071 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-1173b8de-a5e6-4692-bb9d-0e4ac4fa11ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:58.903950 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 278/559] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:02:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 03 13:02:58.904679 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf84f73-eabf-4e34-a0e6-7aac1d75ea5b None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:58.925705 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 282/560] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:02:58.930935 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1173b8de-a5e6-4692-bb9d-0e4ac4fa11ab None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:58.969933 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:59.028546 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:59.040298 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf84f73-eabf-4e34-a0e6-7aac1d75ea5b None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:59.054689 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1173b8de-a5e6-4692-bb9d-0e4ac4fa11ab None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:59.080756 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136555f6-bc33-4fe8-a3a2-45ebf86586f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:59.081962 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136555f6-bc33-4fe8-a3a2-45ebf86586f1 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:59.082495 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136555f6-bc33-4fe8-a3a2-45ebf86586f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:59.083143 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136555f6-bc33-4fe8-a3a2-45ebf86586f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:59.092495 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f7a70d-53be-49f2-b357-a252fcbb8f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:59.093396 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7a70d-53be-49f2-b357-a252fcbb8f5c None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:59.093679 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7a70d-53be-49f2-b357-a252fcbb8f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:59.093947 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7a70d-53be-49f2-b357-a252fcbb8f5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:59.096014 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136555f6-bc33-4fe8-a3a2-45ebf86586f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:59.098073 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136555f6-bc33-4fe8-a3a2-45ebf86586f1 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:59.105258 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f7a70d-53be-49f2-b357-a252fcbb8f5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:59.106406 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f7a70d-53be-49f2-b357-a252fcbb8f5c None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:59.118646 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-136555f6-bc33-4fe8-a3a2-45ebf86586f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:02:59.118646 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:59.118646 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:59.118646 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:59.118646 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:59.118646 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:59.118646 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:59.118646 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:59.118646 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:59.118646 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:59.118646 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:59.118646 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:59.118646 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:02:59.118646 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:02:59.118646 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:02:59.119592 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:02:59.119592 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:59.119592 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:59.119592 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:59.119592 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:59.119592 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:59.119592 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:59.119592 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:59.119592 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:59.119592 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:59.119592 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:59.119592 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:59.119592 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:59.119592 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:59.119592 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:59.119592 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:59.119592 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:59.120551 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:02:59.120551 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:02:59.120551 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:02:59.120551 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:02:59.121307 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 279/561] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:02:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:59.122306 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136555f6-bc33-4fe8-a3a2-45ebf86586f1 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:59.126009 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-69f7a70d-53be-49f2-b357-a252fcbb8f5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:02:59.126009 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:59.126009 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:59.126009 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:59.126009 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:59.126009 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:59.126009 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:59.126009 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:59.126009 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:59.126009 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:59.126009 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:59.126009 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:59.126009 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:02:59.126009 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:02:59.126009 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:02:59.127143 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:02:59.127143 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:59.127143 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:59.127143 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:59.127143 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:59.127143 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:59.127143 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:59.127143 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:59.127143 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:59.127143 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:59.127143 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:59.127143 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:59.127143 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:59.127143 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:59.127143 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:59.127143 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:59.127143 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:59.128053 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:02:59.128053 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:02:59.128053 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:02:59.128053 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:02:59.128053 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 283/562] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:02:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:59.128533 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37410ab0-cae5-409d-a169-6bcf4a2bc5e8 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:59.128880 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37410ab0-cae5-409d-a169-6bcf4a2bc5e8 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:59.129160 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37410ab0-cae5-409d-a169-6bcf4a2bc5e8 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:59.134303 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 284/563] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:59.134303 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37410ab0-cae5-409d-a169-6bcf4a2bc5e8 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:59.224694 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:59.241491 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136555f6-bc33-4fe8-a3a2-45ebf86586f1 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:59.242910 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37410ab0-cae5-409d-a169-6bcf4a2bc5e8 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:59.278486 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c17ff-7837-480f-97a5-1761517dca98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:59.279284 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c17ff-7837-480f-97a5-1761517dca98 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:59.279568 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c17ff-7837-480f-97a5-1761517dca98 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:59.279845 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c17ff-7837-480f-97a5-1761517dca98 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:59.284372 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aec453-0054-4d08-8657-698d5b00fe83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:59.285038 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aec453-0054-4d08-8657-698d5b00fe83 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:59.285342 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aec453-0054-4d08-8657-698d5b00fe83 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:59.285614 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aec453-0054-4d08-8657-698d5b00fe83 None admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:59.286303 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aec453-0054-4d08-8657-698d5b00fe83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:59.286611 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aec453-0054-4d08-8657-698d5b00fe83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:59.288016 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aec453-0054-4d08-8657-698d5b00fe83 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:59.291124 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c17ff-7837-480f-97a5-1761517dca98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:02:59.299881 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-2e8c17ff-7837-480f-97a5-1761517dca98 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 13:02:59.299881 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:59.299881 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:59.299881 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:59.299881 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:59.299881 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:59.299881 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:59.299881 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:59.299881 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:59.299881 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:59.299881 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:59.299881 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:59.299881 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:02:59.299881 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:02:59.299881 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:02:59.299881 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:02:59.300861 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:02:59.300861 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:02:59.300861 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:02:59.300861 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:02:59.300861 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:59.300861 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:59.300861 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:59.300861 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:59.300861 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:59.300861 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:59.300861 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:59.300861 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:59.300861 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:59.300861 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:59.300861 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:59.300861 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:59.301681 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:59.301681 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:59.301681 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:59.301681 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:59.301681 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:02:59.301681 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:02:59.301681 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:02:59.301681 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:02:59.301681 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:02:59.301681 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:02:59.301681 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 13:02:59.301681 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:02:59.302304 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 285/564] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:59.302304 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aec453-0054-4d08-8657-698d5b00fe83 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:59.305171 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 280/565] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jun 3 13:02:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:59.307596 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb48e01-3220-41d1-b72b-aa3eb26f8e13 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:59.307884 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb48e01-3220-41d1-b72b-aa3eb26f8e13 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:59.308188 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb48e01-3220-41d1-b72b-aa3eb26f8e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:59.314238 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:59.326830 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-ddb48e01-3220-41d1-b72b-aa3eb26f8e13 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:02:59.328035 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-ddb48e01-3220-41d1-b72b-aa3eb26f8e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:02:59.400271 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 281/566] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:02:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:02:59.400271 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb48e01-3220-41d1-b72b-aa3eb26f8e13 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:59.430418 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aec453-0054-4d08-8657-698d5b00fe83 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:59.465312 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f88d3-c72d-4698-8a71-bc46fd62d2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:59.465968 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f88d3-c72d-4698-8a71-bc46fd62d2e5 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:59.466253 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f88d3-c72d-4698-8a71-bc46fd62d2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:59.466529 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f88d3-c72d-4698-8a71-bc46fd62d2e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:59.467238 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f88d3-c72d-4698-8a71-bc46fd62d2e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:59.467547 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f88d3-c72d-4698-8a71-bc46fd62d2e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:59.469225 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f88d3-c72d-4698-8a71-bc46fd62d2e5 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:59.480989 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 286/567] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:59.481785 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f88d3-c72d-4698-8a71-bc46fd62d2e5 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:59.489635 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:59.513890 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb48e01-3220-41d1-b72b-aa3eb26f8e13 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:59.549028 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:59.553954 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d267256-6525-4431-a18c-0f55e60d51ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:59.554751 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d267256-6525-4431-a18c-0f55e60d51ce None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:59.560457 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d267256-6525-4431-a18c-0f55e60d51ce None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:59.560457 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d267256-6525-4431-a18c-0f55e60d51ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:59.562054 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d267256-6525-4431-a18c-0f55e60d51ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:59.563637 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d267256-6525-4431-a18c-0f55e60d51ce None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:59.578047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-5d267256-6525-4431-a18c-0f55e60d51ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:02:59.578047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:59.578047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:59.578047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:59.578047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:59.578047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:59.578047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:59.578047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:59.578047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:59.578047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:59.578047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:59.578047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:59.578047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 13:02:59.578047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 13:02:59.578047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 13:02:59.579103 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 13:02:59.579103 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:59.579103 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:59.579103 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:59.579103 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:59.579103 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:59.579103 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:59.579103 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:59.579103 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:59.579103 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:59.579103 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:59.579103 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:59.579103 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:59.579103 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:59.579103 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:59.579103 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:59.579103 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:59.579965 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 13:02:59.579965 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 13:02:59.579965 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 13:02:59.579965 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 13:02:59.579965 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 13:02:59.579965 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 13:02:59.579965 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:02:59.579965 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:02:59.584293 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 282/568] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:02:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:59.585918 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d267256-6525-4431-a18c-0f55e60d51ce None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:59.598868 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f88d3-c72d-4698-8a71-bc46fd62d2e5 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:59.636337 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb57cd-5687-4d47-b043-ff7f0432c043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:59.637006 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb57cd-5687-4d47-b043-ff7f0432c043 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:59.637293 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb57cd-5687-4d47-b043-ff7f0432c043 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:59.637564 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb57cd-5687-4d47-b043-ff7f0432c043 None admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:59.638315 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacb57cd-5687-4d47-b043-ff7f0432c043 None admin] RBAC: Adding query filter params (name=service) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:59.638615 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacb57cd-5687-4d47-b043-ff7f0432c043 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:59.640169 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacb57cd-5687-4d47-b043-ff7f0432c043 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:59.654045 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 287/569] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jun 3 13:02:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:59.654045 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb57cd-5687-4d47-b043-ff7f0432c043 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:59.697130 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d267256-6525-4431-a18c-0f55e60d51ce None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:59.724861 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:59.731801 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f43f4-9852-4c5a-8860-622a05d6d7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:59.732634 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f43f4-9852-4c5a-8860-622a05d6d7e1 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:59.732915 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f43f4-9852-4c5a-8860-622a05d6d7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:59.733184 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f43f4-9852-4c5a-8860-622a05d6d7e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:59.744790 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f43f4-9852-4c5a-8860-622a05d6d7e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:02:59.752783 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-a44f43f4-9852-4c5a-8860-622a05d6d7e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 13:02:59.752783 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:59.752783 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:59.752783 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:59.752783 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:59.752783 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:59.752783 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:59.752783 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:59.752783 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:59.752783 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:59.752783 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:59.752783 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:59.752783 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:02:59.752783 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:02:59.752783 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:02:59.752783 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:02:59.753905 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:02:59.753905 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:02:59.753905 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:02:59.753905 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:02:59.753905 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:59.753905 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:59.753905 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:59.753905 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:59.753905 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:59.753905 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:59.753905 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:59.753905 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:59.753905 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:59.753905 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:59.753905 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:59.753905 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:59.754814 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:59.754814 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:59.754814 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:59.754814 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:59.754814 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:02:59.754814 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:02:59.754814 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:02:59.754814 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:02:59.754814 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:02:59.754814 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:02:59.754814 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 13:02:59.754814 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:02:59.754814 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 283/570] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jun 3 13:02:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:59.754814 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f43f4-9852-4c5a-8860-622a05d6d7e1 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:59.764547 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb57cd-5687-4d47-b043-ff7f0432c043 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:59.800385 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d45c4-9534-49bf-90b9-182cf4f97f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:59.801164 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d45c4-9534-49bf-90b9-182cf4f97f95 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:59.801442 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d45c4-9534-49bf-90b9-182cf4f97f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:59.801709 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d45c4-9534-49bf-90b9-182cf4f97f95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:59.807812 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:59.808283 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9d45c4-9534-49bf-90b9-182cf4f97f95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:59.809727 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9d45c4-9534-49bf-90b9-182cf4f97f95 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:59.823891 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-be9d45c4-9534-49bf-90b9-182cf4f97f95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:02:59.823891 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:59.823891 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:59.823891 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:59.823891 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:59.823891 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:59.823891 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:59.823891 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:59.823891 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:59.823891 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:59.823891 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:59.823891 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:59.823891 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 13:02:59.823891 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 13:02:59.823891 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 13:02:59.825099 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 13:02:59.825099 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:59.825099 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:59.825099 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:59.825099 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:59.825099 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:59.825099 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:59.825099 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:59.825099 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:59.825099 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:59.825099 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:59.825099 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:59.825099 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:59.825099 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:59.825099 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:59.825099 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:59.825099 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:59.825984 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 13:02:59.825984 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 13:02:59.825984 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 13:02:59.825984 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 13:02:59.825984 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 13:02:59.825984 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 13:02:59.825984 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:02:59.825984 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:02:59.825984 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 288/571] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:02:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:02:59.825984 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d45c4-9534-49bf-90b9-182cf4f97f95 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:59.854317 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f43f4-9852-4c5a-8860-622a05d6d7e1 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:59.887331 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af760720-4cb1-437b-852f-c0803bdfa764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:59.888010 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af760720-4cb1-437b-852f-c0803bdfa764 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:59.888325 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af760720-4cb1-437b-852f-c0803bdfa764 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:59.888623 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af760720-4cb1-437b-852f-c0803bdfa764 None admin] PATH_INFO: `/v3/projects` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:59.889396 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af760720-4cb1-437b-852f-c0803bdfa764 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:02:59.890217 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af760720-4cb1-437b-852f-c0803bdfa764 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:59.891639 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af760720-4cb1-437b-852f-c0803bdfa764 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:59.903311 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 284/572] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 13:02:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:02:59.904691 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47198b42-848f-40b2-a984-36e012992f93 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:59.904926 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47198b42-848f-40b2-a984-36e012992f93 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:59.905201 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47198b42-848f-40b2-a984-36e012992f93 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:59.907018 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 285/573] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:02:59.907714 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47198b42-848f-40b2-a984-36e012992f93 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:02:59.932178 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d45c4-9534-49bf-90b9-182cf4f97f95 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:02:59.957296 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:59.965686 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb2aa2-ea90-45c8-8603-fe169a491a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:02:59.966581 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb2aa2-ea90-45c8-8603-fe169a491a3c None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:02:59.966766 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb2aa2-ea90-45c8-8603-fe169a491a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:02:59.967036 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb2aa2-ea90-45c8-8603-fe169a491a3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:02:59.977785 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb2aa2-ea90-45c8-8603-fe169a491a3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:02:59.979235 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb2aa2-ea90-45c8-8603-fe169a491a3c None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:02:59.997349 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-6ecb2aa2-ea90-45c8-8603-fe169a491a3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:02:59.997349 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:02:59.997349 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:02:59.997349 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:02:59.997349 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:02:59.997349 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:02:59.997349 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:02:59.997349 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:02:59.997349 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:02:59.997349 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:02:59.997349 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:02:59.997349 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:02:59.997349 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:02:59.997349 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:02:59.997349 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:02:59.998446 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:02:59.998446 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:02:59.998446 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:02:59.998446 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:02:59.998446 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:02:59.998446 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:02:59.998446 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:02:59.998446 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:02:59.998446 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:02:59.998446 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:02:59.998446 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:02:59.998446 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:02:59.998446 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:02:59.998446 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:02:59.998446 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:02:59.998446 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:02:59.998446 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:02:59.999528 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:02:59.999528 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:02:59.999528 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:02:59.999528 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:00.001244 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 289/574] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:02:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:00.002332 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb2aa2-ea90-45c8-8603-fe169a491a3c None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:00.016114 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47198b42-848f-40b2-a984-36e012992f93 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:00.029221 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:00.051283 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a913174-dcf1-4d4a-b2c7-47d64d6f61d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:00.051948 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a913174-dcf1-4d4a-b2c7-47d64d6f61d9 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:00.052263 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a913174-dcf1-4d4a-b2c7-47d64d6f61d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:00.052546 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a913174-dcf1-4d4a-b2c7-47d64d6f61d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:00.053289 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a913174-dcf1-4d4a-b2c7-47d64d6f61d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:00.053597 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a913174-dcf1-4d4a-b2c7-47d64d6f61d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:00.054964 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a913174-dcf1-4d4a-b2c7-47d64d6f61d9 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:00.063573 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 286/575] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jun 3 13:02:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:00.064610 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a913174-dcf1-4d4a-b2c7-47d64d6f61d9 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:00.106849 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb2aa2-ea90-45c8-8603-fe169a491a3c None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:00.138789 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c58f0-735c-466c-a7f6-a827ca7734f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:00.139442 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c58f0-735c-466c-a7f6-a827ca7734f0 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:00.140270 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c58f0-735c-466c-a7f6-a827ca7734f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:00.140545 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c58f0-735c-466c-a7f6-a827ca7734f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:00.141321 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c58f0-735c-466c-a7f6-a827ca7734f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:00.141627 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c58f0-735c-466c-a7f6-a827ca7734f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:00.143049 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c58f0-735c-466c-a7f6-a827ca7734f0 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:00.154671 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 290/576] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 13:03:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:00.156480 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01a9f4-2ced-4274-9e4c-c22f3559c3d6 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:00.156701 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01a9f4-2ced-4274-9e4c-c22f3559c3d6 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:00.156972 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01a9f4-2ced-4274-9e4c-c22f3559c3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:00.165067 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a913174-dcf1-4d4a-b2c7-47d64d6f61d9 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:00.172969 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-0f01a9f4-2ced-4274-9e4c-c22f3559c3d6 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:00.174160 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-0f01a9f4-2ced-4274-9e4c-c22f3559c3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:00.199726 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08608050-eabf-42ca-b33d-393ce42e8a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:00.200643 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08608050-eabf-42ca-b33d-393ce42e8a0e None admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:00.200922 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08608050-eabf-42ca-b33d-393ce42e8a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:00.201191 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08608050-eabf-42ca-b33d-393ce42e8a0e None admin] PATH_INFO: `/v3/projects/c8c0bf799c9f451b8167a646a5c82eda/users/066aaba3e9af4f85ab0cba89a3d32e34/roles/eb985092d5f14e92a783e26568bf457b` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:00.203565 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:00.216509 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08608050-eabf-42ca-b33d-393ce42e8a0e None admin] RBAC: Authorizing `identity:create_grant(project_id=c8c0bf799c9f451b8167a646a5c82eda, user_id=066aaba3e9af4f85ab0cba89a3d32e34, role_id=eb985092d5f14e92a783e26568bf457b)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:00.218489 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08608050-eabf-42ca-b33d-393ce42e8a0e None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:00.242655 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 291/577] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:03:00.243582 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01a9f4-2ced-4274-9e4c-c22f3559c3d6 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:00.288885 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 287/578] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jun 3 13:03:00 2022] PUT /identity/v3/projects/c8c0bf799c9f451b8167a646a5c82eda/users/066aaba3e9af4f85ab0cba89a3d32e34/roles/eb985092d5f14e92a783e26568bf457b => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:00.289885 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08608050-eabf-42ca-b33d-393ce42e8a0e None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:00.318298 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:00.362590 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01a9f4-2ced-4274-9e4c-c22f3559c3d6 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:00.405411 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05459f01-7d08-4d06-9ac2-6abb78f53173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:00.406577 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08608050-eabf-42ca-b33d-393ce42e8a0e None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:00.407084 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05459f01-7d08-4d06-9ac2-6abb78f53173 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:00.407579 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05459f01-7d08-4d06-9ac2-6abb78f53173 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:00.408084 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05459f01-7d08-4d06-9ac2-6abb78f53173 None admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:00.409109 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05459f01-7d08-4d06-9ac2-6abb78f53173 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:00.409591 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05459f01-7d08-4d06-9ac2-6abb78f53173 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:00.411020 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05459f01-7d08-4d06-9ac2-6abb78f53173 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:00.423973 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 292/579] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:00.425153 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05459f01-7d08-4d06-9ac2-6abb78f53173 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:00.454125 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6734e754-0410-41ec-93d5-9d3a2ad2136d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:00.454939 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734e754-0410-41ec-93d5-9d3a2ad2136d None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:00.455224 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734e754-0410-41ec-93d5-9d3a2ad2136d None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:00.455499 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734e754-0410-41ec-93d5-9d3a2ad2136d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:00.456800 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:00.467949 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6734e754-0410-41ec-93d5-9d3a2ad2136d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:00.469897 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6734e754-0410-41ec-93d5-9d3a2ad2136d None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:00.490640 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-6734e754-0410-41ec-93d5-9d3a2ad2136d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:00.490640 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:00.490640 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:00.490640 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:00.490640 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:00.490640 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:00.490640 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:00.490640 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:00.490640 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:00.490640 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:00.490640 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:00.490640 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:00.490640 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:03:00.490640 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:03:00.490640 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:03:00.491790 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:03:00.491790 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:00.491790 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:00.491790 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:00.491790 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:00.491790 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:00.491790 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:00.491790 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:00.491790 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:00.491790 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:00.491790 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:00.491790 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:00.491790 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:00.491790 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:00.491790 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:00.491790 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:00.491790 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:00.492887 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:03:00.492887 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:03:00.492887 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:00.492887 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:00.493165 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 288/580] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:00.494147 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6734e754-0410-41ec-93d5-9d3a2ad2136d None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:00.553509 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05459f01-7d08-4d06-9ac2-6abb78f53173 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:00.582657 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:00.590847 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04876cf-ce81-461c-afd6-6b1fd38f35fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:00.591894 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04876cf-ce81-461c-afd6-6b1fd38f35fc None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:00.592204 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04876cf-ce81-461c-afd6-6b1fd38f35fc None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:00.596654 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04876cf-ce81-461c-afd6-6b1fd38f35fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:00.596654 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04876cf-ce81-461c-afd6-6b1fd38f35fc None admin] RBAC: Adding query filter params (role.id=eb985092d5f14e92a783e26568bf457b, scope.project.id=c8c0bf799c9f451b8167a646a5c82eda, user.id=b07ad3dd7477497ea25c2a01bff35712) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:00.596654 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04876cf-ce81-461c-afd6-6b1fd38f35fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:00.596654 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04876cf-ce81-461c-afd6-6b1fd38f35fc None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:00.612174 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 293/581] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 13:03:00 2022] GET /identity/v3/role_assignments?user.id=b07ad3dd7477497ea25c2a01bff35712&scope.project.id=c8c0bf799c9f451b8167a646a5c82eda&role.id=eb985092d5f14e92a783e26568bf457b => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:00.612174 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04876cf-ce81-461c-afd6-6b1fd38f35fc None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:00.612478 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6734e754-0410-41ec-93d5-9d3a2ad2136d None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:00.657396 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db59ac6-6179-4bef-812b-049bdaab017e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:00.658251 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db59ac6-6179-4bef-812b-049bdaab017e None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:00.658609 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db59ac6-6179-4bef-812b-049bdaab017e None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:00.659424 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db59ac6-6179-4bef-812b-049bdaab017e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:00.676223 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db59ac6-6179-4bef-812b-049bdaab017e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:03:00.687704 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-7db59ac6-6179-4bef-812b-049bdaab017e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 13:03:00.687704 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:00.687704 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:00.687704 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:00.687704 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:00.687704 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:00.687704 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:00.687704 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:00.687704 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:00.687704 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:00.687704 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:00.687704 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:00.687704 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:03:00.687704 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:03:00.687704 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:03:00.687704 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:03:00.688882 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:03:00.688882 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:03:00.688882 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:03:00.688882 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:03:00.688882 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:00.688882 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:00.688882 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:00.688882 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:00.688882 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:00.688882 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:00.688882 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:00.688882 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:00.688882 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:00.688882 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:00.688882 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:00.688882 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:00.689737 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:00.689737 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:00.689737 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:00.689737 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:00.689737 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:03:00.689737 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:03:00.689737 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:03:00.689737 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:03:00.689737 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:03:00.689737 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:03:00.689737 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 13:03:00.689737 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:00.690376 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 289/582] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jun 3 13:03:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:00.691654 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db59ac6-6179-4bef-812b-049bdaab017e None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:00.728188 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04876cf-ce81-461c-afd6-6b1fd38f35fc None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:00.740641 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:00.768610 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59edd373-5568-4169-b664-0031a12e78bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:00.769713 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59edd373-5568-4169-b664-0031a12e78bb None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:00.770104 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59edd373-5568-4169-b664-0031a12e78bb None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:00.770489 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59edd373-5568-4169-b664-0031a12e78bb None admin] PATH_INFO: `/v3/users/glance` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:00.779236 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59edd373-5568-4169-b664-0031a12e78bb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:00.781001 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59edd373-5568-4169-b664-0031a12e78bb None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:00.798103 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-59edd373-5568-4169-b664-0031a12e78bb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 03 13:03:00.798103 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:00.798103 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:00.798103 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:00.798103 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:00.798103 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:00.798103 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:00.798103 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:00.798103 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:00.798103 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:00.798103 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:00.798103 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:00.798103 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 13:03:00.798103 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 13:03:00.798103 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 13:03:00.798103 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 13:03:00.799133 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:00.799133 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:00.799133 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 13:03:00.799133 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:03:00.799133 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 13:03:00.799133 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:03:00.799133 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:00.799133 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:00.799133 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:00.799133 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:00.799133 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:00.799133 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:00.799133 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:00.799133 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:00.799133 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:00.799133 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:00.799133 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:00.799133 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:00.800082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:00.800082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:00.800082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 13:03:00.800082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 13:03:00.800082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 13:03:00.800082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 13:03:00.800082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 13:03:00.800082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 13:03:00.800082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 03 13:03:00.800082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:00.804441 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 294/583] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:03:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:00.805518 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59edd373-5568-4169-b664-0031a12e78bb None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:00.833390 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db59ac6-6179-4bef-812b-049bdaab017e None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:00.878828 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c6381-8e4b-4146-bbfb-6d5199201c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:00.879489 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c6381-8e4b-4146-bbfb-6d5199201c5b None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:00.879769 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c6381-8e4b-4146-bbfb-6d5199201c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:00.880038 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c6381-8e4b-4146-bbfb-6d5199201c5b None admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:00.880790 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c6381-8e4b-4146-bbfb-6d5199201c5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:00.881166 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c6381-8e4b-4146-bbfb-6d5199201c5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:00.882672 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c6381-8e4b-4146-bbfb-6d5199201c5b None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:00.885816 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:00.896054 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 290/584] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:00.899045 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c6381-8e4b-4146-bbfb-6d5199201c5b None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:00.947458 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59edd373-5568-4169-b664-0031a12e78bb None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:00.994035 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c8523-aebc-40dc-8cbc-642b438c2820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:00.994958 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c8523-aebc-40dc-8cbc-642b438c2820 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:00.995390 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c8523-aebc-40dc-8cbc-642b438c2820 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:00.995839 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c8523-aebc-40dc-8cbc-642b438c2820 None admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:00.996769 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11c8523-aebc-40dc-8cbc-642b438c2820 None admin] RBAC: Adding query filter params (name=service) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:00.997218 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11c8523-aebc-40dc-8cbc-642b438c2820 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:00.998762 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11c8523-aebc-40dc-8cbc-642b438c2820 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:01.012647 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 295/585] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jun 3 13:03:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:01.014111 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c8523-aebc-40dc-8cbc-642b438c2820 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:01.016984 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c6381-8e4b-4146-bbfb-6d5199201c5b None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:01.032556 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:01.069152 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de780ae1-eb75-4df4-abed-b9cab58b1f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:01.070452 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de780ae1-eb75-4df4-abed-b9cab58b1f28 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:01.071327 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de780ae1-eb75-4df4-abed-b9cab58b1f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:01.071811 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de780ae1-eb75-4df4-abed-b9cab58b1f28 None admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:01.072885 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de780ae1-eb75-4df4-abed-b9cab58b1f28 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:01.073430 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de780ae1-eb75-4df4-abed-b9cab58b1f28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:01.075888 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de780ae1-eb75-4df4-abed-b9cab58b1f28 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:01.105353 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 291/586] 10.222.0.61 () {56 vars in 1137 bytes} [Fri Jun 3 13:03:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:01.105353 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de780ae1-eb75-4df4-abed-b9cab58b1f28 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:01.137590 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c8523-aebc-40dc-8cbc-642b438c2820 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:01.166635 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:01.184341 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db8f3e6-a6e8-44a4-91b1-c0b2c486173f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:01.185393 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8f3e6-a6e8-44a4-91b1-c0b2c486173f None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:01.185875 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8f3e6-a6e8-44a4-91b1-c0b2c486173f None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:01.186306 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8f3e6-a6e8-44a4-91b1-c0b2c486173f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:01.196569 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db8f3e6-a6e8-44a4-91b1-c0b2c486173f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:01.198326 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db8f3e6-a6e8-44a4-91b1-c0b2c486173f None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:01.214742 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de780ae1-eb75-4df4-abed-b9cab58b1f28 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:01.218451 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-0db8f3e6-a6e8-44a4-91b1-c0b2c486173f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 03 13:03:01.218451 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:01.218451 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:01.218451 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:01.218451 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:01.218451 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:01.218451 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:01.218451 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:01.218451 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:01.218451 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:01.218451 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:01.218451 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:01.218451 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 13:03:01.218451 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 13:03:01.218451 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 13:03:01.218451 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 13:03:01.219558 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:01.219558 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:01.219558 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 13:03:01.219558 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:03:01.219558 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 13:03:01.219558 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:03:01.219558 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:01.219558 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:01.219558 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:01.219558 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:01.219558 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:01.219558 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:01.219558 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:01.219558 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:01.219558 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:01.219558 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:01.219558 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:01.219558 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:01.220632 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:01.220632 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:01.220632 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 13:03:01.220632 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 13:03:01.220632 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 13:03:01.220632 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 13:03:01.220632 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 13:03:01.220632 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 13:03:01.220632 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 03 13:03:01.220632 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:01.222985 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 296/587] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:03:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:01.223926 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db8f3e6-a6e8-44a4-91b1-c0b2c486173f None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:01.264315 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9803bafe-9d1c-477c-a014-8345753a3598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:01.266028 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803bafe-9d1c-477c-a014-8345753a3598 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:01.266713 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803bafe-9d1c-477c-a014-8345753a3598 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:01.267137 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803bafe-9d1c-477c-a014-8345753a3598 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:01.281378 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9803bafe-9d1c-477c-a014-8345753a3598 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:01.283587 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9803bafe-9d1c-477c-a014-8345753a3598 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:01.307488 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-9803bafe-9d1c-477c-a014-8345753a3598 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:01.307488 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:01.307488 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:01.307488 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:01.307488 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:01.307488 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:01.307488 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:01.307488 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:01.307488 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:01.307488 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:01.307488 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:01.307488 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:01.307488 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:03:01.307488 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:03:01.307488 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:03:01.308617 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:03:01.308617 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:01.308617 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:01.308617 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:01.308617 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:01.308617 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:01.308617 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:01.308617 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:01.308617 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:01.308617 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:01.308617 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:01.308617 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:01.308617 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:01.308617 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:01.308617 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:01.308617 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:01.308617 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:01.309589 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:03:01.309589 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:03:01.309589 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:01.309589 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:01.310847 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:01.313449 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 292/588] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:01.315056 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9803bafe-9d1c-477c-a014-8345753a3598 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:01.339479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db8f3e6-a6e8-44a4-91b1-c0b2c486173f None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:01.377655 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10348552-db93-4bd8-b124-65ed15ba0f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:01.378580 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10348552-db93-4bd8-b124-65ed15ba0f1b None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:01.378877 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10348552-db93-4bd8-b124-65ed15ba0f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:01.379420 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10348552-db93-4bd8-b124-65ed15ba0f1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:01.391532 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10348552-db93-4bd8-b124-65ed15ba0f1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:01.393448 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10348552-db93-4bd8-b124-65ed15ba0f1b None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:01.412070 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-10348552-db93-4bd8-b124-65ed15ba0f1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:01.412070 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:01.412070 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:01.412070 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:01.412070 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:01.412070 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:01.412070 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:01.412070 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:01.412070 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:01.412070 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:01.412070 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:01.412070 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:01.412070 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:03:01.412070 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:03:01.412070 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:03:01.413223 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:03:01.413223 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:01.413223 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:01.413223 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:01.413223 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:01.413223 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:01.413223 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:01.413223 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:01.413223 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:01.413223 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:01.413223 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:01.413223 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:01.413223 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:01.413223 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:01.413223 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:01.413223 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:01.413223 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:01.414246 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:03:01.414246 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:03:01.414246 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:01.414246 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:01.418908 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 297/589] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:01.419674 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10348552-db93-4bd8-b124-65ed15ba0f1b None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:01.448185 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9803bafe-9d1c-477c-a014-8345753a3598 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:01.458372 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:01.488763 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8f906-68c0-451d-a81a-035eeb714ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:01.489624 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8f906-68c0-451d-a81a-035eeb714ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:01.490288 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8f906-68c0-451d-a81a-035eeb714ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:01.490873 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8f906-68c0-451d-a81a-035eeb714ea9 None admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:01.492234 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf8f906-68c0-451d-a81a-035eeb714ea9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:01.492925 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf8f906-68c0-451d-a81a-035eeb714ea9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:01.494578 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf8f906-68c0-451d-a81a-035eeb714ea9 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:01.519455 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 293/590] 10.222.0.61 () {56 vars in 1137 bytes} [Fri Jun 3 13:03:01 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:01.519455 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8f906-68c0-451d-a81a-035eeb714ea9 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:01.547225 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10348552-db93-4bd8-b124-65ed15ba0f1b None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:01.581934 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:01.594658 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91616d79-0072-4a69-b4bc-40d5eac6bca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:01.596678 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91616d79-0072-4a69-b4bc-40d5eac6bca7 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:01.597148 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91616d79-0072-4a69-b4bc-40d5eac6bca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:01.597893 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91616d79-0072-4a69-b4bc-40d5eac6bca7 None admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:01.598801 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91616d79-0072-4a69-b4bc-40d5eac6bca7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:01.599271 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91616d79-0072-4a69-b4bc-40d5eac6bca7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:01.600832 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91616d79-0072-4a69-b4bc-40d5eac6bca7 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:01.618367 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 298/591] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:01.620229 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91616d79-0072-4a69-b4bc-40d5eac6bca7 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:01.629515 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8f906-68c0-451d-a81a-035eeb714ea9 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:01.677646 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46526b12-cb0d-4f45-b5f1-81a428d89228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:01.679330 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46526b12-cb0d-4f45-b5f1-81a428d89228 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:01.679774 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46526b12-cb0d-4f45-b5f1-81a428d89228 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:01.680223 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46526b12-cb0d-4f45-b5f1-81a428d89228 None admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:01.681381 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46526b12-cb0d-4f45-b5f1-81a428d89228 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:01.682283 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46526b12-cb0d-4f45-b5f1-81a428d89228 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:01.683801 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46526b12-cb0d-4f45-b5f1-81a428d89228 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:01.710271 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 294/592] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:01.710271 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46526b12-cb0d-4f45-b5f1-81a428d89228 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:01.736936 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:01.750584 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91616d79-0072-4a69-b4bc-40d5eac6bca7 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:01.798127 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d238f3-2991-41c5-abb0-3425479ca4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:01.799433 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d238f3-2991-41c5-abb0-3425479ca4b4 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:01.799957 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d238f3-2991-41c5-abb0-3425479ca4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:01.800564 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d238f3-2991-41c5-abb0-3425479ca4b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:01.814091 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d238f3-2991-41c5-abb0-3425479ca4b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:01.816209 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d238f3-2991-41c5-abb0-3425479ca4b4 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:01.818770 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46526b12-cb0d-4f45-b5f1-81a428d89228 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:01.836334 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-a0d238f3-2991-41c5-abb0-3425479ca4b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:01.836334 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:01.836334 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:01.836334 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:01.836334 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:01.836334 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:01.836334 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:01.836334 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:01.836334 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:01.836334 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:01.836334 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:01.836334 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:01.836334 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:03:01.836334 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:03:01.836334 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:03:01.837268 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:03:01.837268 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:01.837268 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:01.837268 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:01.837268 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:01.837268 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:01.837268 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:01.837268 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:01.837268 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:01.837268 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:01.837268 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:01.837268 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:01.837268 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:01.837268 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:01.837268 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:01.837268 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:01.837268 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:01.838190 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:03:01.838190 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:03:01.838190 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:01.838190 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:01.845587 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 299/593] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:01.846451 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d238f3-2991-41c5-abb0-3425479ca4b4 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:01.855331 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f756cb-dec4-483a-8f03-79a74ef1aca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:01.856211 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f756cb-dec4-483a-8f03-79a74ef1aca0 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:01.856494 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f756cb-dec4-483a-8f03-79a74ef1aca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:01.856767 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f756cb-dec4-483a-8f03-79a74ef1aca0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:01.865592 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f756cb-dec4-483a-8f03-79a74ef1aca0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:01.867125 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f756cb-dec4-483a-8f03-79a74ef1aca0 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:01.883402 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-10f756cb-dec4-483a-8f03-79a74ef1aca0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 03 13:03:01.883402 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:01.883402 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:01.883402 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:01.883402 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:01.883402 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:01.883402 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:01.883402 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:01.883402 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:01.883402 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:01.883402 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:01.883402 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:01.883402 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 13:03:01.883402 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 13:03:01.883402 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 13:03:01.883402 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 13:03:01.884411 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:01.884411 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:01.884411 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 13:03:01.884411 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:03:01.884411 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 13:03:01.884411 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:03:01.884411 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:01.884411 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:01.884411 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:01.884411 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:01.884411 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:01.884411 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:01.884411 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:01.884411 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:01.884411 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:01.884411 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:01.884411 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:01.884411 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:01.885368 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:01.885368 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:01.885368 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 13:03:01.885368 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 13:03:01.885368 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 13:03:01.885368 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 13:03:01.885368 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 13:03:01.885368 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 13:03:01.885368 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 03 13:03:01.885368 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:01.885368 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 295/594] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jun 3 13:03:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:01.885979 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f756cb-dec4-483a-8f03-79a74ef1aca0 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:01.891305 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:01.960268 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d238f3-2991-41c5-abb0-3425479ca4b4 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:01.986720 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:02.002254 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a0f6a4-4e0e-4873-8edc-414cf7427fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:02.003083 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0f6a4-4e0e-4873-8edc-414cf7427fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:02.003677 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0f6a4-4e0e-4873-8edc-414cf7427fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:02.003957 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0f6a4-4e0e-4873-8edc-414cf7427fc8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:02.006602 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f756cb-dec4-483a-8f03-79a74ef1aca0 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:02.012778 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a0f6a4-4e0e-4873-8edc-414cf7427fc8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:02.014257 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a0f6a4-4e0e-4873-8edc-414cf7427fc8 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:02.033754 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-b0a0f6a4-4e0e-4873-8edc-414cf7427fc8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:03:02.033754 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:02.033754 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:02.033754 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:02.033754 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:02.033754 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:02.033754 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:02.033754 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:02.033754 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:02.033754 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:02.033754 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:02.033754 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:02.033754 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 13:03:02.033754 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 13:03:02.033754 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 13:03:02.034737 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 13:03:02.034737 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:02.034737 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:02.034737 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:02.034737 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:02.034737 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:02.034737 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:02.034737 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:02.034737 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:02.034737 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:02.034737 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:02.034737 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:02.034737 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:02.034737 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:02.034737 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:02.034737 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:02.034737 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:02.035638 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 13:03:02.035638 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 13:03:02.035638 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 13:03:02.035638 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 13:03:02.035638 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 13:03:02.035638 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 13:03:02.035638 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:03:02.035638 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:02.039913 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 300/595] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:03:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:02.041109 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a0f6a4-4e0e-4873-8edc-414cf7427fc8 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:02.052261 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93deab-879b-4326-93a6-e86fc994a5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:02.053260 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93deab-879b-4326-93a6-e86fc994a5b1 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:02.053839 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93deab-879b-4326-93a6-e86fc994a5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:02.054307 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93deab-879b-4326-93a6-e86fc994a5b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:02.055378 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b93deab-879b-4326-93a6-e86fc994a5b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:02.055873 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b93deab-879b-4326-93a6-e86fc994a5b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:02.057498 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b93deab-879b-4326-93a6-e86fc994a5b1 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:02.076001 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 296/596] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:02.077981 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93deab-879b-4326-93a6-e86fc994a5b1 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:02.170313 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:02.176928 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a0f6a4-4e0e-4873-8edc-414cf7427fc8 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:02.193492 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93deab-879b-4326-93a6-e86fc994a5b1 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:02.230239 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605d26c-7ef8-4bc9-b125-d74d2cd60032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:02.231366 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605d26c-7ef8-4bc9-b125-d74d2cd60032 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:02.231664 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605d26c-7ef8-4bc9-b125-d74d2cd60032 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:02.231944 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605d26c-7ef8-4bc9-b125-d74d2cd60032 None admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:02.233095 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a605d26c-7ef8-4bc9-b125-d74d2cd60032 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:02.233999 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a605d26c-7ef8-4bc9-b125-d74d2cd60032 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:02.235856 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a605d26c-7ef8-4bc9-b125-d74d2cd60032 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:02.237736 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0e22f-1c8f-4f6f-bde3-2c2505b1ecc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:02.238636 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0e22f-1c8f-4f6f-bde3-2c2505b1ecc9 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:02.239134 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0e22f-1c8f-4f6f-bde3-2c2505b1ecc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:02.239608 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0e22f-1c8f-4f6f-bde3-2c2505b1ecc9 None admin] PATH_INFO: `/v3/projects` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:02.240611 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f0e22f-1c8f-4f6f-bde3-2c2505b1ecc9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:02.241136 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f0e22f-1c8f-4f6f-bde3-2c2505b1ecc9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:02.242763 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f0e22f-1c8f-4f6f-bde3-2c2505b1ecc9 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:02.256988 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 297/597] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 13:03:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:02.258265 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0e22f-1c8f-4f6f-bde3-2c2505b1ecc9 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:02.263486 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 301/598] 10.222.0.61 () {56 vars in 1139 bytes} [Fri Jun 3 13:03:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:02.264336 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:02.266994 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605d26c-7ef8-4bc9-b125-d74d2cd60032 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:02.376005 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0e22f-1c8f-4f6f-bde3-2c2505b1ecc9 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:02.413696 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7824512-467f-4422-8380-3421344d9fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:02.414496 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7824512-467f-4422-8380-3421344d9fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:02.414793 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7824512-467f-4422-8380-3421344d9fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:02.415030 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7824512-467f-4422-8380-3421344d9fe0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:02.419648 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605d26c-7ef8-4bc9-b125-d74d2cd60032 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:02.422346 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7824512-467f-4422-8380-3421344d9fe0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:02.423854 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7824512-467f-4422-8380-3421344d9fe0 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:02.438624 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-b7824512-467f-4422-8380-3421344d9fe0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:03:02.438624 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:02.438624 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:02.438624 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:02.438624 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:02.438624 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:02.438624 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:02.438624 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:02.438624 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:02.438624 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:02.438624 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:02.438624 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:02.438624 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 13:03:02.438624 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 13:03:02.438624 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 13:03:02.439568 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 13:03:02.439568 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:02.439568 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:02.439568 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:02.439568 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:02.439568 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:02.439568 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:02.439568 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:02.439568 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:02.439568 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:02.439568 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:02.439568 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:02.439568 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:02.439568 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:02.439568 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:02.439568 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:02.439568 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:02.441092 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 13:03:02.441092 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 13:03:02.441092 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 13:03:02.441092 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 13:03:02.441092 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 13:03:02.441092 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 13:03:02.441092 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:03:02.441092 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:02.441092 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 298/599] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:03:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:02.441092 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7824512-467f-4422-8380-3421344d9fe0 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:02.464674 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3711efe-c614-4670-aa0e-1e7e9b04c2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:02.465564 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3711efe-c614-4670-aa0e-1e7e9b04c2c8 None admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:02.465843 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3711efe-c614-4670-aa0e-1e7e9b04c2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:02.466115 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3711efe-c614-4670-aa0e-1e7e9b04c2c8 None admin] PATH_INFO: `/v3/projects/c8c0bf799c9f451b8167a646a5c82eda/users/60eeb0b3e37a4604ab8f8b73c2b021f9/roles/eb985092d5f14e92a783e26568bf457b` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:02.482424 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3711efe-c614-4670-aa0e-1e7e9b04c2c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8c0bf799c9f451b8167a646a5c82eda, user_id=60eeb0b3e37a4604ab8f8b73c2b021f9, role_id=eb985092d5f14e92a783e26568bf457b)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:02.484262 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3711efe-c614-4670-aa0e-1e7e9b04c2c8 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:02.518299 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:02.557203 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7824512-467f-4422-8380-3421344d9fe0 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:02.578701 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 302/600] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jun 3 13:03:02 2022] PUT /identity/v3/projects/c8c0bf799c9f451b8167a646a5c82eda/users/60eeb0b3e37a4604ab8f8b73c2b021f9/roles/eb985092d5f14e92a783e26568bf457b => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:03:02.580172 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3711efe-c614-4670-aa0e-1e7e9b04c2c8 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:02.598566 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:02.613855 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e949b-8a86-4d9a-8fef-41537fe851a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:02.614807 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e949b-8a86-4d9a-8fef-41537fe851a8 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:02.615093 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e949b-8a86-4d9a-8fef-41537fe851a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:02.615410 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e949b-8a86-4d9a-8fef-41537fe851a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:02.640329 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8e949b-8a86-4d9a-8fef-41537fe851a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:02.642597 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8e949b-8a86-4d9a-8fef-41537fe851a8 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:02.665589 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-ff8e949b-8a86-4d9a-8fef-41537fe851a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:02.665589 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:02.665589 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:02.665589 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:02.665589 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:02.665589 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:02.665589 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:02.665589 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:02.665589 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:02.665589 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:02.665589 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:02.665589 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:02.665589 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:03:02.665589 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:03:02.665589 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:03:02.666547 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:03:02.666547 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:02.666547 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:02.666547 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:02.666547 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:02.666547 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:02.666547 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:02.666547 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:02.666547 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:02.666547 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:02.666547 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:02.666547 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:02.666547 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:02.666547 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:02.666547 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:02.666547 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:02.666547 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:02.667434 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:03:02.667434 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:03:02.667434 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:02.667434 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:02.667434 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 299/601] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:02.668297 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247a4d0-94fc-4762-b65f-563ecb4c6270 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:02.668503 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247a4d0-94fc-4762-b65f-563ecb4c6270 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:02.668952 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247a4d0-94fc-4762-b65f-563ecb4c6270 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:02.670640 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 300/602] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:03:02.673309 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247a4d0-94fc-4762-b65f-563ecb4c6270 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:02.763327 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3711efe-c614-4670-aa0e-1e7e9b04c2c8 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:02.793080 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247a4d0-94fc-4762-b65f-563ecb4c6270 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:02.812752 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:02.813306 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de46bf-b2f0-4df5-8ac5-1d4fe18ca658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:02.814069 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de46bf-b2f0-4df5-8ac5-1d4fe18ca658 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:02.814424 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de46bf-b2f0-4df5-8ac5-1d4fe18ca658 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:02.815100 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de46bf-b2f0-4df5-8ac5-1d4fe18ca658 None admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:02.815987 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74de46bf-b2f0-4df5-8ac5-1d4fe18ca658 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:02.816395 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74de46bf-b2f0-4df5-8ac5-1d4fe18ca658 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:02.818501 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74de46bf-b2f0-4df5-8ac5-1d4fe18ca658 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:02.834613 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 303/603] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 13:03:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:02.835993 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87be3b7-edfa-45bf-b210-5fcfca597132 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:02.836380 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87be3b7-edfa-45bf-b210-5fcfca597132 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:02.836730 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87be3b7-edfa-45bf-b210-5fcfca597132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:02.836987 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183799e-fabb-4e52-8abc-205e03ecd55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:02.837760 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183799e-fabb-4e52-8abc-205e03ecd55d None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:02.838124 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183799e-fabb-4e52-8abc-205e03ecd55d None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:02.838466 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183799e-fabb-4e52-8abc-205e03ecd55d None admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:02.839249 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7183799e-fabb-4e52-8abc-205e03ecd55d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:02.839616 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7183799e-fabb-4e52-8abc-205e03ecd55d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:02.841202 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7183799e-fabb-4e52-8abc-205e03ecd55d None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:02.857721 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 301/604] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:03:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:02.860330 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183799e-fabb-4e52-8abc-205e03ecd55d None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:02.862679 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-e87be3b7-edfa-45bf-b210-5fcfca597132 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:02.865349 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-e87be3b7-edfa-45bf-b210-5fcfca597132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:02.948573 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:02.956872 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 304/605] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:03:02.957884 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87be3b7-edfa-45bf-b210-5fcfca597132 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:02.995079 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183799e-fabb-4e52-8abc-205e03ecd55d None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:03.038768 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f8fdf-a137-49ce-9284-6f1059c5bfd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:03.039652 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f8fdf-a137-49ce-9284-6f1059c5bfd1 None admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:03.039929 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f8fdf-a137-49ce-9284-6f1059c5bfd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:03.040232 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f8fdf-a137-49ce-9284-6f1059c5bfd1 None admin] PATH_INFO: `/v3/projects/c8c0bf799c9f451b8167a646a5c82eda/users/303176c26fc74d4892b2f83c81f01b60/roles/eb985092d5f14e92a783e26568bf457b` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:03.059008 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f8fdf-a137-49ce-9284-6f1059c5bfd1 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8c0bf799c9f451b8167a646a5c82eda, user_id=303176c26fc74d4892b2f83c81f01b60, role_id=eb985092d5f14e92a783e26568bf457b)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:03.060974 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f8fdf-a137-49ce-9284-6f1059c5bfd1 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:03.065742 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87be3b7-edfa-45bf-b210-5fcfca597132 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:03.100593 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66878401-681b-42ad-8bff-7319c91a2126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:03.101388 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66878401-681b-42ad-8bff-7319c91a2126 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:03.101669 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66878401-681b-42ad-8bff-7319c91a2126 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:03.101945 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66878401-681b-42ad-8bff-7319c91a2126 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:03.109322 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66878401-681b-42ad-8bff-7319c91a2126 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:03.110761 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66878401-681b-42ad-8bff-7319c91a2126 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:03.125082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-66878401-681b-42ad-8bff-7319c91a2126 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:03:03.125082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:03.125082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:03.125082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:03.125082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:03.125082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:03.125082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:03.125082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:03.125082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:03.125082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:03.125082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:03.125082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:03.125082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 13:03:03.125082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 13:03:03.125082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 13:03:03.126128 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 13:03:03.126128 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:03.126128 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:03.126128 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:03.126128 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:03.126128 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:03.126128 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:03.126128 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:03.126128 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:03.126128 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:03.126128 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:03.126128 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:03.126128 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:03.126128 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:03.126128 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:03.126128 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:03.126128 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:03.127038 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 13:03:03.127038 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 13:03:03.127038 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 13:03:03.127038 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 13:03:03.127038 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 13:03:03.127038 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 13:03:03.127038 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:03:03.127038 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:03.127038 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 305/606] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:03:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:03.127516 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66878401-681b-42ad-8bff-7319c91a2126 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:03.177305 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 302/607] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jun 3 13:03:02 2022] PUT /identity/v3/projects/c8c0bf799c9f451b8167a646a5c82eda/users/303176c26fc74d4892b2f83c81f01b60/roles/eb985092d5f14e92a783e26568bf457b => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:03.178636 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2a2dc-39b1-4e7a-ae21-7c5499b1c3a4 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:03.178922 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2a2dc-39b1-4e7a-ae21-7c5499b1c3a4 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:03.179243 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2a2dc-39b1-4e7a-ae21-7c5499b1c3a4 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:03.180744 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 303/608] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:03:03.185087 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b2a2dc-39b1-4e7a-ae21-7c5499b1c3a4 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:03.195667 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:03.218215 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:03.257478 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66878401-681b-42ad-8bff-7319c91a2126 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:03.308224 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b2a2dc-39b1-4e7a-ae21-7c5499b1c3a4 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:03.308479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f13d8b-2d79-4538-9cb9-e103bef101f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:03.309182 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f13d8b-2d79-4538-9cb9-e103bef101f0 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:03.309398 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f13d8b-2d79-4538-9cb9-e103bef101f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:03.309734 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f13d8b-2d79-4538-9cb9-e103bef101f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:03.324953 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f13d8b-2d79-4538-9cb9-e103bef101f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:03:03.336934 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-90f13d8b-2d79-4538-9cb9-e103bef101f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 13:03:03.336934 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:03.336934 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:03.336934 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:03.336934 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:03.336934 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:03.336934 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:03.336934 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:03.336934 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:03.336934 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:03.336934 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:03.336934 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:03.336934 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:03:03.336934 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:03:03.336934 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:03:03.336934 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:03:03.338234 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:03:03.338234 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:03:03.338234 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:03:03.338234 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:03:03.338234 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:03.338234 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:03.338234 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:03.338234 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:03.338234 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:03.338234 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:03.338234 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:03.338234 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:03.338234 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:03.338234 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:03.338234 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:03.338234 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:03.339341 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:03.339341 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:03.339341 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:03.339341 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:03.339341 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:03:03.339341 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:03:03.339341 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:03:03.339341 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:03:03.339341 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:03:03.339341 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:03:03.339341 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 13:03:03.339341 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:03.339341 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 306/609] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jun 3 13:03:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:03.340083 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9dff09-0b99-4ff4-9be1-c28d8267810d None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:03.340083 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9dff09-0b99-4ff4-9be1-c28d8267810d None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:03.340237 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9dff09-0b99-4ff4-9be1-c28d8267810d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:03.357450 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d35be-d35b-4564-9aad-6b39ad05884e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:03.359090 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d35be-d35b-4564-9aad-6b39ad05884e None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:03.359688 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d35be-d35b-4564-9aad-6b39ad05884e None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:03.360284 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d35be-d35b-4564-9aad-6b39ad05884e None admin] PATH_INFO: `/v3/projects` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:03.361311 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624d35be-d35b-4564-9aad-6b39ad05884e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:03.361904 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624d35be-d35b-4564-9aad-6b39ad05884e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:03.362577 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-4a9dff09-0b99-4ff4-9be1-c28d8267810d None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:03.363756 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624d35be-d35b-4564-9aad-6b39ad05884e None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:03.363869 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-4a9dff09-0b99-4ff4-9be1-c28d8267810d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:03.383066 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 304/610] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 13:03:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:03.384370 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d35be-d35b-4564-9aad-6b39ad05884e None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:03.460916 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 307/611] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:03:03.462143 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9dff09-0b99-4ff4-9be1-c28d8267810d None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:03.507202 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:03.523830 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d35be-d35b-4564-9aad-6b39ad05884e None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:03.525981 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:03.567803 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eff091-fb6e-439a-8386-c6b4081f0676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:03.567803 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eff091-fb6e-439a-8386-c6b4081f0676 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:03.567803 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eff091-fb6e-439a-8386-c6b4081f0676 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:03.567803 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eff091-fb6e-439a-8386-c6b4081f0676 None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:03.568226 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eff091-fb6e-439a-8386-c6b4081f0676 None admin] RBAC: Adding query filter params (name=service) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:03.568226 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eff091-fb6e-439a-8386-c6b4081f0676 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:03.568226 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eff091-fb6e-439a-8386-c6b4081f0676 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:03.576731 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 305/612] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jun 3 13:03:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:03.578866 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eff091-fb6e-439a-8386-c6b4081f0676 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:03.584400 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9dff09-0b99-4ff4-9be1-c28d8267810d None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:03.622437 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb410f-6d08-4df8-b62d-d48bb048df14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:03.623334 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb410f-6d08-4df8-b62d-d48bb048df14 None admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:03.623616 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb410f-6d08-4df8-b62d-d48bb048df14 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:03.623894 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb410f-6d08-4df8-b62d-d48bb048df14 None admin] PATH_INFO: `/v3/projects/c8c0bf799c9f451b8167a646a5c82eda/users/bdb5b24bd01c405c93e32ab4b329bcf1/roles/eb985092d5f14e92a783e26568bf457b` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:03.640506 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb410f-6d08-4df8-b62d-d48bb048df14 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8c0bf799c9f451b8167a646a5c82eda, user_id=bdb5b24bd01c405c93e32ab4b329bcf1, role_id=eb985092d5f14e92a783e26568bf457b)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:03.642194 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb410f-6d08-4df8-b62d-d48bb048df14 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:03.691175 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eff091-fb6e-439a-8386-c6b4081f0676 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:03.717390 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 308/613] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jun 3 13:03:03 2022] PUT /identity/v3/projects/c8c0bf799c9f451b8167a646a5c82eda/users/bdb5b24bd01c405c93e32ab4b329bcf1/roles/eb985092d5f14e92a783e26568bf457b => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:03.718462 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb410f-6d08-4df8-b62d-d48bb048df14 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:03.739192 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c3cac-5115-47e5-9985-fa979456b61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:03.747127 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c3cac-5115-47e5-9985-fa979456b61b None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:03.747127 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c3cac-5115-47e5-9985-fa979456b61b None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:03.747127 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c3cac-5115-47e5-9985-fa979456b61b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:03.759576 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c3cac-5115-47e5-9985-fa979456b61b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:03:03.770733 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-c57c3cac-5115-47e5-9985-fa979456b61b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 13:03:03.770733 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:03.770733 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:03.770733 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:03.770733 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:03.770733 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:03.770733 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:03.770733 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:03.770733 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:03.770733 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:03.770733 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:03.770733 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:03.770733 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:03:03.770733 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:03:03.770733 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:03:03.770733 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:03:03.771749 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:03:03.771749 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:03:03.771749 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:03:03.771749 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:03:03.771749 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:03.771749 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:03.771749 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:03.771749 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:03.771749 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:03.771749 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:03.771749 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:03.771749 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:03.771749 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:03.771749 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:03.771749 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:03.771749 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:03.772643 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:03.772643 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:03.772643 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:03.772643 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:03.772643 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:03:03.772643 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:03:03.772643 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:03:03.772643 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:03:03.772643 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:03:03.772643 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:03:03.772643 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 13:03:03.772643 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:03.776351 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 306/614] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jun 3 13:03:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:03.779386 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c3cac-5115-47e5-9985-fa979456b61b None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:03.797405 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:03.847148 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:03.866567 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb410f-6d08-4df8-b62d-d48bb048df14 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:03.932082 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c3cac-5115-47e5-9985-fa979456b61b None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:03.955329 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0f719-8522-4cec-bd27-5dd29f582049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:03.956166 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0f719-8522-4cec-bd27-5dd29f582049 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:03.956620 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0f719-8522-4cec-bd27-5dd29f582049 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:03.956894 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0f719-8522-4cec-bd27-5dd29f582049 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:03.969400 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc0f719-8522-4cec-bd27-5dd29f582049 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:03.970916 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc0f719-8522-4cec-bd27-5dd29f582049 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:04.002781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-4dc0f719-8522-4cec-bd27-5dd29f582049 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:04.002781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:04.002781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:04.002781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:04.002781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:04.002781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:04.002781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:04.002781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:04.002781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:04.002781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:04.002781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:04.002781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:04.002781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:03:04.002781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:03:04.002781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:03:04.003648 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:03:04.003648 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:04.003648 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:04.003648 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:04.003648 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:04.003648 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:04.003648 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:04.003648 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:04.003648 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:04.003648 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:04.003648 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:04.003648 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:04.003648 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:04.003648 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:04.003648 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:04.003648 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:04.003648 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:04.004743 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:03:04.004743 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:03:04.004743 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:04.004743 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:04.004743 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 309/615] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:04.008984 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fb9dad-edfe-4120-9fce-2da89ce6799a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:04.009677 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb9dad-edfe-4120-9fce-2da89ce6799a None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:04.009958 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb9dad-edfe-4120-9fce-2da89ce6799a None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:04.010234 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb9dad-edfe-4120-9fce-2da89ce6799a None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:04.011010 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fb9dad-edfe-4120-9fce-2da89ce6799a None admin] RBAC: Adding query filter params (name=service) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:04.012312 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0f719-8522-4cec-bd27-5dd29f582049 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:04.015369 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fb9dad-edfe-4120-9fce-2da89ce6799a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:04.017595 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fb9dad-edfe-4120-9fce-2da89ce6799a None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:04.036671 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 307/616] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jun 3 13:03:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:04.042271 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fb9dad-edfe-4120-9fce-2da89ce6799a None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:04.122123 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:04.135889 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0f719-8522-4cec-bd27-5dd29f582049 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:04.154264 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fb9dad-edfe-4120-9fce-2da89ce6799a None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:04.173617 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83a7717-8862-49aa-beb8-0db417a1a217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:04.174594 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a7717-8862-49aa-beb8-0db417a1a217 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:04.175097 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a7717-8862-49aa-beb8-0db417a1a217 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:04.175571 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a7717-8862-49aa-beb8-0db417a1a217 None admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:04.176684 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83a7717-8862-49aa-beb8-0db417a1a217 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:04.177193 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83a7717-8862-49aa-beb8-0db417a1a217 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:04.178770 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83a7717-8862-49aa-beb8-0db417a1a217 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:04.191258 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 310/617] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:04.191566 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985cafa8-f581-49f2-a360-c803b0a1b317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:04.192682 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985cafa8-f581-49f2-a360-c803b0a1b317 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:04.192682 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985cafa8-f581-49f2-a360-c803b0a1b317 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:04.192849 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985cafa8-f581-49f2-a360-c803b0a1b317 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:04.196346 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83a7717-8862-49aa-beb8-0db417a1a217 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:04.208323 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:04.212395 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985cafa8-f581-49f2-a360-c803b0a1b317 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:04.213911 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985cafa8-f581-49f2-a360-c803b0a1b317 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:04.245689 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-985cafa8-f581-49f2-a360-c803b0a1b317 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:04.245689 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:04.245689 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:04.245689 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:04.245689 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:04.245689 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:04.245689 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:04.245689 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:04.245689 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:04.245689 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:04.245689 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:04.245689 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:04.245689 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:03:04.245689 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:03:04.245689 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:03:04.246653 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:03:04.246653 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:04.246653 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:04.246653 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:04.246653 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:04.246653 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:04.246653 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:04.246653 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:04.246653 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:04.246653 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:04.246653 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:04.246653 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:04.246653 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:04.246653 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:04.246653 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:04.246653 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:04.246653 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:04.247566 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:03:04.247566 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:03:04.247566 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:04.247566 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:04.247566 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 308/618] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:03:04.253564 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985cafa8-f581-49f2-a360-c803b0a1b317 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:04.314107 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83a7717-8862-49aa-beb8-0db417a1a217 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:04.352680 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703f21c-e550-4158-a4a9-bb2bcfbaa183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:04.353953 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703f21c-e550-4158-a4a9-bb2bcfbaa183 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:04.354445 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703f21c-e550-4158-a4a9-bb2bcfbaa183 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:04.355021 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703f21c-e550-4158-a4a9-bb2bcfbaa183 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:04.364815 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f703f21c-e550-4158-a4a9-bb2bcfbaa183 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:04.366560 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f703f21c-e550-4158-a4a9-bb2bcfbaa183 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:04.380262 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985cafa8-f581-49f2-a360-c803b0a1b317 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:04.383823 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-f703f21c-e550-4158-a4a9-bb2bcfbaa183 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 13:03:04.383823 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:04.383823 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:04.383823 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:04.383823 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:04.383823 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:04.383823 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:04.383823 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:04.383823 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:04.383823 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:04.383823 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:04.383823 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:04.383823 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 13:03:04.383823 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 13:03:04.383823 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 13:03:04.383823 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 13:03:04.384973 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:04.384973 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:04.384973 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 13:03:04.384973 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:03:04.384973 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 13:03:04.384973 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:03:04.384973 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:04.384973 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:04.384973 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:04.384973 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:04.384973 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:04.384973 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:04.384973 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:04.384973 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:04.384973 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:04.384973 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:04.384973 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:04.384973 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:04.385938 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:04.385938 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:04.385938 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 13:03:04.385938 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 13:03:04.385938 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 13:03:04.385938 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 13:03:04.385938 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 13:03:04.385938 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 13:03:04.385938 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 13:03:04.385938 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:04.388624 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 311/619] 10.222.0.61 () {56 vars in 1093 bytes} [Fri Jun 3 13:03:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:04.395796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703f21c-e550-4158-a4a9-bb2bcfbaa183 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:04.413294 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:04.424722 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e73a2d-9d9d-4150-82d4-a6d224461e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:04.432303 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e73a2d-9d9d-4150-82d4-a6d224461e99 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:04.432303 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e73a2d-9d9d-4150-82d4-a6d224461e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:04.432303 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e73a2d-9d9d-4150-82d4-a6d224461e99 None admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:04.432303 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e73a2d-9d9d-4150-82d4-a6d224461e99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:04.432303 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e73a2d-9d9d-4150-82d4-a6d224461e99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:04.432303 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e73a2d-9d9d-4150-82d4-a6d224461e99 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:04.442597 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 309/620] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:03:04.448173 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e73a2d-9d9d-4150-82d4-a6d224461e99 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:04.487137 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:04.526012 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703f21c-e550-4158-a4a9-bb2bcfbaa183 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:04.563710 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e73a2d-9d9d-4150-82d4-a6d224461e99 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:04.597346 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b1cb3-1641-4545-b363-104c125fdd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:04.598760 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b1cb3-1641-4545-b363-104c125fdd3e None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:04.599276 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b1cb3-1641-4545-b363-104c125fdd3e None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:04.599896 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b1cb3-1641-4545-b363-104c125fdd3e None admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:04.605022 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3b1cb3-1641-4545-b363-104c125fdd3e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:04.605265 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3b1cb3-1641-4545-b363-104c125fdd3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:04.606701 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3b1cb3-1641-4545-b363-104c125fdd3e None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:04.609494 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0cabfd-5d5b-43da-b00e-e64cf69d9884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:04.610394 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0cabfd-5d5b-43da-b00e-e64cf69d9884 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:04.610687 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0cabfd-5d5b-43da-b00e-e64cf69d9884 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:04.610959 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0cabfd-5d5b-43da-b00e-e64cf69d9884 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:04.626642 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0cabfd-5d5b-43da-b00e-e64cf69d9884 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:04.628381 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0cabfd-5d5b-43da-b00e-e64cf69d9884 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:04.641458 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 312/621] 10.222.0.61 () {56 vars in 1133 bytes} [Fri Jun 3 13:03:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:04.650072 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-7b0cabfd-5d5b-43da-b00e-e64cf69d9884 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 03 13:03:04.650072 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:04.650072 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:04.650072 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:04.650072 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:04.650072 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:04.650072 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:04.650072 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:04.650072 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:04.650072 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:04.650072 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:04.650072 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:04.650072 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 13:03:04.650072 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 13:03:04.650072 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 13:03:04.650072 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 13:03:04.651012 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:04.651012 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:04.651012 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 13:03:04.651012 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:03:04.651012 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 13:03:04.651012 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:03:04.651012 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:04.651012 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:04.651012 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:04.651012 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:04.651012 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:04.651012 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:04.651012 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:04.651012 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:04.651012 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:04.651012 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:04.651012 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:04.651012 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:04.651978 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:04.651978 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:04.651978 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 13:03:04.651978 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 13:03:04.651978 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 13:03:04.651978 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 13:03:04.651978 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 13:03:04.651978 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 13:03:04.651978 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 03 13:03:04.651978 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:04.653148 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b1cb3-1641-4545-b363-104c125fdd3e None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:04.655986 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 310/622] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 13:03:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:03:04.659167 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0cabfd-5d5b-43da-b00e-e64cf69d9884 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:04.775534 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b1cb3-1641-4545-b363-104c125fdd3e None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:04.789136 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:04.825921 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:04.845708 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a42f2-554a-4430-b518-3936a2677be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:04.846376 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a42f2-554a-4430-b518-3936a2677be8 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:04.846656 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a42f2-554a-4430-b518-3936a2677be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:04.846931 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a42f2-554a-4430-b518-3936a2677be8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:04.899606 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0cabfd-5d5b-43da-b00e-e64cf69d9884 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:04.957994 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2bcdf4-0159-441b-bc8e-1276171a9adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:04.959650 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2bcdf4-0159-441b-bc8e-1276171a9adf None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:04.959937 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2bcdf4-0159-441b-bc8e-1276171a9adf None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:04.960230 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2bcdf4-0159-441b-bc8e-1276171a9adf None admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:04.961087 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2bcdf4-0159-441b-bc8e-1276171a9adf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:04.961394 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2bcdf4-0159-441b-bc8e-1276171a9adf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:04.962840 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2bcdf4-0159-441b-bc8e-1276171a9adf None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:05.001201 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7a42f2-554a-4430-b518-3936a2677be8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:05.002895 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7a42f2-554a-4430-b518-3936a2677be8 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:05.008233 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 311/623] 10.222.0.61 () {56 vars in 1135 bytes} [Fri Jun 3 13:03:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:05.013111 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2bcdf4-0159-441b-bc8e-1276171a9adf None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:05.119186 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 313/624] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:03:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:05.122668 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:05.125385 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a42f2-554a-4430-b518-3936a2677be8 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:05.127432 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2bcdf4-0159-441b-bc8e-1276171a9adf None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:05.160440 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:05.169265 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf5c695-5eca-462b-9a97-284e68399042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:05.176266 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5c695-5eca-462b-9a97-284e68399042 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:05.176266 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5c695-5eca-462b-9a97-284e68399042 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:05.176266 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5c695-5eca-462b-9a97-284e68399042 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:05.182924 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf5c695-5eca-462b-9a97-284e68399042 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:05.184721 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf5c695-5eca-462b-9a97-284e68399042 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:05.205749 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-ddf5c695-5eca-462b-9a97-284e68399042 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:05.205749 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:05.205749 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:05.205749 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:05.205749 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:05.205749 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:05.205749 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:05.205749 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:05.205749 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:05.205749 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:05.205749 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:05.205749 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:05.205749 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:03:05.205749 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:03:05.205749 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:03:05.206704 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:03:05.206704 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:05.206704 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:05.206704 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:05.206704 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:05.206704 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:05.206704 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:05.206704 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:05.206704 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:05.206704 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:05.206704 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:05.206704 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:05.206704 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:05.206704 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:05.206704 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:05.206704 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:05.206704 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:05.207575 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:03:05.207575 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:03:05.207575 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:05.207575 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:05.209602 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 312/625] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:03:05.215205 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf5c695-5eca-462b-9a97-284e68399042 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:05.314721 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a42f2-554a-4430-b518-3936a2677be8 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:05.362697 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf5c695-5eca-462b-9a97-284e68399042 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:05.373727 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ae86e-5472-4a00-af59-89aba063a9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:05.375677 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ae86e-5472-4a00-af59-89aba063a9b2 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:05.375972 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ae86e-5472-4a00-af59-89aba063a9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:05.376277 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ae86e-5472-4a00-af59-89aba063a9b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:05.389484 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044ae86e-5472-4a00-af59-89aba063a9b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:05.391323 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044ae86e-5472-4a00-af59-89aba063a9b2 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:05.401308 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c22c4-fbd9-4cbd-a25a-fea7cb22e726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:05.402298 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c22c4-fbd9-4cbd-a25a-fea7cb22e726 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:05.402648 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c22c4-fbd9-4cbd-a25a-fea7cb22e726 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:05.402987 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c22c4-fbd9-4cbd-a25a-fea7cb22e726 None admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:05.403796 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377c22c4-fbd9-4cbd-a25a-fea7cb22e726 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:05.404196 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377c22c4-fbd9-4cbd-a25a-fea7cb22e726 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:05.405757 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377c22c4-fbd9-4cbd-a25a-fea7cb22e726 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:05.414009 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-044ae86e-5472-4a00-af59-89aba063a9b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:05.414009 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:05.414009 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:05.414009 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:05.414009 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:05.414009 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:05.414009 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:05.414009 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:05.414009 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:05.414009 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:05.414009 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:05.414009 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:05.414009 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:03:05.414009 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:03:05.414009 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:03:05.414944 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:03:05.414944 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:05.414944 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:05.414944 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:05.414944 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:05.414944 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:05.414944 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:05.414944 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:05.414944 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:05.414944 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:05.414944 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:05.414944 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:05.414944 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:05.414944 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:05.414944 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:05.414944 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:05.414944 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:05.415892 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:03:05.415892 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:03:05.415892 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:05.415892 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:05.423262 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 314/626] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:03:05.423262 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b89d9a-70cd-4edd-9be3-7e4d8f443899 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:05.423262 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b89d9a-70cd-4edd-9be3-7e4d8f443899 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:05.423262 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b89d9a-70cd-4edd-9be3-7e4d8f443899 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:05.423262 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 315/627] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:03:05.426169 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 313/628] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:03:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:05.426282 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b89d9a-70cd-4edd-9be3-7e4d8f443899 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:05.432605 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b8e6d-7895-47a5-bad9-ea928b89f274 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:05.432920 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b8e6d-7895-47a5-bad9-ea928b89f274 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:05.433161 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b8e6d-7895-47a5-bad9-ea928b89f274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:05.452602 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-012b8e6d-7895-47a5-bad9-ea928b89f274 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:05.453811 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-012b8e6d-7895-47a5-bad9-ea928b89f274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:05.462376 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:05.532170 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 314/629] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 13:03:05.532170 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b8e6d-7895-47a5-bad9-ea928b89f274 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:05.554092 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:05.577313 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b89d9a-70cd-4edd-9be3-7e4d8f443899 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:05.616882 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a51909-126b-4c90-b813-94916a5b0f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:05.617546 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a51909-126b-4c90-b813-94916a5b0f9d None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:05.617833 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a51909-126b-4c90-b813-94916a5b0f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:05.618107 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a51909-126b-4c90-b813-94916a5b0f9d None admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:05.618820 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a51909-126b-4c90-b813-94916a5b0f9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:05.619122 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a51909-126b-4c90-b813-94916a5b0f9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:05.620538 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a51909-126b-4c90-b813-94916a5b0f9d None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:05.637576 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 316/630] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:03:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:05.638475 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a51909-126b-4c90-b813-94916a5b0f9d None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:05.656730 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b8e6d-7895-47a5-bad9-ea928b89f274 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:05.703814 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a69aac2-b05f-4c63-9cac-7e3a9ee0e770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:05.705164 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69aac2-b05f-4c63-9cac-7e3a9ee0e770 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:05.706051 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69aac2-b05f-4c63-9cac-7e3a9ee0e770 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:05.706983 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69aac2-b05f-4c63-9cac-7e3a9ee0e770 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:05.717076 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a69aac2-b05f-4c63-9cac-7e3a9ee0e770 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:05.720176 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a69aac2-b05f-4c63-9cac-7e3a9ee0e770 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:05.739457 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-9a69aac2-b05f-4c63-9cac-7e3a9ee0e770 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:03:05.739457 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:05.739457 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:05.739457 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:05.739457 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:05.739457 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:05.739457 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:05.739457 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:05.739457 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:05.739457 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:05.739457 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:05.739457 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:05.739457 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 13:03:05.739457 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 13:03:05.739457 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 13:03:05.740437 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 13:03:05.740437 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:05.740437 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:05.740437 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:05.740437 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:05.740437 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:05.740437 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:05.740437 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:05.740437 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:05.740437 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:05.740437 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:05.740437 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:05.740437 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:05.740437 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:05.740437 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:05.740437 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:05.740437 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:05.741298 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 13:03:05.741298 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 13:03:05.741298 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 13:03:05.741298 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 13:03:05.741298 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 13:03:05.741298 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 13:03:05.741298 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:03:05.741298 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:05.744103 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 315/631] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:03:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:05.745044 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a69aac2-b05f-4c63-9cac-7e3a9ee0e770 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:05.747837 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:05.756952 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a51909-126b-4c90-b813-94916a5b0f9d None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:05.795106 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48446ff5-0649-4a28-aba2-57cba4179c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:05.796539 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48446ff5-0649-4a28-aba2-57cba4179c92 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:05.796886 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48446ff5-0649-4a28-aba2-57cba4179c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:05.797160 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48446ff5-0649-4a28-aba2-57cba4179c92 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:05.804784 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:05.809009 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48446ff5-0649-4a28-aba2-57cba4179c92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:03:05.816911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-48446ff5-0649-4a28-aba2-57cba4179c92 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 13:03:05.816911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:05.816911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:05.816911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:05.816911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:05.816911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:05.816911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:05.816911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:05.816911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:05.816911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:05.816911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:05.816911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:05.816911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:03:05.816911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:03:05.816911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:03:05.816911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:03:05.817856 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:03:05.817856 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:03:05.817856 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:03:05.817856 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:03:05.817856 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:05.817856 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:05.817856 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:05.817856 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:05.817856 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:05.817856 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:05.817856 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:05.817856 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:05.817856 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:05.817856 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:05.817856 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:05.817856 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:05.818675 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:05.818675 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:05.818675 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:05.818675 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:05.818675 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:03:05.818675 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:03:05.818675 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:03:05.818675 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:03:05.818675 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:03:05.818675 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:03:05.818675 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 13:03:05.818675 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:05.818675 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 317/632] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jun 3 13:03:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:05.819381 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48446ff5-0649-4a28-aba2-57cba4179c92 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:05.867290 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a69aac2-b05f-4c63-9cac-7e3a9ee0e770 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:05.903440 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc3ac1-a02a-4068-a1bb-cd4f30b9ff5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:05.904269 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc3ac1-a02a-4068-a1bb-cd4f30b9ff5d None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:05.904555 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc3ac1-a02a-4068-a1bb-cd4f30b9ff5d None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:05.904835 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc3ac1-a02a-4068-a1bb-cd4f30b9ff5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:05.912788 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cc3ac1-a02a-4068-a1bb-cd4f30b9ff5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:05.914234 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cc3ac1-a02a-4068-a1bb-cd4f30b9ff5d None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:05.930559 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-44cc3ac1-a02a-4068-a1bb-cd4f30b9ff5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:03:05.930559 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:05.930559 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:05.930559 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:05.930559 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:05.930559 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:05.930559 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:05.930559 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:05.930559 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:05.930559 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:05.930559 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:05.930559 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:05.930559 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 13:03:05.930559 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 13:03:05.930559 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 13:03:05.931480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 13:03:05.931480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:05.931480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:05.931480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:05.931480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:05.931480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:05.931480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:05.931480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:05.931480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:05.931480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:05.931480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:05.931480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:05.931480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:05.931480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:05.931480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:05.931480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:05.931480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:05.932440 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 13:03:05.932440 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 13:03:05.932440 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 13:03:05.932440 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 13:03:05.932440 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 13:03:05.932440 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 13:03:05.932440 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:03:05.932440 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:05.932868 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48446ff5-0649-4a28-aba2-57cba4179c92 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:05.932943 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 316/633] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:03:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:05.933481 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8e0d2-9e80-4298-8d00-93018d4d65f1 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:05.933713 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8e0d2-9e80-4298-8d00-93018d4d65f1 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:05.933993 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8e0d2-9e80-4298-8d00-93018d4d65f1 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:05.940476 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 317/634] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:03:05.941292 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8e0d2-9e80-4298-8d00-93018d4d65f1 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:05.973563 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b93724-3af0-4791-87bd-a04ba4657ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:05.974596 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b93724-3af0-4791-87bd-a04ba4657ed5 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:05.975032 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b93724-3af0-4791-87bd-a04ba4657ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:05.975316 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b93724-3af0-4791-87bd-a04ba4657ed5 None admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:05.976180 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b93724-3af0-4791-87bd-a04ba4657ed5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:05.976496 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b93724-3af0-4791-87bd-a04ba4657ed5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:05.978033 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b93724-3af0-4791-87bd-a04ba4657ed5 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:05.998180 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 318/635] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 13:03:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:05.998180 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b93724-3af0-4791-87bd-a04ba4657ed5 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:06.020374 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:06.063049 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8e0d2-9e80-4298-8d00-93018d4d65f1 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:06.065043 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:06.100351 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b28e9-cdaf-4fd7-87f0-66f8f4e24a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:06.101030 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b28e9-cdaf-4fd7-87f0-66f8f4e24a0e None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:06.101313 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b28e9-cdaf-4fd7-87f0-66f8f4e24a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:06.101606 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b28e9-cdaf-4fd7-87f0-66f8f4e24a0e None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:06.102343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560b28e9-cdaf-4fd7-87f0-66f8f4e24a0e None admin] RBAC: Adding query filter params (name=service) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:06.102649 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560b28e9-cdaf-4fd7-87f0-66f8f4e24a0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:06.104014 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560b28e9-cdaf-4fd7-87f0-66f8f4e24a0e None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:06.113165 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b93724-3af0-4791-87bd-a04ba4657ed5 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:06.117883 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 318/636] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jun 3 13:03:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:06.117883 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc127e64-8707-4f3a-96ce-1776a2697b90 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:06.117883 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc127e64-8707-4f3a-96ce-1776a2697b90 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:06.117883 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc127e64-8707-4f3a-96ce-1776a2697b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:06.133120 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-cc127e64-8707-4f3a-96ce-1776a2697b90 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:06.134307 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-cc127e64-8707-4f3a-96ce-1776a2697b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:06.153309 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606ab38-7c7e-4aba-bca9-bf2cce70c8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:06.153965 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606ab38-7c7e-4aba-bca9-bf2cce70c8f7 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:06.154247 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606ab38-7c7e-4aba-bca9-bf2cce70c8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:06.154519 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606ab38-7c7e-4aba-bca9-bf2cce70c8f7 None admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:06.155824 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6606ab38-7c7e-4aba-bca9-bf2cce70c8f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:06.156140 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6606ab38-7c7e-4aba-bca9-bf2cce70c8f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:06.157607 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6606ab38-7c7e-4aba-bca9-bf2cce70c8f7 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:06.175461 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 319/637] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 13:03:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:06.175461 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606ab38-7c7e-4aba-bca9-bf2cce70c8f7 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:06.213152 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 319/638] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:03:06.214181 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc127e64-8707-4f3a-96ce-1776a2697b90 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:06.278741 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:06.301562 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606ab38-7c7e-4aba-bca9-bf2cce70c8f7 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:06.320283 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:06.327156 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc127e64-8707-4f3a-96ce-1776a2697b90 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:06.337401 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4928b-c48a-401f-86c9-0c6e91b4a85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:06.338424 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4928b-c48a-401f-86c9-0c6e91b4a85a None admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:06.338803 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4928b-c48a-401f-86c9-0c6e91b4a85a None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:06.339172 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4928b-c48a-401f-86c9-0c6e91b4a85a None admin] PATH_INFO: `/v3/projects/c8c0bf799c9f451b8167a646a5c82eda/users/b07ad3dd7477497ea25c2a01bff35712/roles/eb985092d5f14e92a783e26568bf457b` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:06.355916 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc4928b-c48a-401f-86c9-0c6e91b4a85a None admin] RBAC: Authorizing `identity:create_grant(project_id=c8c0bf799c9f451b8167a646a5c82eda, user_id=b07ad3dd7477497ea25c2a01bff35712, role_id=eb985092d5f14e92a783e26568bf457b)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:06.357651 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc4928b-c48a-401f-86c9-0c6e91b4a85a None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:06.369687 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89586ae7-e83c-4157-afac-58d586fdd638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:06.376043 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89586ae7-e83c-4157-afac-58d586fdd638 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:06.376043 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89586ae7-e83c-4157-afac-58d586fdd638 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:06.376043 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89586ae7-e83c-4157-afac-58d586fdd638 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:06.381354 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89586ae7-e83c-4157-afac-58d586fdd638 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:06.382817 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89586ae7-e83c-4157-afac-58d586fdd638 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:06.400232 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-89586ae7-e83c-4157-afac-58d586fdd638 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:06.400232 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:06.400232 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:06.400232 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:06.400232 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:06.400232 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:06.400232 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:06.400232 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:06.400232 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:06.400232 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:06.400232 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:06.400232 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:06.400232 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:03:06.400232 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:03:06.400232 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:03:06.407319 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:03:06.407319 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:06.407319 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:06.407319 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:06.407319 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:06.407319 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:06.407319 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:06.407319 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:06.407319 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:06.407319 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:06.407319 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:06.407319 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:06.407319 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:06.407319 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:06.407319 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:06.407319 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:06.407319 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:06.408259 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:03:06.408259 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:03:06.408259 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:06.408259 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:06.408259 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 320/639] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:06.408259 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89586ae7-e83c-4157-afac-58d586fdd638 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:06.429069 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 320/640] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jun 3 13:03:06 2022] PUT /identity/v3/projects/c8c0bf799c9f451b8167a646a5c82eda/users/b07ad3dd7477497ea25c2a01bff35712/roles/eb985092d5f14e92a783e26568bf457b => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:06.430514 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4928b-c48a-401f-86c9-0c6e91b4a85a None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:06.537272 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89586ae7-e83c-4157-afac-58d586fdd638 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:06.545349 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:06.569778 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4928b-c48a-401f-86c9-0c6e91b4a85a None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:06.575194 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1484e-953e-440d-928d-6402c4e71f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:06.575940 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1484e-953e-440d-928d-6402c4e71f38 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:06.576269 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1484e-953e-440d-928d-6402c4e71f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:06.576567 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1484e-953e-440d-928d-6402c4e71f38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:06.577485 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a1484e-953e-440d-928d-6402c4e71f38 None admin] RBAC: Adding query filter params (role.id=eb985092d5f14e92a783e26568bf457b, scope.project.id=c8c0bf799c9f451b8167a646a5c82eda, user.id=066aaba3e9af4f85ab0cba89a3d32e34) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:06.577788 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a1484e-953e-440d-928d-6402c4e71f38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:06.579414 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a1484e-953e-440d-928d-6402c4e71f38 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:06.586977 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 321/641] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 13:03:06 2022] GET /identity/v3/role_assignments?user.id=066aaba3e9af4f85ab0cba89a3d32e34&scope.project.id=c8c0bf799c9f451b8167a646a5c82eda&role.id=eb985092d5f14e92a783e26568bf457b => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:06.587748 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1484e-953e-440d-928d-6402c4e71f38 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:06.628750 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6411fa-3802-4f31-afcf-3a98330236d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:06.630840 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6411fa-3802-4f31-afcf-3a98330236d9 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:06.631361 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6411fa-3802-4f31-afcf-3a98330236d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:06.631935 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6411fa-3802-4f31-afcf-3a98330236d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:06.648193 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6411fa-3802-4f31-afcf-3a98330236d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:03:06.657313 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-ca6411fa-3802-4f31-afcf-3a98330236d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 13:03:06.657313 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:06.657313 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:06.657313 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:06.657313 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:06.657313 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:06.657313 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:06.657313 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:06.657313 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:06.657313 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:06.657313 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:06.657313 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:06.657313 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:03:06.657313 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:03:06.657313 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:03:06.657313 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:03:06.658400 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:03:06.658400 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:03:06.658400 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:03:06.658400 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:03:06.658400 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:06.658400 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:06.658400 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:06.658400 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:06.658400 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:06.658400 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:06.658400 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:06.658400 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:06.658400 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:06.658400 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:06.658400 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:06.658400 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:06.659262 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:06.659262 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:06.659262 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:06.659262 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:06.659262 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:03:06.659262 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:03:06.659262 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:03:06.659262 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:03:06.659262 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:03:06.659262 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:03:06.659262 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 13:03:06.659262 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:06.659262 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 321/642] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jun 3 13:03:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:06.660632 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e13cc7-5087-4221-ab35-676e6656428c None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:06.661125 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e13cc7-5087-4221-ab35-676e6656428c None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:06.661125 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e13cc7-5087-4221-ab35-676e6656428c None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:06.662775 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 322/643] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:03:06.665117 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e13cc7-5087-4221-ab35-676e6656428c None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:06.699838 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:06.737091 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1484e-953e-440d-928d-6402c4e71f38 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:06.778269 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598954a4-b677-479b-b50d-921f81d6ad2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:06.778970 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598954a4-b677-479b-b50d-921f81d6ad2e None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:06.779254 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598954a4-b677-479b-b50d-921f81d6ad2e None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:06.779532 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598954a4-b677-479b-b50d-921f81d6ad2e None admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:06.780340 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598954a4-b677-479b-b50d-921f81d6ad2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:06.780769 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598954a4-b677-479b-b50d-921f81d6ad2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:06.782561 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598954a4-b677-479b-b50d-921f81d6ad2e None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:06.785972 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e13cc7-5087-4221-ab35-676e6656428c None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:06.796520 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 322/644] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:03:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:06.798991 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6041e-bcaa-4180-b923-d25c3247e554 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:06.799279 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6041e-bcaa-4180-b923-d25c3247e554 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:06.799554 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6041e-bcaa-4180-b923-d25c3247e554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:06.819635 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-73a6041e-bcaa-4180-b923-d25c3247e554 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:06.820909 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-73a6041e-bcaa-4180-b923-d25c3247e554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:06.824920 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2328205-4508-465a-b3ff-09c70dc1e578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:06.825596 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2328205-4508-465a-b3ff-09c70dc1e578 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:06.825888 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2328205-4508-465a-b3ff-09c70dc1e578 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:06.826157 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2328205-4508-465a-b3ff-09c70dc1e578 None admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:06.826938 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2328205-4508-465a-b3ff-09c70dc1e578 None admin] RBAC: Adding query filter params (name=service) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:06.827260 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2328205-4508-465a-b3ff-09c70dc1e578 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:06.828767 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2328205-4508-465a-b3ff-09c70dc1e578 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:06.837951 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 323/645] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jun 3 13:03:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:03:06.838807 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2328205-4508-465a-b3ff-09c70dc1e578 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:06.850386 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:06.901521 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 323/646] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:03:06.903113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6041e-bcaa-4180-b923-d25c3247e554 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:06.964504 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:06.981120 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2328205-4508-465a-b3ff-09c70dc1e578 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:07.032992 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5e9e0-48ac-4836-9335-30b5010a59ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:07.033802 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5e9e0-48ac-4836-9335-30b5010a59ff None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:07.034091 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5e9e0-48ac-4836-9335-30b5010a59ff None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:07.034229 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6041e-bcaa-4180-b923-d25c3247e554 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:07.034665 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5e9e0-48ac-4836-9335-30b5010a59ff None admin] PATH_INFO: `/v3/users/glance` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:07.043811 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a5e9e0-48ac-4836-9335-30b5010a59ff None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:07.047155 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a5e9e0-48ac-4836-9335-30b5010a59ff None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:07.070870 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-31a5e9e0-48ac-4836-9335-30b5010a59ff None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 03 13:03:07.070870 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:07.070870 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:07.070870 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:07.070870 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:07.070870 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:07.070870 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:07.070870 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:07.070870 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:07.070870 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:07.070870 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:07.070870 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:07.070870 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 13:03:07.070870 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 13:03:07.070870 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 13:03:07.070870 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 13:03:07.072318 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:07.072318 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:07.072318 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 13:03:07.072318 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:03:07.072318 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 13:03:07.072318 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:03:07.072318 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:07.072318 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:07.072318 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:07.072318 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:07.072318 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:07.072318 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:07.072318 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:07.072318 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:07.072318 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:07.072318 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:07.072318 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:07.072318 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:07.073398 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:07.073398 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:07.073398 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 13:03:07.073398 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 13:03:07.073398 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 13:03:07.073398 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 13:03:07.073398 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 13:03:07.073398 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 13:03:07.073398 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 03 13:03:07.073398 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:07.073946 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a47af-6e81-499c-a373-63cc25d5cd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:07.074036 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 324/647] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:03:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:07.074036 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5e9e0-48ac-4836-9335-30b5010a59ff None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:07.077386 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a47af-6e81-499c-a373-63cc25d5cd67 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:07.077735 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a47af-6e81-499c-a373-63cc25d5cd67 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:07.078028 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a47af-6e81-499c-a373-63cc25d5cd67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:07.089356 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a47af-6e81-499c-a373-63cc25d5cd67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:07.090929 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a47af-6e81-499c-a373-63cc25d5cd67 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:07.112113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-e80a47af-6e81-499c-a373-63cc25d5cd67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:07.112113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:07.112113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:07.112113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:07.112113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:07.112113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:07.112113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:07.112113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:07.112113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:07.112113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:07.112113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:07.112113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:07.112113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:03:07.112113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:03:07.112113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:03:07.114182 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:03:07.114182 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:07.114182 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:07.114182 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:07.114182 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:07.114182 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:07.114182 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:07.114182 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:07.114182 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:07.114182 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:07.114182 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:07.114182 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:07.114182 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:07.114182 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:07.114182 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:07.114182 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:07.114182 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:07.116292 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:03:07.116292 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:03:07.116292 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:07.116292 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:07.116292 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 324/648] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:07.124172 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a47af-6e81-499c-a373-63cc25d5cd67 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:07.134270 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:07.209260 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5e9e0-48ac-4836-9335-30b5010a59ff None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:07.230511 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a47af-6e81-499c-a373-63cc25d5cd67 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:07.250562 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59394acb-9fa2-4483-be46-55c4fa7c4d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:07.251728 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59394acb-9fa2-4483-be46-55c4fa7c4d7a None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:07.252465 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59394acb-9fa2-4483-be46-55c4fa7c4d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:07.252952 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59394acb-9fa2-4483-be46-55c4fa7c4d7a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:07.264790 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59394acb-9fa2-4483-be46-55c4fa7c4d7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:03:07.268861 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc98c0-f248-47d7-89e9-a7df4f15165a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:07.269581 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc98c0-f248-47d7-89e9-a7df4f15165a None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:07.269879 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc98c0-f248-47d7-89e9-a7df4f15165a None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:07.270158 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc98c0-f248-47d7-89e9-a7df4f15165a None admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:07.270999 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc98c0-f248-47d7-89e9-a7df4f15165a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:07.271306 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc98c0-f248-47d7-89e9-a7df4f15165a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:07.272768 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc98c0-f248-47d7-89e9-a7df4f15165a None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:07.274979 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-59394acb-9fa2-4483-be46-55c4fa7c4d7a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 13:03:07.274979 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:07.274979 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:07.274979 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:07.274979 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:07.274979 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:07.274979 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:07.274979 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:07.274979 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:07.274979 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:07.274979 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:07.274979 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:07.274979 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:03:07.274979 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:03:07.274979 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:03:07.274979 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:03:07.275938 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:03:07.275938 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:03:07.275938 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:03:07.275938 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:03:07.275938 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:07.275938 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:07.275938 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:07.275938 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:07.275938 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:07.275938 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:07.275938 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:07.275938 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:07.275938 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:07.275938 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:07.275938 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:07.275938 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:07.276822 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:07.276822 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:07.276822 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:07.276822 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:07.276822 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:03:07.276822 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:03:07.276822 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:03:07.276822 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:03:07.276822 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:03:07.276822 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:03:07.276822 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 13:03:07.276822 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:07.277477 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 325/649] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jun 3 13:03:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:07.278186 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59394acb-9fa2-4483-be46-55c4fa7c4d7a None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:07.293902 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:07.307445 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 325/650] 10.222.0.61 () {56 vars in 1137 bytes} [Fri Jun 3 13:03:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:07.307445 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc98c0-f248-47d7-89e9-a7df4f15165a None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:07.381772 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:07.391873 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59394acb-9fa2-4483-be46-55c4fa7c4d7a None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:07.417187 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc98c0-f248-47d7-89e9-a7df4f15165a None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:07.428276 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64503c-67f1-4eb5-a361-4cc8ec789a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:07.429097 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64503c-67f1-4eb5-a361-4cc8ec789a98 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:07.429598 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64503c-67f1-4eb5-a361-4cc8ec789a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:07.429889 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64503c-67f1-4eb5-a361-4cc8ec789a98 None admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:07.430712 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be64503c-67f1-4eb5-a361-4cc8ec789a98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:07.431124 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be64503c-67f1-4eb5-a361-4cc8ec789a98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:07.432690 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be64503c-67f1-4eb5-a361-4cc8ec789a98 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:07.446951 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 326/651] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:03:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:07.446951 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64503c-67f1-4eb5-a361-4cc8ec789a98 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:07.460794 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e83e2-af84-42fa-834c-4c1d303607c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:07.461714 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e83e2-af84-42fa-834c-4c1d303607c7 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:07.462192 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e83e2-af84-42fa-834c-4c1d303607c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:07.462682 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e83e2-af84-42fa-834c-4c1d303607c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:07.463742 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e83e2-af84-42fa-834c-4c1d303607c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:07.464380 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e83e2-af84-42fa-834c-4c1d303607c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:07.465953 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e83e2-af84-42fa-834c-4c1d303607c7 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:07.480352 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 326/652] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jun 3 13:03:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:07.481586 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e83e2-af84-42fa-834c-4c1d303607c7 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:07.524063 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:07.557360 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64503c-67f1-4eb5-a361-4cc8ec789a98 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:07.593732 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e83e2-af84-42fa-834c-4c1d303607c7 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:07.595612 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902874b8-6d95-4dbb-9435-eb5c942a3ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:07.596418 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902874b8-6d95-4dbb-9435-eb5c942a3ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:07.597886 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902874b8-6d95-4dbb-9435-eb5c942a3ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:07.598279 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902874b8-6d95-4dbb-9435-eb5c942a3ce4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:07.629570 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:07.635845 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4004bd-3855-435a-88ac-1aeb5f971f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:07.637113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4004bd-3855-435a-88ac-1aeb5f971f0a None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:07.637613 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4004bd-3855-435a-88ac-1aeb5f971f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:07.638059 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4004bd-3855-435a-88ac-1aeb5f971f0a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:07.651164 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4004bd-3855-435a-88ac-1aeb5f971f0a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:07.653142 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4004bd-3855-435a-88ac-1aeb5f971f0a None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:07.674791 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-8d4004bd-3855-435a-88ac-1aeb5f971f0a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 03 13:03:07.674791 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:07.674791 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:07.674791 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:07.674791 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:07.674791 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:07.674791 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:07.674791 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:07.674791 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:07.674791 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:07.674791 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:07.674791 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:07.674791 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 13:03:07.674791 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 13:03:07.674791 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 13:03:07.674791 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 13:03:07.675774 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:07.675774 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:07.675774 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 13:03:07.675774 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:03:07.675774 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 13:03:07.675774 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:03:07.675774 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:07.675774 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:07.675774 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:07.675774 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:07.675774 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:07.675774 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:07.675774 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:07.675774 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:07.675774 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:07.675774 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:07.675774 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:07.675774 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:07.677322 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:07.677322 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:07.677322 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 13:03:07.677322 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 13:03:07.677322 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 13:03:07.677322 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 13:03:07.677322 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 13:03:07.677322 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 13:03:07.677322 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 03 13:03:07.677322 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:07.677322 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 327/653] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:03:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:07.677322 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4004bd-3855-435a-88ac-1aeb5f971f0a None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:07.693535 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902874b8-6d95-4dbb-9435-eb5c942a3ce4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:07.695672 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902874b8-6d95-4dbb-9435-eb5c942a3ce4 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:07.782546 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4004bd-3855-435a-88ac-1aeb5f971f0a None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:07.788747 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:07.819231 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375b9e3-75dd-49d9-a181-bb280574142f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:07.820344 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375b9e3-75dd-49d9-a181-bb280574142f None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:07.820625 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375b9e3-75dd-49d9-a181-bb280574142f None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:07.820897 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375b9e3-75dd-49d9-a181-bb280574142f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:07.834738 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7375b9e3-75dd-49d9-a181-bb280574142f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:07.835001 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 327/654] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:03:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:07.836085 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902874b8-6d95-4dbb-9435-eb5c942a3ce4 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:07.836241 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7375b9e3-75dd-49d9-a181-bb280574142f None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:07.863249 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-7375b9e3-75dd-49d9-a181-bb280574142f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:07.863249 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:07.863249 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:07.863249 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:07.863249 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:07.863249 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:07.863249 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:07.863249 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:07.863249 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:07.863249 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:07.863249 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:07.863249 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:07.863249 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:03:07.863249 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:03:07.863249 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:03:07.864180 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:03:07.864180 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:07.864180 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:07.864180 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:07.864180 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:07.864180 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:07.864180 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:07.864180 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:07.864180 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:07.864180 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:07.864180 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:07.864180 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:07.864180 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:07.864180 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:07.864180 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:07.864180 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:07.864180 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:07.865115 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:03:07.865115 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:03:07.865115 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:07.865115 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:07.866043 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 328/655] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:07.866624 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375b9e3-75dd-49d9-a181-bb280574142f None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:07.923103 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:07.959028 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902874b8-6d95-4dbb-9435-eb5c942a3ce4 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:07.998670 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375b9e3-75dd-49d9-a181-bb280574142f None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:08.001299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5626ca4-6fba-4daf-8bd8-6904d05f3149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:08.002087 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5626ca4-6fba-4daf-8bd8-6904d05f3149 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:08.002369 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5626ca4-6fba-4daf-8bd8-6904d05f3149 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:08.002638 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5626ca4-6fba-4daf-8bd8-6904d05f3149 None admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:08.003474 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5626ca4-6fba-4daf-8bd8-6904d05f3149 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:08.004013 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5626ca4-6fba-4daf-8bd8-6904d05f3149 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:08.005517 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5626ca4-6fba-4daf-8bd8-6904d05f3149 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:08.029632 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 328/656] 10.222.0.61 () {56 vars in 1137 bytes} [Fri Jun 3 13:03:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:08.029632 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5626ca4-6fba-4daf-8bd8-6904d05f3149 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:08.060651 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:08.061961 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43028a0-f140-4b8a-b16e-e674412e590e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:08.063488 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43028a0-f140-4b8a-b16e-e674412e590e None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:08.064113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43028a0-f140-4b8a-b16e-e674412e590e None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:08.064955 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43028a0-f140-4b8a-b16e-e674412e590e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:08.080753 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43028a0-f140-4b8a-b16e-e674412e590e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:08.083212 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43028a0-f140-4b8a-b16e-e674412e590e None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:08.110284 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-a43028a0-f140-4b8a-b16e-e674412e590e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:08.110284 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:08.110284 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:08.110284 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:08.110284 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:08.110284 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:08.110284 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:08.110284 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:08.110284 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:08.110284 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:08.110284 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:08.110284 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:08.110284 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:03:08.110284 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:03:08.110284 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:03:08.111232 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:03:08.111232 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:08.111232 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:08.111232 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:08.111232 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:08.111232 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:08.111232 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:08.111232 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:08.111232 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:08.111232 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:08.111232 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:08.111232 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:08.111232 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:08.111232 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:08.111232 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:08.111232 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:08.111232 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:08.112122 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:03:08.112122 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:03:08.112122 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:08.112122 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:08.115000 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 329/657] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:08.116685 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43028a0-f140-4b8a-b16e-e674412e590e None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:08.143808 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5626ca4-6fba-4daf-8bd8-6904d05f3149 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:08.180676 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e8354-d188-4263-a8a6-81bc946919a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:08.181394 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e8354-d188-4263-a8a6-81bc946919a4 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:08.181673 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e8354-d188-4263-a8a6-81bc946919a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:08.181946 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e8354-d188-4263-a8a6-81bc946919a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:08.182660 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5e8354-d188-4263-a8a6-81bc946919a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:08.182962 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5e8354-d188-4263-a8a6-81bc946919a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:08.184373 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5e8354-d188-4263-a8a6-81bc946919a4 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:08.196719 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 329/658] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:08.197646 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e8354-d188-4263-a8a6-81bc946919a4 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:08.239276 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:08.246222 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43028a0-f140-4b8a-b16e-e674412e590e None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:08.284427 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e450fbfe-52ec-41fe-892b-95ea1a0029a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:08.285457 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e450fbfe-52ec-41fe-892b-95ea1a0029a4 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:08.285927 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e450fbfe-52ec-41fe-892b-95ea1a0029a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:08.286415 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e450fbfe-52ec-41fe-892b-95ea1a0029a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:08.294481 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:08.308251 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e8354-d188-4263-a8a6-81bc946919a4 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:08.346033 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee29991-e6f8-4c28-8008-42e125bbb819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:08.346864 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee29991-e6f8-4c28-8008-42e125bbb819 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:08.347209 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee29991-e6f8-4c28-8008-42e125bbb819 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:08.347911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee29991-e6f8-4c28-8008-42e125bbb819 None admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:08.348834 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee29991-e6f8-4c28-8008-42e125bbb819 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:08.349209 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee29991-e6f8-4c28-8008-42e125bbb819 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:08.350658 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee29991-e6f8-4c28-8008-42e125bbb819 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:08.363488 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 330/659] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:08.364461 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee29991-e6f8-4c28-8008-42e125bbb819 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:08.365156 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e450fbfe-52ec-41fe-892b-95ea1a0029a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:08.366837 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e450fbfe-52ec-41fe-892b-95ea1a0029a4 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:08.472132 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:08.476343 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee29991-e6f8-4c28-8008-42e125bbb819 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:08.485417 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 330/660] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:03:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:08.486577 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e450fbfe-52ec-41fe-892b-95ea1a0029a4 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:08.513368 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a3fce-0605-4fcc-ae7b-fb5f62a9722e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:08.514169 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a3fce-0605-4fcc-ae7b-fb5f62a9722e None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:08.514471 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a3fce-0605-4fcc-ae7b-fb5f62a9722e None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:08.516075 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a3fce-0605-4fcc-ae7b-fb5f62a9722e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:08.525997 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a3fce-0605-4fcc-ae7b-fb5f62a9722e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:08.527346 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a3fce-0605-4fcc-ae7b-fb5f62a9722e None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:08.542935 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-da0a3fce-0605-4fcc-ae7b-fb5f62a9722e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 03 13:03:08.542935 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:08.542935 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:08.542935 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:08.542935 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:08.542935 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:08.542935 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:08.542935 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:08.542935 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:08.542935 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:08.542935 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:08.542935 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:08.542935 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 13:03:08.542935 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 13:03:08.542935 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 13:03:08.542935 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 13:03:08.543935 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:08.543935 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:08.543935 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 13:03:08.543935 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:03:08.543935 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 13:03:08.543935 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:03:08.543935 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:08.543935 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:08.543935 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:08.543935 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:08.543935 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:08.543935 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:08.543935 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:08.543935 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:08.543935 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:08.543935 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:08.543935 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:08.543935 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:08.544918 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:08.544918 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:08.544918 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 13:03:08.544918 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 13:03:08.544918 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 13:03:08.544918 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 13:03:08.544918 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 13:03:08.544918 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 13:03:08.544918 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 03 13:03:08.544918 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:08.544918 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 331/661] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jun 3 13:03:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:08.545538 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a3fce-0605-4fcc-ae7b-fb5f62a9722e None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:08.558753 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:08.601624 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e450fbfe-52ec-41fe-892b-95ea1a0029a4 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:08.639398 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def37d3-8b2d-46da-b9fe-56fae29fb624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:08.641038 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def37d3-8b2d-46da-b9fe-56fae29fb624 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:08.641538 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def37d3-8b2d-46da-b9fe-56fae29fb624 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:08.642037 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def37d3-8b2d-46da-b9fe-56fae29fb624 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:08.649524 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2def37d3-8b2d-46da-b9fe-56fae29fb624 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:08.651238 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2def37d3-8b2d-46da-b9fe-56fae29fb624 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:08.655868 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a3fce-0605-4fcc-ae7b-fb5f62a9722e None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:08.666937 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-2def37d3-8b2d-46da-b9fe-56fae29fb624 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:03:08.666937 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:08.666937 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:08.666937 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:08.666937 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:08.666937 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:08.666937 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:08.666937 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:08.666937 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:08.666937 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:08.666937 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:08.666937 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:08.666937 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 13:03:08.666937 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 13:03:08.666937 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 13:03:08.667984 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 13:03:08.667984 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:08.667984 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:08.667984 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:08.667984 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:08.667984 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:08.667984 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:08.667984 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:08.667984 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:08.667984 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:08.667984 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:08.667984 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:08.667984 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:08.667984 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:08.667984 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:08.667984 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:08.667984 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:08.668915 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 13:03:08.668915 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 13:03:08.668915 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 13:03:08.668915 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 13:03:08.668915 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 13:03:08.668915 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 13:03:08.668915 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:03:08.668915 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:08.672361 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 331/662] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:03:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:08.673414 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def37d3-8b2d-46da-b9fe-56fae29fb624 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:08.692358 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab466f5a-0813-4c05-88e6-ba0f1575a834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:08.693149 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab466f5a-0813-4c05-88e6-ba0f1575a834 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:08.693432 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab466f5a-0813-4c05-88e6-ba0f1575a834 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:08.693762 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab466f5a-0813-4c05-88e6-ba0f1575a834 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:08.705612 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab466f5a-0813-4c05-88e6-ba0f1575a834 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:08.707118 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab466f5a-0813-4c05-88e6-ba0f1575a834 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:08.732734 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-ab466f5a-0813-4c05-88e6-ba0f1575a834 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:08.732734 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:08.732734 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:08.732734 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:08.732734 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:08.732734 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:08.732734 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:08.732734 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:08.732734 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:08.732734 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:08.732734 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:08.732734 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:08.732734 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:03:08.732734 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:03:08.732734 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:03:08.734588 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:03:08.734588 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:08.734588 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:08.734588 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:08.734588 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:08.734588 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:08.734588 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:08.734588 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:08.734588 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:08.734588 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:08.734588 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:08.734588 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:08.734588 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:08.734588 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:08.734588 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:08.734588 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:08.734588 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:08.735655 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:03:08.735655 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:03:08.735655 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:08.735655 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:08.738765 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 332/663] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:08.739742 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab466f5a-0813-4c05-88e6-ba0f1575a834 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:08.740452 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:08.788090 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def37d3-8b2d-46da-b9fe-56fae29fb624 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:08.810692 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:08.826754 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87eadb-2da4-4b00-82d0-bce72b71ce4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:08.827503 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87eadb-2da4-4b00-82d0-bce72b71ce4a None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:08.827787 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87eadb-2da4-4b00-82d0-bce72b71ce4a None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:08.828062 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87eadb-2da4-4b00-82d0-bce72b71ce4a None admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:08.828940 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac87eadb-2da4-4b00-82d0-bce72b71ce4a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:08.829244 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac87eadb-2da4-4b00-82d0-bce72b71ce4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:08.830707 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac87eadb-2da4-4b00-82d0-bce72b71ce4a None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:08.849166 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 332/664] 10.222.0.61 () {56 vars in 1139 bytes} [Fri Jun 3 13:03:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:08.853782 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87eadb-2da4-4b00-82d0-bce72b71ce4a None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:08.861340 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab466f5a-0813-4c05-88e6-ba0f1575a834 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:08.899705 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d84f68-1769-47a8-b204-50d050b7ec26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:08.900344 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d84f68-1769-47a8-b204-50d050b7ec26 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:08.900634 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d84f68-1769-47a8-b204-50d050b7ec26 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:08.900912 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d84f68-1769-47a8-b204-50d050b7ec26 None admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:08.901697 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d84f68-1769-47a8-b204-50d050b7ec26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:08.902016 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d84f68-1769-47a8-b204-50d050b7ec26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:08.903460 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d84f68-1769-47a8-b204-50d050b7ec26 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:08.916967 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 333/665] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 13:03:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:08.918245 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9558c4-809d-47d6-9ccc-03ece74d90b6 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:08.918530 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9558c4-809d-47d6-9ccc-03ece74d90b6 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:08.918805 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9558c4-809d-47d6-9ccc-03ece74d90b6 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:08.920222 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 334/666] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:03:08.924791 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9558c4-809d-47d6-9ccc-03ece74d90b6 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:08.963239 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87eadb-2da4-4b00-82d0-bce72b71ce4a None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:08.978665 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:09.005901 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6a9ea-05ea-4312-8ba7-65af79baf708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:09.006561 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6a9ea-05ea-4312-8ba7-65af79baf708 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:09.006837 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6a9ea-05ea-4312-8ba7-65af79baf708 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:09.007104 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6a9ea-05ea-4312-8ba7-65af79baf708 None admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:09.007819 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6a9ea-05ea-4312-8ba7-65af79baf708 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:09.008122 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6a9ea-05ea-4312-8ba7-65af79baf708 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:09.009602 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6a9ea-05ea-4312-8ba7-65af79baf708 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:09.023305 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 333/667] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:09.024126 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6a9ea-05ea-4312-8ba7-65af79baf708 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:09.042887 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9558c4-809d-47d6-9ccc-03ece74d90b6 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:09.063674 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:09.078746 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb7b88e-f72f-4dfc-93ee-d43bdd59ecdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:09.079486 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7b88e-f72f-4dfc-93ee-d43bdd59ecdb None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:09.079775 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7b88e-f72f-4dfc-93ee-d43bdd59ecdb None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:09.080051 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7b88e-f72f-4dfc-93ee-d43bdd59ecdb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:09.137384 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6a9ea-05ea-4312-8ba7-65af79baf708 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:09.151044 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb7b88e-f72f-4dfc-93ee-d43bdd59ecdb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:09.152480 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb7b88e-f72f-4dfc-93ee-d43bdd59ecdb None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:09.169804 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1502c67-9e99-449c-8054-b2677af924f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:09.170449 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1502c67-9e99-449c-8054-b2677af924f8 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:09.171320 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1502c67-9e99-449c-8054-b2677af924f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:09.172290 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1502c67-9e99-449c-8054-b2677af924f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:09.173119 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1502c67-9e99-449c-8054-b2677af924f8 None admin] RBAC: Adding query filter params (role.id=eb985092d5f14e92a783e26568bf457b, scope.project.id=c8c0bf799c9f451b8167a646a5c82eda, user.id=60eeb0b3e37a4604ab8f8b73c2b021f9) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:09.173426 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1502c67-9e99-449c-8054-b2677af924f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:09.174836 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1502c67-9e99-449c-8054-b2677af924f8 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:09.180542 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 334/668] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 13:03:09 2022] GET /identity/v3/role_assignments?user.id=60eeb0b3e37a4604ab8f8b73c2b021f9&scope.project.id=c8c0bf799c9f451b8167a646a5c82eda&role.id=eb985092d5f14e92a783e26568bf457b => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:09.181694 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec48dc6-44aa-42af-b16b-fa8710672424 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:09.181982 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec48dc6-44aa-42af-b16b-fa8710672424 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:09.182252 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec48dc6-44aa-42af-b16b-fa8710672424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:09.205073 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-8ec48dc6-44aa-42af-b16b-fa8710672424 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:09.206294 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-8ec48dc6-44aa-42af-b16b-fa8710672424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:09.239369 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:09.263258 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 335/669] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:03:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:09.269051 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb7b88e-f72f-4dfc-93ee-d43bdd59ecdb None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:09.279521 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 335/670] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:03:09.281912 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd454ff7-00d3-4e1a-bffb-8530be7f34dc None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:09.282198 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd454ff7-00d3-4e1a-bffb-8530be7f34dc None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:09.282469 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd454ff7-00d3-4e1a-bffb-8530be7f34dc None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:09.284006 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 336/671] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:03:09.284497 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd454ff7-00d3-4e1a-bffb-8530be7f34dc None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:09.304468 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:09.398345 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd454ff7-00d3-4e1a-bffb-8530be7f34dc None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:09.400283 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb7b88e-f72f-4dfc-93ee-d43bdd59ecdb None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:09.435831 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021c03f-2b9f-42d0-98e9-c0b2d7025a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:09.437153 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021c03f-2b9f-42d0-98e9-c0b2d7025a17 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:09.437571 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021c03f-2b9f-42d0-98e9-c0b2d7025a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:09.437956 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021c03f-2b9f-42d0-98e9-c0b2d7025a17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:09.445948 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546c3ce-4ab6-4b4e-b5d1-2ebf84f78114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:09.447093 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546c3ce-4ab6-4b4e-b5d1-2ebf84f78114 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:09.447093 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546c3ce-4ab6-4b4e-b5d1-2ebf84f78114 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:09.447302 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546c3ce-4ab6-4b4e-b5d1-2ebf84f78114 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:09.449709 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c021c03f-2b9f-42d0-98e9-c0b2d7025a17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:09.451068 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c021c03f-2b9f-42d0-98e9-c0b2d7025a17 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:09.456604 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9546c3ce-4ab6-4b4e-b5d1-2ebf84f78114 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:09.458297 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9546c3ce-4ab6-4b4e-b5d1-2ebf84f78114 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:09.470809 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-c021c03f-2b9f-42d0-98e9-c0b2d7025a17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:09.470809 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:09.470809 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:09.470809 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:09.470809 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:09.470809 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:09.470809 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:09.470809 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:09.470809 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:09.470809 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:09.470809 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:09.470809 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:09.470809 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:03:09.470809 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:03:09.470809 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:03:09.471712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:03:09.471712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:09.471712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:09.471712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:09.471712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:09.471712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:09.471712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:09.471712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:09.471712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:09.471712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:09.471712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:09.471712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:09.471712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:09.471712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:09.471712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:09.471712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:09.471712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:09.473039 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:03:09.473039 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:03:09.473039 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:09.473039 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:09.474700 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-9546c3ce-4ab6-4b4e-b5d1-2ebf84f78114 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:03:09.474700 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:09.474700 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:09.474700 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:09.474700 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:09.474700 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:09.474700 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:09.474700 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:09.474700 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:09.474700 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:09.474700 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:09.474700 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:09.474700 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 13:03:09.474700 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 13:03:09.474700 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 13:03:09.475519 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 13:03:09.475519 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:09.475519 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:09.475519 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:09.475519 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:09.475519 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:09.475519 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:09.475519 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:09.475519 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:09.475519 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:09.475519 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:09.475519 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:09.475519 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:09.475519 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:09.475519 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:09.475519 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:09.475519 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:09.476466 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 13:03:09.476466 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 13:03:09.476466 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 13:03:09.476466 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 13:03:09.476466 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 13:03:09.476466 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 13:03:09.476466 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:03:09.476466 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:09.476466 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 336/672] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:03:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:09.477019 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 337/673] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:09.477948 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021c03f-2b9f-42d0-98e9-c0b2d7025a17 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:09.478127 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47182b-3cfb-4bb0-871c-0208604395c3 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:09.478127 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47182b-3cfb-4bb0-871c-0208604395c3 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:09.478127 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47182b-3cfb-4bb0-871c-0208604395c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:09.500374 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-6e47182b-3cfb-4bb0-871c-0208604395c3 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:09.501465 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:09.502057 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-6e47182b-3cfb-4bb0-871c-0208604395c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:09.581963 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021c03f-2b9f-42d0-98e9-c0b2d7025a17 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:09.588491 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 337/674] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:03:09.589654 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e47182b-3cfb-4bb0-871c-0208604395c3 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:09.602916 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:09.619892 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd49bce-783d-42d7-8ea5-befeb2abcce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:09.620739 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd49bce-783d-42d7-8ea5-befeb2abcce1 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:09.621020 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd49bce-783d-42d7-8ea5-befeb2abcce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:09.621295 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd49bce-783d-42d7-8ea5-befeb2abcce1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:09.632528 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd49bce-783d-42d7-8ea5-befeb2abcce1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:03:09.640571 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-6bd49bce-783d-42d7-8ea5-befeb2abcce1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 13:03:09.640571 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:09.640571 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:09.640571 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:09.640571 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:09.640571 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:09.640571 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:09.640571 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:09.640571 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:09.640571 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:09.640571 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:09.640571 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:09.640571 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:03:09.640571 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:03:09.640571 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:03:09.640571 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:03:09.641520 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:03:09.641520 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:03:09.641520 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:03:09.641520 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:03:09.641520 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:09.641520 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:09.641520 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:09.641520 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:09.641520 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:09.641520 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:09.641520 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:09.641520 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:09.641520 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:09.641520 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:09.641520 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:09.641520 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:09.642343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:09.642343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:09.642343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:09.642343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:09.642343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:03:09.642343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:03:09.642343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:03:09.642343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:03:09.642343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:03:09.642343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:03:09.642343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 13:03:09.642343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:09.642343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 338/675] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jun 3 13:03:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:09.643033 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd49bce-783d-42d7-8ea5-befeb2abcce1 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:09.711312 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e47182b-3cfb-4bb0-871c-0208604395c3 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:09.731457 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:09.751378 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ce17f-bba9-4dc4-b1d5-838a84d288ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:09.752042 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ce17f-bba9-4dc4-b1d5-838a84d288ac None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:09.752359 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ce17f-bba9-4dc4-b1d5-838a84d288ac None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:09.752639 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ce17f-bba9-4dc4-b1d5-838a84d288ac None admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:09.753418 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051ce17f-bba9-4dc4-b1d5-838a84d288ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:09.753728 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051ce17f-bba9-4dc4-b1d5-838a84d288ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:09.755163 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051ce17f-bba9-4dc4-b1d5-838a84d288ac None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:09.755996 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd49bce-783d-42d7-8ea5-befeb2abcce1 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:09.773053 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 338/676] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 13:03:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:09.773053 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ce17f-bba9-4dc4-b1d5-838a84d288ac None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:09.794923 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0c1cd-7d53-46b1-8604-6730cde930ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:09.796216 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0c1cd-7d53-46b1-8604-6730cde930ec None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:09.796575 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0c1cd-7d53-46b1-8604-6730cde930ec None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:09.797101 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0c1cd-7d53-46b1-8604-6730cde930ec None admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:09.797908 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea0c1cd-7d53-46b1-8604-6730cde930ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:09.798223 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea0c1cd-7d53-46b1-8604-6730cde930ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:09.799612 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea0c1cd-7d53-46b1-8604-6730cde930ec None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:09.818948 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 339/677] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:03:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:09.818948 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0c1cd-7d53-46b1-8604-6730cde930ec None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:09.858837 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:09.889949 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ce17f-bba9-4dc4-b1d5-838a84d288ac None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:09.923889 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0c1cd-7d53-46b1-8604-6730cde930ec None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:09.925728 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf0fa4-2e5d-4e7f-a5c8-2937b968ae6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:09.926535 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf0fa4-2e5d-4e7f-a5c8-2937b968ae6c None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:09.926820 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf0fa4-2e5d-4e7f-a5c8-2937b968ae6c None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:09.927094 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf0fa4-2e5d-4e7f-a5c8-2937b968ae6c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:09.939254 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbf0fa4-2e5d-4e7f-a5c8-2937b968ae6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:03:09.946963 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-afbf0fa4-2e5d-4e7f-a5c8-2937b968ae6c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:03:09.946963 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:09.946963 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:09.946963 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:09.946963 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:09.946963 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:09.946963 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:09.946963 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:09.946963 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:09.946963 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:09.946963 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:09.946963 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:09.946963 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:03:09.946963 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:03:09.946963 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:03:09.946963 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:03:09.948101 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:03:09.948101 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:03:09.948101 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:03:09.948101 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:03:09.948101 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:09.948101 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:09.948101 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:09.948101 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:09.948101 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:09.948101 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:09.948101 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:09.948101 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:09.948101 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:09.948101 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:09.948101 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:09.948101 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:09.948976 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:09.948976 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:09.948976 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:09.948976 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:09.948976 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:03:09.948976 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:03:09.948976 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:03:09.948976 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:03:09.948976 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:03:09.948976 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:03:09.948976 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:03:09.948976 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:09.949622 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 339/678] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 13:03:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:09.950290 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf0fa4-2e5d-4e7f-a5c8-2937b968ae6c None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:09.966931 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8c6c6-8e7d-49dd-9e6f-31e97e360414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:09.969078 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8c6c6-8e7d-49dd-9e6f-31e97e360414 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:09.969967 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8c6c6-8e7d-49dd-9e6f-31e97e360414 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:09.970247 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8c6c6-8e7d-49dd-9e6f-31e97e360414 None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:09.971008 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f8c6c6-8e7d-49dd-9e6f-31e97e360414 None admin] RBAC: Adding query filter params (name=service) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:09.971315 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f8c6c6-8e7d-49dd-9e6f-31e97e360414 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:09.974774 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f8c6c6-8e7d-49dd-9e6f-31e97e360414 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:09.988447 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 340/679] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jun 3 13:03:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:09.988447 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8c6c6-8e7d-49dd-9e6f-31e97e360414 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:09.988447 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:10.079547 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf0fa4-2e5d-4e7f-a5c8-2937b968ae6c None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:10.097259 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8c6c6-8e7d-49dd-9e6f-31e97e360414 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:10.109976 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:10.116702 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169965c8-3f16-4d15-a361-803ac3e7844b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:10.117581 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169965c8-3f16-4d15-a361-803ac3e7844b None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:10.117864 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169965c8-3f16-4d15-a361-803ac3e7844b None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:10.127218 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169965c8-3f16-4d15-a361-803ac3e7844b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:10.127218 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169965c8-3f16-4d15-a361-803ac3e7844b None admin] RBAC: Adding query filter params (role.id=eb985092d5f14e92a783e26568bf457b, scope.project.id=c8c0bf799c9f451b8167a646a5c82eda, user.id=303176c26fc74d4892b2f83c81f01b60) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:10.127218 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169965c8-3f16-4d15-a361-803ac3e7844b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:10.127218 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169965c8-3f16-4d15-a361-803ac3e7844b None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:10.129007 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 340/680] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 13:03:09 2022] GET /identity/v3/role_assignments?user.id=303176c26fc74d4892b2f83c81f01b60&scope.project.id=c8c0bf799c9f451b8167a646a5c82eda&role.id=eb985092d5f14e92a783e26568bf457b => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:10.130143 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169965c8-3f16-4d15-a361-803ac3e7844b None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:10.159438 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797e1d2-9cf1-44f9-87d0-2880550c5c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:10.160531 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797e1d2-9cf1-44f9-87d0-2880550c5c0f None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:10.160812 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797e1d2-9cf1-44f9-87d0-2880550c5c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:10.161203 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797e1d2-9cf1-44f9-87d0-2880550c5c0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:10.169722 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797e1d2-9cf1-44f9-87d0-2880550c5c0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:10.172067 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797e1d2-9cf1-44f9-87d0-2880550c5c0f None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:10.191791 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-9797e1d2-9cf1-44f9-87d0-2880550c5c0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:03:10.191791 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:10.191791 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:10.191791 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:10.191791 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:10.191791 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:10.191791 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:10.191791 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:10.191791 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:10.191791 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:10.191791 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:10.191791 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:10.191791 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 13:03:10.191791 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 13:03:10.191791 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 13:03:10.192890 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 13:03:10.192890 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:10.192890 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:10.192890 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:10.192890 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:10.192890 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:10.192890 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:10.192890 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:10.192890 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:10.192890 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:10.192890 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:10.192890 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:10.192890 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:10.192890 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:10.192890 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:10.192890 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:10.192890 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:10.193801 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 13:03:10.193801 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 13:03:10.193801 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 13:03:10.193801 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 13:03:10.193801 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 13:03:10.193801 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 13:03:10.193801 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:03:10.193801 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:10.194248 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 341/681] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:03:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:10.200172 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797e1d2-9cf1-44f9-87d0-2880550c5c0f None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:10.273567 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:10.280815 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169965c8-3f16-4d15-a361-803ac3e7844b None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:10.324966 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797e1d2-9cf1-44f9-87d0-2880550c5c0f None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:10.330575 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6106f1-6e81-4449-8783-14b2f186018e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:10.331402 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6106f1-6e81-4449-8783-14b2f186018e None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:10.331827 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6106f1-6e81-4449-8783-14b2f186018e None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:10.332236 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6106f1-6e81-4449-8783-14b2f186018e None admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:10.333463 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6106f1-6e81-4449-8783-14b2f186018e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:10.334096 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6106f1-6e81-4449-8783-14b2f186018e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:10.335941 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6106f1-6e81-4449-8783-14b2f186018e None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:10.355835 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 341/682] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:03:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:10.355835 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6106f1-6e81-4449-8783-14b2f186018e None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:10.392361 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8d759-964f-40a2-abe4-c6fecd6f55b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:10.393256 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8d759-964f-40a2-abe4-c6fecd6f55b7 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:10.393551 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8d759-964f-40a2-abe4-c6fecd6f55b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:10.393827 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8d759-964f-40a2-abe4-c6fecd6f55b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:10.413210 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf8d759-964f-40a2-abe4-c6fecd6f55b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:10.415672 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf8d759-964f-40a2-abe4-c6fecd6f55b7 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:10.440289 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:10.441102 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-faf8d759-964f-40a2-abe4-c6fecd6f55b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:10.441102 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:10.441102 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:10.441102 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:10.441102 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:10.441102 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:10.441102 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:10.441102 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:10.441102 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:10.441102 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:10.441102 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:10.441102 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:10.441102 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:03:10.441102 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:03:10.441102 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:03:10.442005 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:03:10.442005 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:10.442005 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:10.442005 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:10.442005 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:10.442005 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:10.442005 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:10.442005 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:10.442005 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:10.442005 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:10.442005 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:10.442005 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:10.442005 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:10.442005 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:10.442005 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:10.442005 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:10.442005 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:10.442913 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:03:10.442913 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:03:10.442913 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:10.442913 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:10.442913 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 342/683] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:10.444138 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8d759-964f-40a2-abe4-c6fecd6f55b7 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:10.496689 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6106f1-6e81-4449-8783-14b2f186018e None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:10.534869 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc17e5-8557-4e7e-b276-98e89f67ecae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:10.536181 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc17e5-8557-4e7e-b276-98e89f67ecae None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:10.536770 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc17e5-8557-4e7e-b276-98e89f67ecae None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:10.537269 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc17e5-8557-4e7e-b276-98e89f67ecae None admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:10.538703 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cc17e5-8557-4e7e-b276-98e89f67ecae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:10.539282 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cc17e5-8557-4e7e-b276-98e89f67ecae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:10.540978 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cc17e5-8557-4e7e-b276-98e89f67ecae None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:10.555285 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 342/684] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 13:03:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:10.556586 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc17e5-8557-4e7e-b276-98e89f67ecae None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:10.579906 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8d759-964f-40a2-abe4-c6fecd6f55b7 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:10.595867 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:10.621721 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd8a81a-5c86-47aa-a7a9-8a590fce1280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:10.622533 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8a81a-5c86-47aa-a7a9-8a590fce1280 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:10.622815 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8a81a-5c86-47aa-a7a9-8a590fce1280 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:10.623093 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8a81a-5c86-47aa-a7a9-8a590fce1280 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:10.635956 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd8a81a-5c86-47aa-a7a9-8a590fce1280 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:10.637646 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd8a81a-5c86-47aa-a7a9-8a590fce1280 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:10.659129 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-2fd8a81a-5c86-47aa-a7a9-8a590fce1280 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:10.659129 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:10.659129 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:10.659129 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:10.659129 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:10.659129 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:10.659129 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:10.659129 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:10.659129 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:10.659129 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:10.659129 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:10.659129 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:10.659129 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:03:10.659129 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:03:10.659129 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:03:10.660123 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:03:10.660123 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:10.660123 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:10.660123 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:10.660123 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:10.660123 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:10.660123 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:10.660123 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:10.660123 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:10.660123 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:10.660123 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:10.660123 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:10.660123 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:10.660123 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:10.660123 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:10.660123 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:10.660123 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:10.661047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:03:10.661047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:03:10.661047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:10.661047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:10.661047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 343/685] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:10.661774 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd8a81a-5c86-47aa-a7a9-8a590fce1280 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:10.678062 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc17e5-8557-4e7e-b276-98e89f67ecae None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:10.697606 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:10.718750 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2ee33-9ee1-47a3-8956-bcf63010b5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:10.719798 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2ee33-9ee1-47a3-8956-bcf63010b5b6 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:10.720336 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2ee33-9ee1-47a3-8956-bcf63010b5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:10.720813 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2ee33-9ee1-47a3-8956-bcf63010b5b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:10.721880 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2ee33-9ee1-47a3-8956-bcf63010b5b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:10.722769 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2ee33-9ee1-47a3-8956-bcf63010b5b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:10.724408 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2ee33-9ee1-47a3-8956-bcf63010b5b6 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:10.739280 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 343/686] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:03:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:10.740493 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2ee33-9ee1-47a3-8956-bcf63010b5b6 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:10.801363 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd8a81a-5c86-47aa-a7a9-8a590fce1280 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:10.837783 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710be278-3e9f-4f9b-9385-94f175603f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:10.838463 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710be278-3e9f-4f9b-9385-94f175603f77 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:10.838712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710be278-3e9f-4f9b-9385-94f175603f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:10.838984 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710be278-3e9f-4f9b-9385-94f175603f77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:10.839863 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710be278-3e9f-4f9b-9385-94f175603f77 None admin] RBAC: Adding query filter params (role.id=eb985092d5f14e92a783e26568bf457b, scope.project.id=c8c0bf799c9f451b8167a646a5c82eda, user.id=bdb5b24bd01c405c93e32ab4b329bcf1) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:10.840188 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710be278-3e9f-4f9b-9385-94f175603f77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:10.841625 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710be278-3e9f-4f9b-9385-94f175603f77 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:10.848815 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 344/687] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 13:03:10 2022] GET /identity/v3/role_assignments?user.id=bdb5b24bd01c405c93e32ab4b329bcf1&scope.project.id=c8c0bf799c9f451b8167a646a5c82eda&role.id=eb985092d5f14e92a783e26568bf457b => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:10.849722 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710be278-3e9f-4f9b-9385-94f175603f77 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:10.856692 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2ee33-9ee1-47a3-8956-bcf63010b5b6 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:10.896640 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:10.918013 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ed45f-dfe3-475d-9fe7-4f8fe411d216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:10.918700 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ed45f-dfe3-475d-9fe7-4f8fe411d216 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:10.918982 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ed45f-dfe3-475d-9fe7-4f8fe411d216 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:10.919257 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ed45f-dfe3-475d-9fe7-4f8fe411d216 None admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:10.920099 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37ed45f-dfe3-475d-9fe7-4f8fe411d216 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:10.920443 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37ed45f-dfe3-475d-9fe7-4f8fe411d216 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:10.929665 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37ed45f-dfe3-475d-9fe7-4f8fe411d216 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:10.962531 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 344/688] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:03:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:10.963060 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710be278-3e9f-4f9b-9385-94f175603f77 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:10.969356 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ed45f-dfe3-475d-9fe7-4f8fe411d216 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:11.008421 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91b8d7-d8c6-4dff-9b4e-13b541e8cf56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:11.009651 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91b8d7-d8c6-4dff-9b4e-13b541e8cf56 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:11.009930 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91b8d7-d8c6-4dff-9b4e-13b541e8cf56 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:11.010345 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91b8d7-d8c6-4dff-9b4e-13b541e8cf56 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:11.029420 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b91b8d7-d8c6-4dff-9b4e-13b541e8cf56 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:11.031821 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b91b8d7-d8c6-4dff-9b4e-13b541e8cf56 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:11.053391 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:11.064727 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-7b91b8d7-d8c6-4dff-9b4e-13b541e8cf56 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 03 13:03:11.064727 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:11.064727 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:11.064727 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:11.064727 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:11.064727 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:11.064727 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:11.064727 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:11.064727 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:11.064727 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:11.064727 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:11.064727 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:11.064727 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 13:03:11.064727 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 13:03:11.064727 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 13:03:11.064727 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 13:03:11.070817 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:11.070817 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:11.070817 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 13:03:11.070817 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:03:11.070817 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 13:03:11.070817 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:03:11.070817 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:11.070817 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:11.070817 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:11.070817 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:11.070817 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:11.070817 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:11.070817 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:11.070817 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:11.070817 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:11.070817 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:11.070817 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:11.070817 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:11.071755 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:11.071755 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:11.071755 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 13:03:11.071755 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 13:03:11.071755 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 13:03:11.071755 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 13:03:11.071755 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 13:03:11.071755 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 13:03:11.071755 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 03 13:03:11.071755 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:11.071755 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 345/689] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 13:03:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:11.072376 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91b8d7-d8c6-4dff-9b4e-13b541e8cf56 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:11.189957 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:11.193676 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ed45f-dfe3-475d-9fe7-4f8fe411d216 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:11.202497 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91b8d7-d8c6-4dff-9b4e-13b541e8cf56 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:11.242543 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53adf635-f1a6-4b4e-bf5c-aeffe777e464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:11.243648 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53adf635-f1a6-4b4e-bf5c-aeffe777e464 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:11.244067 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53adf635-f1a6-4b4e-bf5c-aeffe777e464 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:11.244484 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53adf635-f1a6-4b4e-bf5c-aeffe777e464 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:11.251017 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73abc6f6-c7b4-4f14-965d-36364c9817a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:11.251699 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73abc6f6-c7b4-4f14-965d-36364c9817a4 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:11.251980 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73abc6f6-c7b4-4f14-965d-36364c9817a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:11.252455 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73abc6f6-c7b4-4f14-965d-36364c9817a4 None admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:11.253325 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53adf635-f1a6-4b4e-bf5c-aeffe777e464 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:11.253493 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73abc6f6-c7b4-4f14-965d-36364c9817a4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:11.253721 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73abc6f6-c7b4-4f14-965d-36364c9817a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:11.255162 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73abc6f6-c7b4-4f14-965d-36364c9817a4 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:11.255343 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53adf635-f1a6-4b4e-bf5c-aeffe777e464 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:11.273714 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-53adf635-f1a6-4b4e-bf5c-aeffe777e464 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 13:03:11.273714 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:11.273714 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:11.273714 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:11.273714 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:11.273714 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:11.273714 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:11.273714 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:11.273714 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:11.273714 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:11.273714 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:11.273714 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:11.273714 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 13:03:11.273714 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 13:03:11.273714 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 13:03:11.273714 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 13:03:11.275922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:11.275922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:11.275922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 13:03:11.275922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:03:11.275922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 13:03:11.275922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:03:11.275922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:11.275922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:11.275922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:11.275922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:11.275922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:11.275922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:11.275922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:11.275922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:11.275922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:11.275922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:11.275922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:11.275922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:11.277601 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:11.277601 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:11.277601 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 13:03:11.277601 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 13:03:11.277601 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 13:03:11.277601 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 13:03:11.277601 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 13:03:11.277601 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 13:03:11.277601 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 13:03:11.277601 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:11.277601 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 345/690] 10.222.0.61 () {56 vars in 1093 bytes} [Fri Jun 3 13:03:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:11.278937 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 346/691] 10.222.0.61 () {56 vars in 1135 bytes} [Fri Jun 3 13:03:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:11.282331 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53adf635-f1a6-4b4e-bf5c-aeffe777e464 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:11.285164 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73abc6f6-c7b4-4f14-965d-36364c9817a4 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:11.390504 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:11.396964 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73abc6f6-c7b4-4f14-965d-36364c9817a4 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:11.397984 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53adf635-f1a6-4b4e-bf5c-aeffe777e464 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:11.433655 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb1601-1576-4d30-96d0-aad8e4199191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:11.434322 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb1601-1576-4d30-96d0-aad8e4199191 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:11.434603 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb1601-1576-4d30-96d0-aad8e4199191 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:11.434876 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb1601-1576-4d30-96d0-aad8e4199191 None admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:11.435911 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb1601-1576-4d30-96d0-aad8e4199191 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:11.436379 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb1601-1576-4d30-96d0-aad8e4199191 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:11.437406 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3443e19-4f2b-4713-999d-94fa487b0598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:11.437848 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb1601-1576-4d30-96d0-aad8e4199191 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:11.438515 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3443e19-4f2b-4713-999d-94fa487b0598 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:11.439021 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3443e19-4f2b-4713-999d-94fa487b0598 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:11.439588 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3443e19-4f2b-4713-999d-94fa487b0598 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:11.456924 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 347/692] 10.222.0.61 () {56 vars in 1133 bytes} [Fri Jun 3 13:03:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:11.469296 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb1601-1576-4d30-96d0-aad8e4199191 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:11.478368 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:11.519125 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3443e19-4f2b-4713-999d-94fa487b0598 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:11.521134 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3443e19-4f2b-4713-999d-94fa487b0598 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:11.624953 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:11.632716 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 346/693] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:03:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 03 13:03:11.637230 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb1601-1576-4d30-96d0-aad8e4199191 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:11.648008 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3443e19-4f2b-4713-999d-94fa487b0598 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:11.674207 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8094c-9699-4f64-a77d-268479db9d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:11.674791 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8094c-9699-4f64-a77d-268479db9d2c None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:11.675074 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8094c-9699-4f64-a77d-268479db9d2c None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:11.675350 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8094c-9699-4f64-a77d-268479db9d2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:11.753450 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3443e19-4f2b-4713-999d-94fa487b0598 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:11.790435 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08548f95-f565-4500-8a97-6458f0f861b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:11.791606 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08548f95-f565-4500-8a97-6458f0f861b4 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:11.792109 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08548f95-f565-4500-8a97-6458f0f861b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:11.792608 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08548f95-f565-4500-8a97-6458f0f861b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:11.803916 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08548f95-f565-4500-8a97-6458f0f861b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:11.805785 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08548f95-f565-4500-8a97-6458f0f861b4 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:11.817520 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c8094c-9699-4f64-a77d-268479db9d2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:11.818975 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c8094c-9699-4f64-a77d-268479db9d2c None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:11.825825 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-08548f95-f565-4500-8a97-6458f0f861b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:11.825825 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:11.825825 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:11.825825 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:11.825825 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:11.825825 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:11.825825 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:11.825825 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:11.825825 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:11.825825 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:11.825825 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:11.825825 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:11.825825 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:03:11.825825 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:03:11.825825 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:03:11.826710 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:03:11.826710 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:11.826710 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:11.826710 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:11.826710 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:11.826710 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:11.826710 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:11.826710 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:11.826710 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:11.826710 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:11.826710 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:11.826710 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:11.826710 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:11.826710 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:11.826710 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:11.826710 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:11.826710 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:11.828401 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:03:11.828401 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:03:11.828401 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:11.828401 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:11.830631 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 347/694] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:11.835677 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:11.836484 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08548f95-f565-4500-8a97-6458f0f861b4 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:11.930148 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:11.979982 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 348/695] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:03:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:11.984946 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c6e9d-c88e-4667-bbe1-b606b31e4d1f None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:11.985229 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c6e9d-c88e-4667-bbe1-b606b31e4d1f None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:11.985502 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c6e9d-c88e-4667-bbe1-b606b31e4d1f None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:11.988532 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 349/696] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:03:11.989325 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c6e9d-c88e-4667-bbe1-b606b31e4d1f None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:12.013344 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08548f95-f565-4500-8a97-6458f0f861b4 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:12.051025 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f6f9b-e248-49fc-b058-369767cd9418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:12.051692 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f6f9b-e248-49fc-b058-369767cd9418 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:12.051977 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f6f9b-e248-49fc-b058-369767cd9418 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:12.052287 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f6f9b-e248-49fc-b058-369767cd9418 None admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:12.053009 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f6f9b-e248-49fc-b058-369767cd9418 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:12.053315 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f6f9b-e248-49fc-b058-369767cd9418 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:12.054694 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f6f9b-e248-49fc-b058-369767cd9418 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:12.068022 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 348/697] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:12.069333 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18fa04-fe5a-4ecc-8fd1-22356778d696 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:12.069620 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18fa04-fe5a-4ecc-8fd1-22356778d696 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:12.069896 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18fa04-fe5a-4ecc-8fd1-22356778d696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:12.086533 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-cd18fa04-fe5a-4ecc-8fd1-22356778d696 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:12.087735 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-cd18fa04-fe5a-4ecc-8fd1-22356778d696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:12.101657 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c6e9d-c88e-4667-bbe1-b606b31e4d1f None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:12.112460 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:12.140583 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0061c4-db30-4075-8e59-9b315b79ac66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:12.141481 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0061c4-db30-4075-8e59-9b315b79ac66 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:12.141771 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0061c4-db30-4075-8e59-9b315b79ac66 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:12.142054 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0061c4-db30-4075-8e59-9b315b79ac66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:12.153387 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0061c4-db30-4075-8e59-9b315b79ac66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:12.155164 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0061c4-db30-4075-8e59-9b315b79ac66 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:12.164478 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 349/698] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:03:12.165410 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18fa04-fe5a-4ecc-8fd1-22356778d696 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:12.175671 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-ac0061c4-db30-4075-8e59-9b315b79ac66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:12.175671 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:12.175671 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:12.175671 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:12.175671 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:12.175671 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:12.175671 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:12.175671 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:12.175671 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:12.175671 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:12.175671 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:12.175671 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:12.175671 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:03:12.175671 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:03:12.175671 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:03:12.176780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:03:12.176780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:12.176780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:12.176780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:12.176780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:12.176780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:12.176780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:12.176780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:12.176780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:12.176780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:12.176780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:12.176780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:12.176780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:12.176780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:12.176780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:12.176780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:12.176780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:12.177780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:03:12.177780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:03:12.177780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:12.177780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:12.180373 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 350/699] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:12.182806 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0061c4-db30-4075-8e59-9b315b79ac66 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:12.228720 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:12.291631 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18fa04-fe5a-4ecc-8fd1-22356778d696 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:12.293902 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0061c4-db30-4075-8e59-9b315b79ac66 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:12.327729 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a4aa21-fed9-449d-8068-44d1983400f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:12.328738 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4aa21-fed9-449d-8068-44d1983400f2 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:12.329101 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4aa21-fed9-449d-8068-44d1983400f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:12.329510 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4aa21-fed9-449d-8068-44d1983400f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:12.332542 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5fbfda-023b-498a-b287-6da096acf3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:12.333215 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5fbfda-023b-498a-b287-6da096acf3ac None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:12.333495 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5fbfda-023b-498a-b287-6da096acf3ac None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:12.333776 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5fbfda-023b-498a-b287-6da096acf3ac None admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:12.334505 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5fbfda-023b-498a-b287-6da096acf3ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:12.334814 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5fbfda-023b-498a-b287-6da096acf3ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:12.336204 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5fbfda-023b-498a-b287-6da096acf3ac None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:12.337348 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a4aa21-fed9-449d-8068-44d1983400f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:12.338886 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a4aa21-fed9-449d-8068-44d1983400f2 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:12.354132 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-14a4aa21-fed9-449d-8068-44d1983400f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:03:12.354132 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:12.354132 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:12.354132 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:12.354132 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:12.354132 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:12.354132 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:12.354132 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:12.354132 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:12.354132 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:12.354132 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:12.354132 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:12.354132 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 13:03:12.354132 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 13:03:12.354132 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 13:03:12.355243 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 13:03:12.355243 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:12.355243 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:12.355243 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:12.355243 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:12.355243 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:12.355243 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:12.355243 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:12.355243 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:12.355243 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:12.355243 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:12.355243 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:12.355243 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:12.355243 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:12.355243 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:12.355243 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:12.355243 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:12.356366 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 13:03:12.356366 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 13:03:12.356366 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 13:03:12.356366 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 13:03:12.356366 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 13:03:12.356366 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 13:03:12.356366 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:03:12.356366 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:12.356901 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 351/700] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:03:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:03:12.356901 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5fbfda-023b-498a-b287-6da096acf3ac None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:12.360169 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 350/701] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:03:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:12.360169 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a4aa21-fed9-449d-8068-44d1983400f2 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:12.377578 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:12.468973 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:12.471597 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5fbfda-023b-498a-b287-6da096acf3ac None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:12.473744 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a4aa21-fed9-449d-8068-44d1983400f2 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:12.510392 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5bb25-65b3-440e-80f7-2bdfd1dff200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:12.511211 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5bb25-65b3-440e-80f7-2bdfd1dff200 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:12.511495 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5bb25-65b3-440e-80f7-2bdfd1dff200 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:12.511769 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5bb25-65b3-440e-80f7-2bdfd1dff200 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:12.512027 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc00196-5159-4bc8-bee7-780038b522e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:12.513062 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc00196-5159-4bc8-bee7-780038b522e3 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:12.513554 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc00196-5159-4bc8-bee7-780038b522e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:12.514173 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc00196-5159-4bc8-bee7-780038b522e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:12.522091 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc00196-5159-4bc8-bee7-780038b522e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:12.523837 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc00196-5159-4bc8-bee7-780038b522e3 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:12.524042 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe5bb25-65b3-440e-80f7-2bdfd1dff200 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:12.525719 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe5bb25-65b3-440e-80f7-2bdfd1dff200 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:12.539411 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-1bc00196-5159-4bc8-bee7-780038b522e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:03:12.539411 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:12.539411 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:12.539411 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:12.539411 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:12.539411 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:12.539411 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:12.539411 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:12.539411 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:12.539411 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:12.539411 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:12.539411 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:12.539411 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 13:03:12.539411 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 13:03:12.539411 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 13:03:12.540412 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 13:03:12.540412 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:12.540412 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:12.540412 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:12.540412 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:12.540412 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:12.540412 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:12.540412 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:12.540412 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:12.540412 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:12.540412 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:12.540412 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:12.540412 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:12.540412 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:12.540412 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:12.540412 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:12.540412 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:12.541322 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 13:03:12.541322 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 13:03:12.541322 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 13:03:12.541322 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 13:03:12.541322 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 13:03:12.541322 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 13:03:12.541322 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:03:12.541322 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:12.543756 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 351/702] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:03:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:12.544781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc00196-5159-4bc8-bee7-780038b522e3 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:12.550174 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-1fe5bb25-65b3-440e-80f7-2bdfd1dff200 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:12.550174 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:12.550174 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:12.550174 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:12.550174 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:12.550174 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:12.550174 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:12.550174 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:12.550174 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:12.550174 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:12.550174 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:12.550174 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:12.550174 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:03:12.550174 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:03:12.550174 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:03:12.551134 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:03:12.551134 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:12.551134 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:12.551134 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:12.551134 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:12.551134 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:12.551134 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:12.551134 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:12.551134 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:12.551134 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:12.551134 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:12.551134 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:12.551134 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:12.551134 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:12.551134 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:12.551134 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:12.551134 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:12.552048 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:03:12.552048 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:03:12.552048 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:12.552048 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:12.552048 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 352/703] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:12.553293 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5bb25-65b3-440e-80f7-2bdfd1dff200 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:12.635208 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:12.661630 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc00196-5159-4bc8-bee7-780038b522e3 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:12.669432 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5bb25-65b3-440e-80f7-2bdfd1dff200 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:12.704658 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c301608-d96a-43b5-a6b9-2fcd7f3cabd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:12.705703 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c301608-d96a-43b5-a6b9-2fcd7f3cabd7 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:12.706187 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c301608-d96a-43b5-a6b9-2fcd7f3cabd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:12.706658 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c301608-d96a-43b5-a6b9-2fcd7f3cabd7 None admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:12.707660 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c301608-d96a-43b5-a6b9-2fcd7f3cabd7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:12.708180 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c301608-d96a-43b5-a6b9-2fcd7f3cabd7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:12.709482 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b86773-ed71-43f6-9970-7ecf67685662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:12.710053 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c301608-d96a-43b5-a6b9-2fcd7f3cabd7 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:12.710160 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b86773-ed71-43f6-9970-7ecf67685662 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:12.710412 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b86773-ed71-43f6-9970-7ecf67685662 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:12.710687 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b86773-ed71-43f6-9970-7ecf67685662 None admin] PATH_INFO: `/v3/projects` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:12.711471 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b86773-ed71-43f6-9970-7ecf67685662 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:12.711779 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b86773-ed71-43f6-9970-7ecf67685662 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:12.713361 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b86773-ed71-43f6-9970-7ecf67685662 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:12.726310 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 352/704] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 13:03:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:12.727453 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c301608-d96a-43b5-a6b9-2fcd7f3cabd7 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:12.732280 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 353/705] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 13:03:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:12.733474 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b86773-ed71-43f6-9970-7ecf67685662 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:12.747993 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:12.836007 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c301608-d96a-43b5-a6b9-2fcd7f3cabd7 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:12.848226 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b86773-ed71-43f6-9970-7ecf67685662 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:12.874178 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05881d43-7325-4a24-bdd5-3c42d199d2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:12.875388 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05881d43-7325-4a24-bdd5-3c42d199d2b0 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:12.875870 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05881d43-7325-4a24-bdd5-3c42d199d2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:12.876533 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05881d43-7325-4a24-bdd5-3c42d199d2b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:12.877519 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05881d43-7325-4a24-bdd5-3c42d199d2b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:12.878107 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05881d43-7325-4a24-bdd5-3c42d199d2b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:12.879784 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05881d43-7325-4a24-bdd5-3c42d199d2b0 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:12.880897 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:12.886713 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09af429-67ef-4abb-b9c6-2d64e6be507b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:12.887369 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09af429-67ef-4abb-b9c6-2d64e6be507b None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:12.887652 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09af429-67ef-4abb-b9c6-2d64e6be507b None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:12.887925 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09af429-67ef-4abb-b9c6-2d64e6be507b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:12.888934 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09af429-67ef-4abb-b9c6-2d64e6be507b None admin] RBAC: Adding query filter params (role.id=eb985092d5f14e92a783e26568bf457b, scope.project.id=c8c0bf799c9f451b8167a646a5c82eda, user.id=b07ad3dd7477497ea25c2a01bff35712) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:12.893977 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09af429-67ef-4abb-b9c6-2d64e6be507b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:12.893977 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09af429-67ef-4abb-b9c6-2d64e6be507b None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:12.895946 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 353/706] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:03:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:12.897130 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05881d43-7325-4a24-bdd5-3c42d199d2b0 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:12.898387 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 354/707] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 13:03:12 2022] GET /identity/v3/role_assignments?user.id=b07ad3dd7477497ea25c2a01bff35712&scope.project.id=c8c0bf799c9f451b8167a646a5c82eda&role.id=eb985092d5f14e92a783e26568bf457b => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:12.901818 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09af429-67ef-4abb-b9c6-2d64e6be507b None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:12.994438 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:13.028102 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09af429-67ef-4abb-b9c6-2d64e6be507b None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:13.029966 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05881d43-7325-4a24-bdd5-3c42d199d2b0 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:13.071823 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52c7df-c4a4-415a-9ede-49692a63a5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:13.072387 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c83c271-6ac6-4be3-961d-64a509e5a715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:13.072603 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52c7df-c4a4-415a-9ede-49692a63a5a0 None admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:13.072843 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52c7df-c4a4-415a-9ede-49692a63a5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:13.073119 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52c7df-c4a4-415a-9ede-49692a63a5a0 None admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:13.073847 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b52c7df-c4a4-415a-9ede-49692a63a5a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:13.074066 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83c271-6ac6-4be3-961d-64a509e5a715 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:13.074551 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83c271-6ac6-4be3-961d-64a509e5a715 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:13.075020 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83c271-6ac6-4be3-961d-64a509e5a715 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:13.075316 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b52c7df-c4a4-415a-9ede-49692a63a5a0 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:13.076340 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c83c271-6ac6-4be3-961d-64a509e5a715 None admin] RBAC: Adding query filter params (role.id=bbd5f3e0c18e4992886fcfb4a3feb426, scope.project.id=c8c0bf799c9f451b8167a646a5c82eda, user.id=066aaba3e9af4f85ab0cba89a3d32e34) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:13.077246 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c83c271-6ac6-4be3-961d-64a509e5a715 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:13.079667 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c83c271-6ac6-4be3-961d-64a509e5a715 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:13.087159 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 354/708] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 13:03:12 2022] GET /identity/v3/role_assignments?user.id=066aaba3e9af4f85ab0cba89a3d32e34&scope.project.id=c8c0bf799c9f451b8167a646a5c82eda&role.id=bbd5f3e0c18e4992886fcfb4a3feb426 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:13.089060 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635900cc-5a3d-4e52-9144-1d76ad2db3e1 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:13.089610 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635900cc-5a3d-4e52-9144-1d76ad2db3e1 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:13.090089 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635900cc-5a3d-4e52-9144-1d76ad2db3e1 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:13.092174 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 355/709] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:03:13.097985 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9814aef-c302-444b-bb26-b1089183ab78 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:13.098625 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9814aef-c302-444b-bb26-b1089183ab78 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:13.099170 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9814aef-c302-444b-bb26-b1089183ab78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:13.120761 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-c9814aef-c302-444b-bb26-b1089183ab78 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:13.122565 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-c9814aef-c302-444b-bb26-b1089183ab78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:13.174486 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 355/710] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jun 3 13:03:12 2022] POST /identity/v3/users => generated 254 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:13.211164 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 356/711] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 13:03:13.243102 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52c7df-c4a4-415a-9ede-49692a63a5a0 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:13.329207 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:13.396869 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52c7df-c4a4-415a-9ede-49692a63a5a0 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:13.435933 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5339df9-3a0d-4dec-b231-db14e56373e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:13.437224 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5339df9-3a0d-4dec-b231-db14e56373e5 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:13.437703 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5339df9-3a0d-4dec-b231-db14e56373e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:13.438168 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5339df9-3a0d-4dec-b231-db14e56373e5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:13.439011 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5339df9-3a0d-4dec-b231-db14e56373e5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:13.440623 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5339df9-3a0d-4dec-b231-db14e56373e5 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:13.455708 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-a5339df9-3a0d-4dec-b231-db14e56373e5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 13:03:13.455708 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:13.455708 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 13:03:13.455708 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 13:03:13.455708 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 13:03:13.455708 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 13:03:13.455708 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 13:03:13.455708 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:03:13.455708 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 13:03:13.455708 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:13.455708 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 13:03:13.455708 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:13.455708 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:13.455708 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:13.455708 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:13.455708 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:13.456724 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:13.456724 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:13.456724 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:13.456724 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:13.456724 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:13.456724 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:13.456724 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:13.456724 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 13:03:13.456724 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 13:03:13.456724 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 13:03:13.456724 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 13:03:13.456724 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:13.456724 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:13.456724 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:13.456724 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:13.456724 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:13.457596 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:13.457596 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:13.457596 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:13.457596 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:13.457596 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:13.457596 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:13.457596 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:13.457596 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:13.457596 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:13.457596 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:13.457596 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:13.457596 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 13:03:13.457596 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:03:13.457596 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 13:03:13.457596 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:13.460680 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 356/712] 10.222.0.61 () {56 vars in 1129 bytes} [Fri Jun 3 13:03:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:13.466672 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9814aef-c302-444b-bb26-b1089183ab78 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:13.543470 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:13.579422 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9814aef-c302-444b-bb26-b1089183ab78 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:13.616033 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb1eba-92e3-43c6-8d1f-425f7986d7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:13.616737 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb1eba-92e3-43c6-8d1f-425f7986d7ee None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:13.617022 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb1eba-92e3-43c6-8d1f-425f7986d7ee None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:13.617298 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb1eba-92e3-43c6-8d1f-425f7986d7ee None admin] PATH_INFO: `/v3/services` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:13.618007 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdb1eba-92e3-43c6-8d1f-425f7986d7ee None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:13.618313 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdb1eba-92e3-43c6-8d1f-425f7986d7ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:13.619706 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdb1eba-92e3-43c6-8d1f-425f7986d7ee None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:13.625664 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 357/713] 10.222.0.61 () {56 vars in 1124 bytes} [Fri Jun 3 13:03:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:13.631053 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5339df9-3a0d-4dec-b231-db14e56373e5 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:13.697963 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e66ad6-65c2-4e1a-9126-7ec5d6b75354 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:13.698278 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e66ad6-65c2-4e1a-9126-7ec5d6b75354 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:13.699202 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e66ad6-65c2-4e1a-9126-7ec5d6b75354 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:13.701594 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 358/714] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:03:13.711603 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4419954-f351-4bfb-a0eb-af5473e4d3d4 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:13.711918 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4419954-f351-4bfb-a0eb-af5473e4d3d4 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:13.712167 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4419954-f351-4bfb-a0eb-af5473e4d3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:13.740441 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-f4419954-f351-4bfb-a0eb-af5473e4d3d4 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:13.742269 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-f4419954-f351-4bfb-a0eb-af5473e4d3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:13.768000 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5339df9-3a0d-4dec-b231-db14e56373e5 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:13.787744 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:13.836569 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 359/715] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:03:13.841768 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62897c4-d975-4ccb-93d2-64eae1fd862f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:13.842953 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62897c4-d975-4ccb-93d2-64eae1fd862f None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:13.843291 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62897c4-d975-4ccb-93d2-64eae1fd862f None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:13.843553 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62897c4-d975-4ccb-93d2-64eae1fd862f None admin] PATH_INFO: `/v3/services` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:13.844291 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62897c4-d975-4ccb-93d2-64eae1fd862f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:13.844594 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62897c4-d975-4ccb-93d2-64eae1fd862f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:13.845974 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62897c4-d975-4ccb-93d2-64eae1fd862f None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:13.854137 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4419954-f351-4bfb-a0eb-af5473e4d3d4 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:13.864854 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 357/716] 10.222.0.61 () {56 vars in 1124 bytes} [Fri Jun 3 13:03:13 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:13.927038 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:13.966199 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4419954-f351-4bfb-a0eb-af5473e4d3d4 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:14.017748 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93af047-7c0f-4655-b961-846226ce0333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:14.018579 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93af047-7c0f-4655-b961-846226ce0333 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:14.018859 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93af047-7c0f-4655-b961-846226ce0333 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:14.019131 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93af047-7c0f-4655-b961-846226ce0333 None admin] PATH_INFO: `/v3/services/network` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:14.019794 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93af047-7c0f-4655-b961-846226ce0333 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:14.021232 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93af047-7c0f-4655-b961-846226ce0333 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:14.039093 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-a93af047-7c0f-4655-b961-846226ce0333 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 13:03:14.039093 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:14.039093 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 13:03:14.039093 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 13:03:14.039093 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 13:03:14.039093 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 13:03:14.039093 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 13:03:14.039093 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:03:14.039093 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 13:03:14.039093 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:14.039093 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 13:03:14.039093 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:14.039093 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:14.039093 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:14.039093 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:14.039093 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:14.039093 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:14.040202 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:14.040202 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:14.040202 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:14.040202 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:14.040202 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:14.040202 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:14.040202 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 13:03:14.040202 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 13:03:14.040202 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 13:03:14.040202 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 13:03:14.040202 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:14.040202 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:14.040202 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:14.040202 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:14.040202 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:14.040202 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:14.041070 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:14.041070 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:14.041070 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:14.041070 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:14.041070 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:14.041070 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:14.041070 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:14.041070 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:14.041070 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:14.041070 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:14.041070 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 13:03:14.041070 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:03:14.041070 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 13:03:14.041070 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:14.041070 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 360/717] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:03:13 2022] GET /identity/v3/services/network => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:03:14.049326 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62897c4-d975-4ccb-93d2-64eae1fd862f None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:14.189539 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62897c4-d975-4ccb-93d2-64eae1fd862f None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:14.241027 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ef60c-aabc-431f-a9eb-9b3ad3a788f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:14.241699 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ef60c-aabc-431f-a9eb-9b3ad3a788f8 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:14.241983 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ef60c-aabc-431f-a9eb-9b3ad3a788f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:14.242262 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ef60c-aabc-431f-a9eb-9b3ad3a788f8 None admin] PATH_INFO: `/v3/services` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:14.242970 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ef60c-aabc-431f-a9eb-9b3ad3a788f8 None admin] RBAC: Adding query filter params (name=network) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:14.243277 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ef60c-aabc-431f-a9eb-9b3ad3a788f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:14.244677 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ef60c-aabc-431f-a9eb-9b3ad3a788f8 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:14.252675 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 358/718] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Jun 3 13:03:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:14.257765 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93af047-7c0f-4655-b961-846226ce0333 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:14.404203 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93af047-7c0f-4655-b961-846226ce0333 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:14.448887 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:14.459664 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55921ae5-ac50-41c1-9071-992230e10d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:14.460421 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55921ae5-ac50-41c1-9071-992230e10d53 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:14.460708 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55921ae5-ac50-41c1-9071-992230e10d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:14.468610 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55921ae5-ac50-41c1-9071-992230e10d53 None admin] PATH_INFO: `/v3/services` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:14.468610 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55921ae5-ac50-41c1-9071-992230e10d53 None admin] RBAC: Adding query filter params (type=network) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:14.468610 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55921ae5-ac50-41c1-9071-992230e10d53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:14.468610 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55921ae5-ac50-41c1-9071-992230e10d53 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:14.473560 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 361/719] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Jun 3 13:03:14 2022] GET /identity/v3/services?type=network => generated 124 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:15.875359 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e76ec3-8460-4232-9a33-4a866df6c6e9 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:15.876349 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e76ec3-8460-4232-9a33-4a866df6c6e9 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:15.876792 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e76ec3-8460-4232-9a33-4a866df6c6e9 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:15.878751 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 359/720] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:03:15.884516 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007423c-dff6-457d-9dbc-f3b99201a158 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:15.884986 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007423c-dff6-457d-9dbc-f3b99201a158 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:15.885068 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007423c-dff6-457d-9dbc-f3b99201a158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:15.913176 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-4007423c-dff6-457d-9dbc-f3b99201a158 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:15.914375 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-4007423c-dff6-457d-9dbc-f3b99201a158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:16.009852 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 362/721] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:03:16.033420 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f735fc-93f4-4647-bcb1-917695f3e262 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:16.033729 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f735fc-93f4-4647-bcb1-917695f3e262 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:16.033980 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f735fc-93f4-4647-bcb1-917695f3e262 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:16.035581 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 360/722] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:03:16.041380 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190cf5ff-a8ae-469d-8a8a-e4a6d3d684dc None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:16.041690 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190cf5ff-a8ae-469d-8a8a-e4a6d3d684dc None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:16.041944 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190cf5ff-a8ae-469d-8a8a-e4a6d3d684dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:16.047759 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f735fc-93f4-4647-bcb1-917695f3e262 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:16.073292 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-190cf5ff-a8ae-469d-8a8a-e4a6d3d684dc None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:16.074485 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-190cf5ff-a8ae-469d-8a8a-e4a6d3d684dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:16.156588 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:16.194117 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 363/723] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:03:16.217205 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190cf5ff-a8ae-469d-8a8a-e4a6d3d684dc None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:16.247259 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f735fc-93f4-4647-bcb1-917695f3e262 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:16.284096 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:16.308302 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03fd01c-252e-4ce1-9660-78207c6d6069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:16.309102 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fd01c-252e-4ce1-9660-78207c6d6069 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:16.309381 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fd01c-252e-4ce1-9660-78207c6d6069 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:16.309650 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fd01c-252e-4ce1-9660-78207c6d6069 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:16.326679 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03fd01c-252e-4ce1-9660-78207c6d6069 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:03:16.335562 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-f03fd01c-252e-4ce1-9660-78207c6d6069 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:03:16.335562 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:16.335562 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:16.335562 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:16.335562 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:16.335562 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:16.335562 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:16.335562 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:16.335562 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:16.335562 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:16.335562 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:16.335562 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:16.335562 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:03:16.335562 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:03:16.335562 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:03:16.335562 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:03:16.336516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:03:16.336516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:03:16.336516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:03:16.336516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:03:16.336516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:16.336516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:16.336516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:16.336516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:16.336516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:16.336516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:16.336516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:16.336516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:16.336516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:16.336516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:16.336516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:16.336516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:16.338183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:16.338183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:16.338183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:16.338183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:16.338183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:03:16.338183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:03:16.338183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:03:16.338183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:03:16.338183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:03:16.338183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:03:16.338183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:03:16.338183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:16.338183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 361/724] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 13:03:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:16.338876 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d81b93-cc71-446b-9d82-65591472da32 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:16.338876 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d81b93-cc71-446b-9d82-65591472da32 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:16.339518 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d81b93-cc71-446b-9d82-65591472da32 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:16.345410 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 362/725] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:03:16.346282 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d81b93-cc71-446b-9d82-65591472da32 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:16.356576 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190cf5ff-a8ae-469d-8a8a-e4a6d3d684dc None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:16.392416 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7967fd3f-3cbc-4da9-9c05-d257b0fd4f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:16.393233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967fd3f-3cbc-4da9-9c05-d257b0fd4f85 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:16.393519 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967fd3f-3cbc-4da9-9c05-d257b0fd4f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:16.393794 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967fd3f-3cbc-4da9-9c05-d257b0fd4f85 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:16.406701 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7967fd3f-3cbc-4da9-9c05-d257b0fd4f85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:03:16.414501 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-7967fd3f-3cbc-4da9-9c05-d257b0fd4f85 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:03:16.414501 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:16.414501 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:16.414501 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:16.414501 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:16.414501 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:16.414501 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:16.414501 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:16.414501 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:16.414501 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:16.414501 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:16.414501 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:16.414501 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:03:16.414501 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:03:16.414501 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:03:16.414501 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:03:16.415590 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:03:16.415590 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:03:16.415590 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:03:16.415590 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:03:16.415590 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:16.415590 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:16.415590 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:16.415590 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:16.415590 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:16.415590 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:16.415590 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:16.415590 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:16.415590 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:16.415590 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:16.415590 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:16.415590 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:16.416458 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:16.416458 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:16.416458 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:16.416458 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:16.416458 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:03:16.416458 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:03:16.416458 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:03:16.416458 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:03:16.416458 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:03:16.416458 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:03:16.416458 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:03:16.416458 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:16.416458 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 364/726] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 13:03:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:03:16.421688 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01bad3-36e8-45a0-bdcf-c9e526722fa8 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:16.421973 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01bad3-36e8-45a0-bdcf-c9e526722fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:16.422241 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01bad3-36e8-45a0-bdcf-c9e526722fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:16.440396 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-be01bad3-36e8-45a0-bdcf-c9e526722fa8 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:16.441600 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-be01bad3-36e8-45a0-bdcf-c9e526722fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:16.466365 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d81b93-cc71-446b-9d82-65591472da32 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:16.468974 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:16.505978 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa209427-c0d3-49d8-afd0-6b0dcc18d823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:16.506745 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa209427-c0d3-49d8-afd0-6b0dcc18d823 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:16.507033 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa209427-c0d3-49d8-afd0-6b0dcc18d823 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:16.507359 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa209427-c0d3-49d8-afd0-6b0dcc18d823 None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:16.508191 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa209427-c0d3-49d8-afd0-6b0dcc18d823 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:16.508657 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa209427-c0d3-49d8-afd0-6b0dcc18d823 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:16.510132 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa209427-c0d3-49d8-afd0-6b0dcc18d823 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:16.514022 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 365/727] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:03:16.515440 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01bad3-36e8-45a0-bdcf-c9e526722fa8 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:16.527913 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 363/728] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:03:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:16.532747 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa209427-c0d3-49d8-afd0-6b0dcc18d823 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:16.567883 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:16.629833 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01bad3-36e8-45a0-bdcf-c9e526722fa8 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:16.658560 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa209427-c0d3-49d8-afd0-6b0dcc18d823 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:16.668175 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39598ef0-ebcb-44d5-8ede-283b80f6f16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:16.669028 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39598ef0-ebcb-44d5-8ede-283b80f6f16f None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:16.669386 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39598ef0-ebcb-44d5-8ede-283b80f6f16f None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:16.669734 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39598ef0-ebcb-44d5-8ede-283b80f6f16f None admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:16.671266 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39598ef0-ebcb-44d5-8ede-283b80f6f16f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:16.671646 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39598ef0-ebcb-44d5-8ede-283b80f6f16f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:16.673332 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39598ef0-ebcb-44d5-8ede-283b80f6f16f None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:16.688564 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 366/729] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:03:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:16.689666 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39598ef0-ebcb-44d5-8ede-283b80f6f16f None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:16.697366 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc218e-c6c1-447a-af30-94faeaac62cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:16.698172 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc218e-c6c1-447a-af30-94faeaac62cd None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:16.698500 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc218e-c6c1-447a-af30-94faeaac62cd None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:16.698832 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc218e-c6c1-447a-af30-94faeaac62cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:16.712004 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dc218e-c6c1-447a-af30-94faeaac62cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:16.713615 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dc218e-c6c1-447a-af30-94faeaac62cd None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:16.732854 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-e0dc218e-c6c1-447a-af30-94faeaac62cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:16.732854 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:16.732854 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:16.732854 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:16.732854 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:16.732854 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:16.732854 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:16.732854 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:16.732854 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:16.732854 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:16.732854 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:16.732854 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:16.732854 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:03:16.732854 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:03:16.732854 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:03:16.735500 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:03:16.735500 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:16.735500 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:16.735500 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:16.735500 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:16.735500 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:16.735500 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:16.735500 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:16.735500 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:16.735500 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:16.735500 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:16.735500 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:16.735500 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:16.735500 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:16.735500 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:16.735500 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:16.735500 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:16.737896 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:03:16.737896 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:03:16.737896 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:16.737896 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:16.737896 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 364/730] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:03:16.737896 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc218e-c6c1-447a-af30-94faeaac62cd None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:16.757495 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:16.807493 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39598ef0-ebcb-44d5-8ede-283b80f6f16f None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:16.816903 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:16.846608 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c52c1b-d7dc-4167-938f-e5c192e366f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:16.847407 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c52c1b-d7dc-4167-938f-e5c192e366f6 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:16.847948 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c52c1b-d7dc-4167-938f-e5c192e366f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:16.848053 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc218e-c6c1-447a-af30-94faeaac62cd None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:16.848257 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c52c1b-d7dc-4167-938f-e5c192e366f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:16.859867 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c52c1b-d7dc-4167-938f-e5c192e366f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:03:16.867620 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-b1c52c1b-d7dc-4167-938f-e5c192e366f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 13:03:16.867620 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:16.867620 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:16.867620 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:16.867620 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:16.867620 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:16.867620 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:16.867620 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:16.867620 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:16.867620 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:16.867620 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:16.867620 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:16.867620 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:03:16.867620 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:03:16.867620 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:03:16.867620 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:03:16.871803 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:03:16.871803 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:03:16.871803 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:03:16.871803 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:03:16.871803 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:16.871803 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:16.871803 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:16.871803 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:16.871803 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:16.871803 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:16.871803 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:16.871803 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:16.871803 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:16.871803 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:16.871803 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:16.871803 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:16.872726 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:16.872726 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:16.872726 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:16.872726 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:16.872726 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:03:16.872726 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:03:16.872726 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:03:16.872726 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:03:16.872726 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:03:16.872726 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:03:16.872726 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 13:03:16.872726 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:16.872726 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 367/731] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jun 3 13:03:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:16.872726 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c52c1b-d7dc-4167-938f-e5c192e366f6 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:16.886649 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df70631a-df4e-4620-b260-eac5337033af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:16.887738 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70631a-df4e-4620-b260-eac5337033af None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:16.888024 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70631a-df4e-4620-b260-eac5337033af None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:16.888335 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70631a-df4e-4620-b260-eac5337033af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:16.900815 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df70631a-df4e-4620-b260-eac5337033af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:16.902352 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df70631a-df4e-4620-b260-eac5337033af None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:16.922730 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-df70631a-df4e-4620-b260-eac5337033af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:16.922730 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:16.922730 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:16.922730 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:16.922730 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:16.922730 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:16.922730 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:16.922730 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:16.922730 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:16.922730 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:16.922730 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:16.922730 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:16.922730 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:03:16.922730 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:03:16.922730 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:03:16.923899 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:03:16.923899 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:16.923899 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:16.923899 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:16.923899 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:16.923899 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:16.923899 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:16.923899 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:16.923899 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:16.923899 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:16.923899 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:16.923899 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:16.923899 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:16.923899 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:16.923899 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:16.923899 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:16.923899 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:16.931224 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:03:16.931224 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:03:16.931224 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:16.931224 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:16.931224 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 365/732] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:16.931224 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420aeda-81d1-47fc-9547-03311a6c25a2 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:16.931224 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420aeda-81d1-47fc-9547-03311a6c25a2 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:16.931224 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420aeda-81d1-47fc-9547-03311a6c25a2 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:16.931224 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 366/733] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:03:16.931745 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420aeda-81d1-47fc-9547-03311a6c25a2 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:17.033285 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:17.033793 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c52c1b-d7dc-4167-938f-e5c192e366f6 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:17.070515 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420aeda-81d1-47fc-9547-03311a6c25a2 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:17.074852 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facfee87-7a84-4c53-9a8d-9f3c9643b9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:17.075525 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facfee87-7a84-4c53-9a8d-9f3c9643b9a6 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:17.075811 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facfee87-7a84-4c53-9a8d-9f3c9643b9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:17.076092 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facfee87-7a84-4c53-9a8d-9f3c9643b9a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:17.077030 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facfee87-7a84-4c53-9a8d-9f3c9643b9a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:17.077393 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facfee87-7a84-4c53-9a8d-9f3c9643b9a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:17.078959 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facfee87-7a84-4c53-9a8d-9f3c9643b9a6 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:17.091374 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 368/734] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:03:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:17.093288 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facfee87-7a84-4c53-9a8d-9f3c9643b9a6 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:17.111192 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c258e-9247-492e-b8da-624ab6a90d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:17.111857 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c258e-9247-492e-b8da-624ab6a90d36 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:17.112136 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c258e-9247-492e-b8da-624ab6a90d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:17.112432 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c258e-9247-492e-b8da-624ab6a90d36 None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:17.113294 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15c258e-9247-492e-b8da-624ab6a90d36 None admin] RBAC: Adding query filter params (name=service) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:17.113599 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15c258e-9247-492e-b8da-624ab6a90d36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:17.114956 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15c258e-9247-492e-b8da-624ab6a90d36 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:17.123307 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:17.128295 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 367/735] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jun 3 13:03:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:17.128295 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e851c60-a4d4-4024-90fd-e52e8b28f0cd None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:17.128295 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e851c60-a4d4-4024-90fd-e52e8b28f0cd None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:17.128295 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e851c60-a4d4-4024-90fd-e52e8b28f0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:17.145926 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-4e851c60-a4d4-4024-90fd-e52e8b28f0cd None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:17.147133 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-4e851c60-a4d4-4024-90fd-e52e8b28f0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:17.198748 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facfee87-7a84-4c53-9a8d-9f3c9643b9a6 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:17.232176 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 368/736] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:03:17.232176 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e851c60-a4d4-4024-90fd-e52e8b28f0cd None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:17.236583 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae2645-9f14-4fb0-bc13-68c08e67388e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:17.237388 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae2645-9f14-4fb0-bc13-68c08e67388e None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:17.237677 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae2645-9f14-4fb0-bc13-68c08e67388e None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:17.237953 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae2645-9f14-4fb0-bc13-68c08e67388e None admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:17.238666 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbae2645-9f14-4fb0-bc13-68c08e67388e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:17.238972 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbae2645-9f14-4fb0-bc13-68c08e67388e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:17.240392 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbae2645-9f14-4fb0-bc13-68c08e67388e None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:17.252880 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 369/737] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:03:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:17.253656 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae2645-9f14-4fb0-bc13-68c08e67388e None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:17.295336 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:17.336277 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e851c60-a4d4-4024-90fd-e52e8b28f0cd None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:17.337905 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:17.352846 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae2645-9f14-4fb0-bc13-68c08e67388e None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:17.370696 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1783502-6ae2-427d-819c-ac9b4a05954c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:17.371485 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1783502-6ae2-427d-819c-ac9b4a05954c None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:17.371771 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1783502-6ae2-427d-819c-ac9b4a05954c None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:17.372051 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1783502-6ae2-427d-819c-ac9b4a05954c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:17.379678 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1783502-6ae2-427d-819c-ac9b4a05954c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:17.381155 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1783502-6ae2-427d-819c-ac9b4a05954c None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:17.386408 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98d693-f7dd-46d9-8710-873b5bbd6c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:17.387188 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98d693-f7dd-46d9-8710-873b5bbd6c9c None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:17.387468 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98d693-f7dd-46d9-8710-873b5bbd6c9c None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:17.387740 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98d693-f7dd-46d9-8710-873b5bbd6c9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:17.396102 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-e1783502-6ae2-427d-819c-ac9b4a05954c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 03 13:03:17.396102 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:17.396102 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:17.396102 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:17.396102 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:17.396102 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:17.396102 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:17.396102 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:17.396102 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:17.396102 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:17.396102 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:17.396102 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:17.396102 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 13:03:17.396102 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 13:03:17.396102 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 13:03:17.396102 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 13:03:17.397256 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:17.397256 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:17.397256 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 13:03:17.397256 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:03:17.397256 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 13:03:17.397256 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:03:17.397256 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:17.397256 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:17.397256 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:17.397256 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:17.397256 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:17.397256 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:17.397256 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:17.397256 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:17.397256 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:17.397256 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:17.397256 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:17.397256 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:17.398209 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:17.398209 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:17.398209 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 13:03:17.398209 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 13:03:17.398209 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 13:03:17.398209 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 13:03:17.398209 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 13:03:17.398209 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 13:03:17.398209 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 03 13:03:17.398209 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:17.398209 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 369/738] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 13:03:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:17.398209 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1783502-6ae2-427d-819c-ac9b4a05954c None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:17.402084 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb98d693-f7dd-46d9-8710-873b5bbd6c9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:17.403564 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb98d693-f7dd-46d9-8710-873b5bbd6c9c None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:17.422399 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-cb98d693-f7dd-46d9-8710-873b5bbd6c9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:17.422399 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:17.422399 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:17.422399 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:17.422399 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:17.422399 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:17.422399 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:17.422399 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:17.422399 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:17.422399 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:17.422399 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:17.422399 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:17.422399 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:03:17.422399 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:03:17.422399 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:03:17.423377 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:03:17.423377 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:17.423377 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:17.423377 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:17.423377 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:17.423377 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:17.423377 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:17.423377 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:17.423377 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:17.423377 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:17.423377 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:17.423377 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:17.423377 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:17.423377 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:17.423377 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:17.423377 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:17.423377 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:17.424364 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:03:17.424364 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:03:17.424364 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:17.424364 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:17.424364 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 370/739] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:17.425291 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537fb9d-5aab-4ae9-bca2-0f0037e5de0c None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:17.425577 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537fb9d-5aab-4ae9-bca2-0f0037e5de0c None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:17.425851 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537fb9d-5aab-4ae9-bca2-0f0037e5de0c None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:17.427133 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 371/740] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:03:17.427821 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537fb9d-5aab-4ae9-bca2-0f0037e5de0c None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:17.501600 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1783502-6ae2-427d-819c-ac9b4a05954c None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:17.521892 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:17.530338 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537fb9d-5aab-4ae9-bca2-0f0037e5de0c None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:17.535152 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b3187e-2869-47d6-9dc0-86e5398844d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:17.535804 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3187e-2869-47d6-9dc0-86e5398844d2 None admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:17.536084 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3187e-2869-47d6-9dc0-86e5398844d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:17.536385 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3187e-2869-47d6-9dc0-86e5398844d2 None admin] PATH_INFO: `/v3/services` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:17.537097 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b3187e-2869-47d6-9dc0-86e5398844d2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:17.538456 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b3187e-2869-47d6-9dc0-86e5398844d2 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:17.564957 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf154c-2835-470a-b78e-5808641b1084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:17.565737 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf154c-2835-470a-b78e-5808641b1084 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:17.566021 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf154c-2835-470a-b78e-5808641b1084 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:17.566282 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf154c-2835-470a-b78e-5808641b1084 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:17.573100 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bf154c-2835-470a-b78e-5808641b1084 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:17.574540 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bf154c-2835-470a-b78e-5808641b1084 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:17.576249 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:17.589502 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-a9bf154c-2835-470a-b78e-5808641b1084 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 13:03:17.589502 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:17.589502 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:17.589502 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:17.589502 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:17.589502 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:17.589502 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:17.589502 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:17.589502 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:17.589502 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:17.589502 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:17.589502 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:17.589502 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 13:03:17.589502 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 13:03:17.589502 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 13:03:17.589502 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 13:03:17.590583 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:17.590583 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:17.590583 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 13:03:17.590583 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:03:17.590583 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 13:03:17.590583 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:03:17.590583 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:17.590583 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:17.590583 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:17.590583 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:17.590583 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:17.590583 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:17.590583 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:17.590583 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:17.590583 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:17.590583 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:17.590583 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:17.590583 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:17.591793 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:17.591793 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:17.591793 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 13:03:17.591793 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 13:03:17.591793 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 13:03:17.591793 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 13:03:17.591793 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 13:03:17.591793 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 13:03:17.591793 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 13:03:17.591793 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:17.591793 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 372/741] 10.222.0.61 () {56 vars in 1093 bytes} [Fri Jun 3 13:03:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:17.591793 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf154c-2835-470a-b78e-5808641b1084 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:17.621597 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 370/742] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Jun 3 13:03:17 2022] POST /identity/v3/services => generated 251 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:17.622433 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b3187e-2869-47d6-9dc0-86e5398844d2 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:17.704059 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf154c-2835-470a-b78e-5808641b1084 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:17.751854 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24781d52-ad49-4b77-8bfa-0845a6de69fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:17.752479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24781d52-ad49-4b77-8bfa-0845a6de69fa None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:17.752786 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24781d52-ad49-4b77-8bfa-0845a6de69fa None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:17.753065 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24781d52-ad49-4b77-8bfa-0845a6de69fa None admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:17.753275 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b3187e-2869-47d6-9dc0-86e5398844d2 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:17.753909 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24781d52-ad49-4b77-8bfa-0845a6de69fa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:17.754220 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24781d52-ad49-4b77-8bfa-0845a6de69fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:17.755703 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24781d52-ad49-4b77-8bfa-0845a6de69fa None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:17.780983 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 373/743] 10.222.0.61 () {56 vars in 1135 bytes} [Fri Jun 3 13:03:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:17.780983 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644f385-58e8-4ba7-8752-23ecb5b398ea None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:17.780983 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644f385-58e8-4ba7-8752-23ecb5b398ea None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:17.780983 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644f385-58e8-4ba7-8752-23ecb5b398ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:17.793368 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71126c6-7d12-4092-9980-8a9fbd88d6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:17.794116 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71126c6-7d12-4092-9980-8a9fbd88d6e3 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:17.794328 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71126c6-7d12-4092-9980-8a9fbd88d6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:17.794606 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71126c6-7d12-4092-9980-8a9fbd88d6e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:17.795346 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71126c6-7d12-4092-9980-8a9fbd88d6e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:17.795697 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71126c6-7d12-4092-9980-8a9fbd88d6e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:17.797201 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71126c6-7d12-4092-9980-8a9fbd88d6e3 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:17.798389 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-e644f385-58e8-4ba7-8752-23ecb5b398ea None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:17.799723 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-e644f385-58e8-4ba7-8752-23ecb5b398ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:17.810423 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 371/744] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:03:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:17.811806 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71126c6-7d12-4092-9980-8a9fbd88d6e3 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:17.853266 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:17.864488 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:17.881941 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 374/745] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:17 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 13:03:17.882784 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e644f385-58e8-4ba7-8752-23ecb5b398ea None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:17.931666 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71126c6-7d12-4092-9980-8a9fbd88d6e3 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:17.967653 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0493353e-2661-4333-8670-6c7a4a5111ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:17.968883 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493353e-2661-4333-8670-6c7a4a5111ff None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:17.969174 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493353e-2661-4333-8670-6c7a4a5111ff None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:17.969453 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493353e-2661-4333-8670-6c7a4a5111ff None admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:17.970726 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0493353e-2661-4333-8670-6c7a4a5111ff None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:17.970974 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0493353e-2661-4333-8670-6c7a4a5111ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:17.972435 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0493353e-2661-4333-8670-6c7a4a5111ff None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:17.995378 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 372/746] 10.222.0.61 () {56 vars in 1133 bytes} [Fri Jun 3 13:03:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:17.995573 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e644f385-58e8-4ba7-8752-23ecb5b398ea None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:17.995670 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0493353e-2661-4333-8670-6c7a4a5111ff None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:18.031248 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74950ed8-e64b-4005-9de1-82bf6f3a6a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:18.031868 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74950ed8-e64b-4005-9de1-82bf6f3a6a3d None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:18.032159 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74950ed8-e64b-4005-9de1-82bf6f3a6a3d None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:18.032439 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74950ed8-e64b-4005-9de1-82bf6f3a6a3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:18.086835 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:18.102975 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:18.105198 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74950ed8-e64b-4005-9de1-82bf6f3a6a3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:18.106661 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74950ed8-e64b-4005-9de1-82bf6f3a6a3d None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:18.111155 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0493353e-2661-4333-8670-6c7a4a5111ff None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:18.147806 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa0541-310f-470a-8493-e18c6d68339f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:18.150229 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa0541-310f-470a-8493-e18c6d68339f None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:18.150229 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa0541-310f-470a-8493-e18c6d68339f None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:18.150229 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa0541-310f-470a-8493-e18c6d68339f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:18.157330 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fa0541-310f-470a-8493-e18c6d68339f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:18.158764 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fa0541-310f-470a-8493-e18c6d68339f None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:18.174247 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-26fa0541-310f-470a-8493-e18c6d68339f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 13:03:18.174247 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:18.174247 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:18.174247 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:18.174247 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:18.174247 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:18.174247 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:18.174247 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:18.174247 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:18.174247 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:18.174247 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:18.174247 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:18.174247 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 13:03:18.174247 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 13:03:18.174247 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 13:03:18.174247 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 13:03:18.175376 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:18.175376 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:18.175376 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 13:03:18.175376 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:03:18.175376 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 13:03:18.175376 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:03:18.175376 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:18.175376 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:18.175376 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:18.175376 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:18.175376 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:18.175376 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:18.175376 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:18.175376 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:18.175376 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:18.175376 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:18.175376 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:18.175376 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:18.176491 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:18.176491 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:18.176491 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 13:03:18.176491 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 13:03:18.176491 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 13:03:18.176491 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 13:03:18.176491 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 13:03:18.176491 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 13:03:18.176491 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 13:03:18.176491 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:18.180056 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 373/747] 10.222.0.61 () {56 vars in 1117 bytes} [Fri Jun 3 13:03:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:18.180904 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa0541-310f-470a-8493-e18c6d68339f None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:18.219887 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 375/748] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:03:17 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:18.219887 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74950ed8-e64b-4005-9de1-82bf6f3a6a3d None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:18.293960 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa0541-310f-470a-8493-e18c6d68339f None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:18.303456 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:18.321365 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74950ed8-e64b-4005-9de1-82bf6f3a6a3d None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:18.339343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1cba3b-75c7-4432-8b84-8bcb4c332bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:18.340005 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1cba3b-75c7-4432-8b84-8bcb4c332bc7 None admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:18.340320 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1cba3b-75c7-4432-8b84-8bcb4c332bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:18.340597 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1cba3b-75c7-4432-8b84-8bcb4c332bc7 None admin] PATH_INFO: `/v3/services` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:18.341320 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1cba3b-75c7-4432-8b84-8bcb4c332bc7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:18.343210 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1cba3b-75c7-4432-8b84-8bcb4c332bc7 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:18.358044 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968419a5-7a14-47a4-a048-91b9f3119fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:18.359434 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968419a5-7a14-47a4-a048-91b9f3119fef None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:18.359715 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968419a5-7a14-47a4-a048-91b9f3119fef None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:18.359986 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968419a5-7a14-47a4-a048-91b9f3119fef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:18.370354 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968419a5-7a14-47a4-a048-91b9f3119fef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:18.371840 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968419a5-7a14-47a4-a048-91b9f3119fef None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:18.390339 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-968419a5-7a14-47a4-a048-91b9f3119fef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:18.390339 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:18.390339 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:18.390339 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:18.390339 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:18.390339 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:18.390339 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:18.390339 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:18.390339 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:18.390339 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:18.390339 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:18.390339 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:18.390339 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:03:18.390339 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:03:18.390339 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:03:18.391481 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:03:18.391481 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:18.391481 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:18.391481 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:18.391481 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:18.391481 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:18.391481 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:18.391481 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:18.391481 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:18.391481 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:18.391481 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:18.391481 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:18.391481 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:18.391481 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:18.391481 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:18.391481 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:18.391481 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:18.392436 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:03:18.392436 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:03:18.392436 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:18.392436 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:18.392436 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 376/749] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:18.392775 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968419a5-7a14-47a4-a048-91b9f3119fef None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:18.420187 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 374/750] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Jun 3 13:03:18 2022] POST /identity/v3/services => generated 240 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:18.420187 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1cba3b-75c7-4432-8b84-8bcb4c332bc7 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:18.429500 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:18.533671 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968419a5-7a14-47a4-a048-91b9f3119fef None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:18.549081 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1cba3b-75c7-4432-8b84-8bcb4c332bc7 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:18.580869 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70251333-6b11-4bb6-bd9e-d576102a0394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:18.581563 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70251333-6b11-4bb6-bd9e-d576102a0394 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:18.582112 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70251333-6b11-4bb6-bd9e-d576102a0394 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:18.582397 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70251333-6b11-4bb6-bd9e-d576102a0394 None admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:18.583695 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70251333-6b11-4bb6-bd9e-d576102a0394 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:18.584311 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70251333-6b11-4bb6-bd9e-d576102a0394 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:18.586574 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70251333-6b11-4bb6-bd9e-d576102a0394 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:18.589030 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:18.591656 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a793c73-afd0-4346-825e-a0bbcde9b07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:18.593151 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a793c73-afd0-4346-825e-a0bbcde9b07b None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:18.593502 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a793c73-afd0-4346-825e-a0bbcde9b07b None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:18.593873 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a793c73-afd0-4346-825e-a0bbcde9b07b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:18.611311 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a793c73-afd0-4346-825e-a0bbcde9b07b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:18.612210 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 377/751] 10.222.0.61 () {56 vars in 1149 bytes} [Fri Jun 3 13:03:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:18.613290 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70251333-6b11-4bb6-bd9e-d576102a0394 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:18.613473 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a793c73-afd0-4346-825e-a0bbcde9b07b None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:18.635885 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-5a793c73-afd0-4346-825e-a0bbcde9b07b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:18.635885 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:18.635885 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:18.635885 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:18.635885 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:18.635885 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:18.635885 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:18.635885 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:18.635885 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:18.635885 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:18.635885 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:18.635885 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:18.635885 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:03:18.635885 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:03:18.635885 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:03:18.637070 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:03:18.637070 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:18.637070 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:18.637070 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:18.637070 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:18.637070 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:18.637070 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:18.637070 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:18.637070 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:18.637070 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:18.637070 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:18.637070 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:18.637070 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:18.637070 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:18.637070 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:18.637070 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:18.637070 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:18.638185 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:03:18.638185 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:03:18.638185 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:18.638185 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:18.640641 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 375/752] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:18.641606 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a793c73-afd0-4346-825e-a0bbcde9b07b None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:18.724906 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:18.738586 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70251333-6b11-4bb6-bd9e-d576102a0394 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:18.767855 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a793c73-afd0-4346-825e-a0bbcde9b07b None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:18.787541 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a05892-0acd-470e-8242-37c8454be97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:18.789137 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a05892-0acd-470e-8242-37c8454be97e None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:18.789616 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a05892-0acd-470e-8242-37c8454be97e None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:18.790107 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a05892-0acd-470e-8242-37c8454be97e None admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:18.791031 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a05892-0acd-470e-8242-37c8454be97e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:18.791534 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a05892-0acd-470e-8242-37c8454be97e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:18.793453 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a05892-0acd-470e-8242-37c8454be97e None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:18.807443 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 378/753] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:18.812000 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a05892-0acd-470e-8242-37c8454be97e None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:18.818675 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1395e9e-d6bc-41a5-bcaa-cef4eab73363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:18.819664 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1395e9e-d6bc-41a5-bcaa-cef4eab73363 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:18.820175 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1395e9e-d6bc-41a5-bcaa-cef4eab73363 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:18.820728 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1395e9e-d6bc-41a5-bcaa-cef4eab73363 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:18.871388 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:18.897138 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1395e9e-d6bc-41a5-bcaa-cef4eab73363 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:18.898924 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1395e9e-d6bc-41a5-bcaa-cef4eab73363 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:18.924707 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a05892-0acd-470e-8242-37c8454be97e None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:18.961592 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07badbfd-f84c-424b-83bb-71c62b276cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:18.962251 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07badbfd-f84c-424b-83bb-71c62b276cbc None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:18.962539 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07badbfd-f84c-424b-83bb-71c62b276cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:18.962798 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07badbfd-f84c-424b-83bb-71c62b276cbc None admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:18.963570 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07badbfd-f84c-424b-83bb-71c62b276cbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:18.963874 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07badbfd-f84c-424b-83bb-71c62b276cbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:18.965427 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07badbfd-f84c-424b-83bb-71c62b276cbc None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:18.971330 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:18.979102 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 379/754] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:18.980044 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07badbfd-f84c-424b-83bb-71c62b276cbc None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:19.026781 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 376/755] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:03:18 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 13:03:19.028084 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1395e9e-d6bc-41a5-bcaa-cef4eab73363 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:19.089371 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07badbfd-f84c-424b-83bb-71c62b276cbc None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:19.104401 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:19.130193 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65949edb-2cf4-41d7-a2bf-6dc533061468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:19.131289 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65949edb-2cf4-41d7-a2bf-6dc533061468 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:19.131596 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65949edb-2cf4-41d7-a2bf-6dc533061468 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:19.131964 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65949edb-2cf4-41d7-a2bf-6dc533061468 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:19.137417 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1395e9e-d6bc-41a5-bcaa-cef4eab73363 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:19.139960 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65949edb-2cf4-41d7-a2bf-6dc533061468 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:19.141878 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65949edb-2cf4-41d7-a2bf-6dc533061468 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:19.156985 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-65949edb-2cf4-41d7-a2bf-6dc533061468 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:03:19.156985 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:19.156985 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:19.156985 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:19.156985 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:19.156985 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:19.156985 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:19.156985 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:19.156985 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:19.156985 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:19.156985 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:19.156985 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:19.156985 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 13:03:19.156985 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 13:03:19.156985 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 13:03:19.157921 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 13:03:19.157921 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:19.157921 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:19.157921 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:19.157921 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:19.157921 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:19.157921 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:19.157921 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:19.157921 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:19.157921 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:19.157921 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:19.157921 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:19.157921 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:19.157921 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:19.157921 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:19.157921 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:19.157921 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:19.158898 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 13:03:19.158898 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 13:03:19.158898 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 13:03:19.158898 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 13:03:19.158898 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 13:03:19.158898 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 13:03:19.158898 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:03:19.158898 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:19.163394 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 380/756] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:03:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:19.164325 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65949edb-2cf4-41d7-a2bf-6dc533061468 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:19.178516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91ad84-223d-4935-bbe2-9152c139bda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:19.179585 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91ad84-223d-4935-bbe2-9152c139bda7 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:19.180071 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91ad84-223d-4935-bbe2-9152c139bda7 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:19.180590 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91ad84-223d-4935-bbe2-9152c139bda7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:19.188768 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c91ad84-223d-4935-bbe2-9152c139bda7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:19.190414 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c91ad84-223d-4935-bbe2-9152c139bda7 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:19.205949 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-4c91ad84-223d-4935-bbe2-9152c139bda7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:03:19.205949 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:19.205949 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:19.205949 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:19.205949 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:19.205949 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:19.205949 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:19.205949 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:19.205949 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:19.205949 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:19.205949 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:19.205949 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:19.205949 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 13:03:19.205949 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 13:03:19.205949 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 13:03:19.206885 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 13:03:19.206885 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:19.206885 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:19.206885 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:19.206885 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:19.206885 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:19.206885 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:19.206885 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:19.206885 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:19.206885 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:19.206885 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:19.206885 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:19.206885 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:19.206885 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:19.206885 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:19.206885 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:19.206885 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:19.207780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 13:03:19.207780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 13:03:19.207780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 13:03:19.207780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 13:03:19.207780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 13:03:19.207780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 13:03:19.207780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:03:19.207780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:19.210355 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 377/757] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:03:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:19.211469 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91ad84-223d-4935-bbe2-9152c139bda7 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:19.238480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:19.276080 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65949edb-2cf4-41d7-a2bf-6dc533061468 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:19.314759 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80f1e4-8164-42f8-93f4-82cd112a9110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:19.315553 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80f1e4-8164-42f8-93f4-82cd112a9110 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:19.315880 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80f1e4-8164-42f8-93f4-82cd112a9110 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:19.316184 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80f1e4-8164-42f8-93f4-82cd112a9110 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:19.327575 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e80f1e4-8164-42f8-93f4-82cd112a9110 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:19.329069 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e80f1e4-8164-42f8-93f4-82cd112a9110 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:19.330752 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91ad84-223d-4935-bbe2-9152c139bda7 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:19.349028 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-3e80f1e4-8164-42f8-93f4-82cd112a9110 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:19.349028 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:19.349028 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:19.349028 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:19.349028 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:19.349028 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:19.349028 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:19.349028 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:19.349028 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:19.349028 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:19.349028 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:19.349028 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:19.349028 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:03:19.349028 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:03:19.349028 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:03:19.349957 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:03:19.349957 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:19.349957 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:19.349957 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:19.349957 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:19.349957 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:19.349957 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:19.349957 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:19.349957 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:19.349957 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:19.349957 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:19.349957 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:19.349957 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:19.349957 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:19.349957 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:19.349957 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:19.349957 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:19.350828 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:03:19.350828 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:03:19.350828 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:19.350828 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:19.354733 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 381/758] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:19.355637 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80f1e4-8164-42f8-93f4-82cd112a9110 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:19.369860 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de43f8-9ed2-451b-81c2-5f3d06ed3962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:19.370831 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de43f8-9ed2-451b-81c2-5f3d06ed3962 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:19.371418 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de43f8-9ed2-451b-81c2-5f3d06ed3962 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:19.371908 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de43f8-9ed2-451b-81c2-5f3d06ed3962 None admin] PATH_INFO: `/v3/projects` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:19.372962 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de43f8-9ed2-451b-81c2-5f3d06ed3962 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:19.373467 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de43f8-9ed2-451b-81c2-5f3d06ed3962 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:19.375437 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de43f8-9ed2-451b-81c2-5f3d06ed3962 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:19.382227 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:19.390150 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 378/759] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 13:03:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:19.391274 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de43f8-9ed2-451b-81c2-5f3d06ed3962 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:19.480604 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80f1e4-8164-42f8-93f4-82cd112a9110 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:19.491466 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:19.510009 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de43f8-9ed2-451b-81c2-5f3d06ed3962 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:19.527358 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951ad42-52e3-46ed-9d52-acf372cb8648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:19.528566 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951ad42-52e3-46ed-9d52-acf372cb8648 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:19.529002 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951ad42-52e3-46ed-9d52-acf372cb8648 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:19.529428 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951ad42-52e3-46ed-9d52-acf372cb8648 None admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:19.530559 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8951ad42-52e3-46ed-9d52-acf372cb8648 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:19.531475 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8951ad42-52e3-46ed-9d52-acf372cb8648 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:19.533401 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8951ad42-52e3-46ed-9d52-acf372cb8648 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:19.547439 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0958c1-362b-47a8-a279-49663f0aeff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:19.548107 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0958c1-362b-47a8-a279-49663f0aeff2 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:19.548486 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0958c1-362b-47a8-a279-49663f0aeff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:19.548852 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0958c1-362b-47a8-a279-49663f0aeff2 None admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:19.549495 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0958c1-362b-47a8-a279-49663f0aeff2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:19.549854 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0958c1-362b-47a8-a279-49663f0aeff2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:19.551308 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0958c1-362b-47a8-a279-49663f0aeff2 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:19.551698 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 382/760] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 13:03:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:19.552982 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951ad42-52e3-46ed-9d52-acf372cb8648 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:19.565927 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 379/761] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:03:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:19.566778 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0958c1-362b-47a8-a279-49663f0aeff2 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:19.655151 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:19.675518 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951ad42-52e3-46ed-9d52-acf372cb8648 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:19.714874 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b9e45-2ef7-46da-9905-90d49224ec74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:19.715762 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b9e45-2ef7-46da-9905-90d49224ec74 None admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:19.716040 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b9e45-2ef7-46da-9905-90d49224ec74 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:19.716356 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b9e45-2ef7-46da-9905-90d49224ec74 None admin] PATH_INFO: `/v3/projects/c8c0bf799c9f451b8167a646a5c82eda/users/066aaba3e9af4f85ab0cba89a3d32e34/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:19.716744 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0958c1-362b-47a8-a279-49663f0aeff2 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:19.718572 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b9e45-2ef7-46da-9905-90d49224ec74 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8c0bf799c9f451b8167a646a5c82eda, user_id=066aaba3e9af4f85ab0cba89a3d32e34, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:19.720117 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b9e45-2ef7-46da-9905-90d49224ec74 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:19.754665 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8ef8b-a3de-437a-b585-f334b33e185f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:19.755319 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8ef8b-a3de-437a-b585-f334b33e185f None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:19.755601 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8ef8b-a3de-437a-b585-f334b33e185f None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:19.755872 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8ef8b-a3de-437a-b585-f334b33e185f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:19.756734 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb8ef8b-a3de-437a-b585-f334b33e185f None admin] RBAC: Adding query filter params (role.id=bbd5f3e0c18e4992886fcfb4a3feb426, scope.project.id=c8c0bf799c9f451b8167a646a5c82eda, user.id=b07ad3dd7477497ea25c2a01bff35712) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:19.757047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb8ef8b-a3de-437a-b585-f334b33e185f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:19.758489 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb8ef8b-a3de-437a-b585-f334b33e185f None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:19.764963 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 380/762] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 13:03:19 2022] GET /identity/v3/role_assignments?user.id=b07ad3dd7477497ea25c2a01bff35712&scope.project.id=c8c0bf799c9f451b8167a646a5c82eda&role.id=bbd5f3e0c18e4992886fcfb4a3feb426 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:19.765482 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8ef8b-a3de-437a-b585-f334b33e185f None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:19.776936 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:19.799070 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 383/763] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jun 3 13:03:19 2022] PUT /identity/v3/projects/c8c0bf799c9f451b8167a646a5c82eda/users/066aaba3e9af4f85ab0cba89a3d32e34/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:19.908005 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8ef8b-a3de-437a-b585-f334b33e185f None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:19.954552 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98908d25-7e6e-43be-aa0b-d134275c6f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:19.955369 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98908d25-7e6e-43be-aa0b-d134275c6f17 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:19.955657 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98908d25-7e6e-43be-aa0b-d134275c6f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:19.955933 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98908d25-7e6e-43be-aa0b-d134275c6f17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:19.963873 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98908d25-7e6e-43be-aa0b-d134275c6f17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:19.965410 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98908d25-7e6e-43be-aa0b-d134275c6f17 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:19.982504 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-98908d25-7e6e-43be-aa0b-d134275c6f17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:03:19.982504 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:19.982504 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:19.982504 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:19.982504 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:19.982504 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:19.982504 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:19.982504 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:19.982504 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:19.982504 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:19.982504 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:19.982504 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:19.982504 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 13:03:19.982504 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 13:03:19.982504 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 13:03:19.984668 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 13:03:19.984668 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:19.984668 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:19.984668 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:19.984668 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:19.984668 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:19.984668 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:19.984668 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:19.984668 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:19.984668 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:19.984668 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:19.984668 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:19.984668 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:19.984668 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:19.984668 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:19.984668 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:19.984668 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:19.985853 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 13:03:19.985853 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 13:03:19.985853 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 13:03:19.985853 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 13:03:19.985853 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 13:03:19.985853 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 13:03:19.985853 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:03:19.985853 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:19.988395 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 381/764] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:03:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:19.990081 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b9e45-2ef7-46da-9905-90d49224ec74 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:20.031153 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc6a0d-c8f8-4edb-adfc-8aa81a7fedb1 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:20.031546 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc6a0d-c8f8-4edb-adfc-8aa81a7fedb1 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:20.031835 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc6a0d-c8f8-4edb-adfc-8aa81a7fedb1 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:20.033290 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 382/765] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 13:03:20.039537 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18ac9a-4cd2-4edd-bcac-da2552d0fe10 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:20.039837 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18ac9a-4cd2-4edd-bcac-da2552d0fe10 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:20.040096 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18ac9a-4cd2-4edd-bcac-da2552d0fe10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:20.072779 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-2f18ac9a-4cd2-4edd-bcac-da2552d0fe10 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:20.074068 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-2f18ac9a-4cd2-4edd-bcac-da2552d0fe10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:20.131843 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b9e45-2ef7-46da-9905-90d49224ec74 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:20.153739 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:20.157906 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 383/766] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:03:20.182827 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e05ec5-fdb8-498c-918a-1871714bfa6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:20.183817 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e05ec5-fdb8-498c-918a-1871714bfa6d None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:20.184276 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e05ec5-fdb8-498c-918a-1871714bfa6d None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:20.184691 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e05ec5-fdb8-498c-918a-1871714bfa6d None admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:20.185614 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e05ec5-fdb8-498c-918a-1871714bfa6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:20.186203 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e05ec5-fdb8-498c-918a-1871714bfa6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:20.188550 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e05ec5-fdb8-498c-918a-1871714bfa6d None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:20.192699 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f18ac9a-4cd2-4edd-bcac-da2552d0fe10 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:20.203006 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 384/767] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 13:03:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:20.210028 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e05ec5-fdb8-498c-918a-1871714bfa6d None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:20.213921 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:20.306143 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f18ac9a-4cd2-4edd-bcac-da2552d0fe10 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:20.318753 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e05ec5-fdb8-498c-918a-1871714bfa6d None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:20.343838 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9606de2-7bf9-48cc-b425-3c358e14792f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:20.345045 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9606de2-7bf9-48cc-b425-3c358e14792f None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:20.345541 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9606de2-7bf9-48cc-b425-3c358e14792f None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:20.346040 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9606de2-7bf9-48cc-b425-3c358e14792f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:20.346887 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9606de2-7bf9-48cc-b425-3c358e14792f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:20.348861 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9606de2-7bf9-48cc-b425-3c358e14792f None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:20.355287 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f868426-7329-4c7a-a5ff-49f998f27617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:20.355946 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f868426-7329-4c7a-a5ff-49f998f27617 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:20.356263 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f868426-7329-4c7a-a5ff-49f998f27617 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:20.356550 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f868426-7329-4c7a-a5ff-49f998f27617 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:20.357383 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f868426-7329-4c7a-a5ff-49f998f27617 None admin] RBAC: Adding query filter params (role.id=eb985092d5f14e92a783e26568bf457b, scope.project.id=c8c0bf799c9f451b8167a646a5c82eda, user.id=06c55d0ea52f40ae9125d2efe1d159a3) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:20.357696 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f868426-7329-4c7a-a5ff-49f998f27617 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:20.359947 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f868426-7329-4c7a-a5ff-49f998f27617 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:20.364474 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-c9606de2-7bf9-48cc-b425-3c358e14792f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 13:03:20.364474 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:20.364474 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 13:03:20.364474 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 13:03:20.364474 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 13:03:20.364474 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 13:03:20.364474 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 13:03:20.364474 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:03:20.364474 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 13:03:20.364474 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:20.364474 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 13:03:20.364474 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:20.364474 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:20.364474 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:20.364474 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:20.364474 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:20.365388 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:20.365388 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:20.365388 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:20.365388 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:20.365388 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:20.365388 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:20.365388 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:20.365388 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 13:03:20.365388 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 13:03:20.365388 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 13:03:20.365388 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 13:03:20.365388 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:20.365388 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:20.365388 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:20.365388 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:20.365388 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:20.366227 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:20.366227 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:20.366227 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:20.366227 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:20.366227 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:20.366227 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:20.366227 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:20.366227 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:20.366227 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:20.366227 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:20.366227 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:20.366227 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 13:03:20.366227 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:03:20.366227 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 13:03:20.366227 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:20.366991 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 385/768] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 13:03:20 2022] GET /identity/v3/role_assignments?user.id=06c55d0ea52f40ae9125d2efe1d159a3&scope.project.id=c8c0bf799c9f451b8167a646a5c82eda&role.id=eb985092d5f14e92a783e26568bf457b => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:20.369312 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 384/769] 10.222.0.61 () {56 vars in 1129 bytes} [Fri Jun 3 13:03:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:20.375825 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f868426-7329-4c7a-a5ff-49f998f27617 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:20.472997 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:20.511909 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f868426-7329-4c7a-a5ff-49f998f27617 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:20.553172 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9bda7-eead-4eae-b040-88ffac65a4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:20.554132 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9bda7-eead-4eae-b040-88ffac65a4d7 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:20.554571 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9bda7-eead-4eae-b040-88ffac65a4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:20.555004 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9bda7-eead-4eae-b040-88ffac65a4d7 None admin] PATH_INFO: `/v3/services` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:20.555894 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc9bda7-eead-4eae-b040-88ffac65a4d7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:20.556405 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc9bda7-eead-4eae-b040-88ffac65a4d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:20.558017 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc9bda7-eead-4eae-b040-88ffac65a4d7 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:20.564774 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 386/770] 10.222.0.61 () {56 vars in 1124 bytes} [Fri Jun 3 13:03:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:20.573581 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9606de2-7bf9-48cc-b425-3c358e14792f None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:20.660447 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:20.719692 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9606de2-7bf9-48cc-b425-3c358e14792f None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:20.765041 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49ccae-5d28-4c3c-9be1-ccf866675c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:20.765628 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49ccae-5d28-4c3c-9be1-ccf866675c74 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:20.765909 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49ccae-5d28-4c3c-9be1-ccf866675c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:20.766185 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49ccae-5d28-4c3c-9be1-ccf866675c74 None admin] PATH_INFO: `/v3/services` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:20.766887 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d49ccae-5d28-4c3c-9be1-ccf866675c74 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:20.767190 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d49ccae-5d28-4c3c-9be1-ccf866675c74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:20.768570 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d49ccae-5d28-4c3c-9be1-ccf866675c74 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:20.776521 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 385/771] 10.222.0.61 () {56 vars in 1124 bytes} [Fri Jun 3 13:03:20 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:20.783376 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9bda7-eead-4eae-b040-88ffac65a4d7 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:20.912401 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c50e79-4c18-4bca-8e55-42ecef03ab53 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:20.912789 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c50e79-4c18-4bca-8e55-42ecef03ab53 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:20.912992 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c50e79-4c18-4bca-8e55-42ecef03ab53 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:20.914769 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 386/772] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:03:20.919766 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519266e-44ab-450e-a441-0a98396e130e None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:20.920052 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519266e-44ab-450e-a441-0a98396e130e None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:20.920355 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519266e-44ab-450e-a441-0a98396e130e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:20.921656 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9bda7-eead-4eae-b040-88ffac65a4d7 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:20.957046 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:20.957615 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-1519266e-44ab-450e-a441-0a98396e130e None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:20.958808 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-1519266e-44ab-450e-a441-0a98396e130e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:20.964838 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8f6f3-0f01-4760-8f36-810660058a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:20.965554 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8f6f3-0f01-4760-8f36-810660058a6d None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:20.965837 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8f6f3-0f01-4760-8f36-810660058a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:20.966106 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8f6f3-0f01-4760-8f36-810660058a6d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:20.966895 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8f6f3-0f01-4760-8f36-810660058a6d None admin] RBAC: Adding query filter params (interface=public, service_id=4521a69a690342ec9b983e3e8d7a95c6, region_id=RegionOne) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:20.967202 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8f6f3-0f01-4760-8f36-810660058a6d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:20.969478 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8f6f3-0f01-4760-8f36-810660058a6d None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:20.983599 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 387/773] 10.222.0.61 () {56 vars in 1251 bytes} [Fri Jun 3 13:03:20 2022] GET /identity/v3/endpoints?service_id=4521a69a690342ec9b983e3e8d7a95c6&interface=public®ion_id=RegionOne => generated 194 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:20.990286 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8f6f3-0f01-4760-8f36-810660058a6d None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:21.049476 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 387/774] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:03:21.072506 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519266e-44ab-450e-a441-0a98396e130e None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:21.136651 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:21.184497 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519266e-44ab-450e-a441-0a98396e130e None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:21.223710 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ff709-3d03-4b41-91c1-2ffd3de033ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:21.224722 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ff709-3d03-4b41-91c1-2ffd3de033ab None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:21.225104 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ff709-3d03-4b41-91c1-2ffd3de033ab None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:21.225479 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ff709-3d03-4b41-91c1-2ffd3de033ab None admin] PATH_INFO: `/v3/services/network` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:21.226227 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ff709-3d03-4b41-91c1-2ffd3de033ab None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:21.227699 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ff709-3d03-4b41-91c1-2ffd3de033ab None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:21.240960 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-3f9ff709-3d03-4b41-91c1-2ffd3de033ab None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 13:03:21.240960 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:21.240960 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 13:03:21.240960 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 13:03:21.240960 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 13:03:21.240960 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 13:03:21.240960 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 13:03:21.240960 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:03:21.240960 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 13:03:21.240960 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:21.240960 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 13:03:21.240960 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:21.240960 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:21.240960 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:21.240960 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:21.240960 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:21.240960 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:21.242049 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:21.242049 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:21.242049 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:21.242049 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:21.242049 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:21.242049 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:21.242049 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 13:03:21.242049 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 13:03:21.242049 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 13:03:21.242049 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 13:03:21.242049 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:21.242049 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:21.242049 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:21.242049 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:21.242049 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:21.242049 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:21.242879 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:21.242879 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:21.242879 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:21.242879 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:21.242879 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:21.242879 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:21.242879 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:21.242879 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:21.242879 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:21.242879 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:21.242879 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 13:03:21.242879 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:03:21.242879 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 13:03:21.242879 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:21.243619 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 388/775] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:03:21 2022] GET /identity/v3/services/network => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:03:21.249623 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ff709-3d03-4b41-91c1-2ffd3de033ab None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:21.318848 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8f6f3-0f01-4760-8f36-810660058a6d None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:21.362052 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfc555-4dbb-41d7-b2fb-652b97e4b55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:21.363509 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfc555-4dbb-41d7-b2fb-652b97e4b55f None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:21.363794 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfc555-4dbb-41d7-b2fb-652b97e4b55f None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:21.364072 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfc555-4dbb-41d7-b2fb-652b97e4b55f None admin] PATH_INFO: `/v3/services` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:21.364849 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bfc555-4dbb-41d7-b2fb-652b97e4b55f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:21.366231 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bfc555-4dbb-41d7-b2fb-652b97e4b55f None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:21.372624 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 388/776] 10.222.0.61 () {56 vars in 1087 bytes} [Fri Jun 3 13:03:20 2022] GET /identity/v3/services => generated 772 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:21.408474 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ff709-3d03-4b41-91c1-2ffd3de033ab None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:21.428515 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:21.457731 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7727771-851e-4c88-9856-958eb8964567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:21.458440 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7727771-851e-4c88-9856-958eb8964567 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:21.458725 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7727771-851e-4c88-9856-958eb8964567 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:21.459000 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7727771-851e-4c88-9856-958eb8964567 None admin] PATH_INFO: `/v3/services` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:21.459759 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7727771-851e-4c88-9856-958eb8964567 None admin] RBAC: Adding query filter params (name=network) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:21.460070 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7727771-851e-4c88-9856-958eb8964567 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:21.461518 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7727771-851e-4c88-9856-958eb8964567 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:21.467364 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 389/777] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Jun 3 13:03:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:03:21.473372 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfc555-4dbb-41d7-b2fb-652b97e4b55f None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:21.568121 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:21.642064 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfc555-4dbb-41d7-b2fb-652b97e4b55f None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:21.679980 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02baa6c1-a8ea-4308-b664-2c0f3f4e8e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:21.680683 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02baa6c1-a8ea-4308-b664-2c0f3f4e8e24 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:21.680967 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02baa6c1-a8ea-4308-b664-2c0f3f4e8e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:21.681247 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02baa6c1-a8ea-4308-b664-2c0f3f4e8e24 None admin] PATH_INFO: `/v3/services` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:21.681971 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02baa6c1-a8ea-4308-b664-2c0f3f4e8e24 None admin] RBAC: Adding query filter params (type=network) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:21.682269 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02baa6c1-a8ea-4308-b664-2c0f3f4e8e24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:21.683654 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02baa6c1-a8ea-4308-b664-2c0f3f4e8e24 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:21.694447 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 389/778] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Jun 3 13:03:21 2022] GET /identity/v3/services?type=network => generated 350 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:21.695806 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7727771-851e-4c88-9856-958eb8964567 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:21.818285 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7727771-851e-4c88-9856-958eb8964567 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:21.862874 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8bf16b-50fa-4436-b0f4-3dee6bc57468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:21.863540 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8bf16b-50fa-4436-b0f4-3dee6bc57468 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:21.863820 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8bf16b-50fa-4436-b0f4-3dee6bc57468 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:21.864093 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8bf16b-50fa-4436-b0f4-3dee6bc57468 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:21.864915 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8bf16b-50fa-4436-b0f4-3dee6bc57468 None admin] RBAC: Adding query filter params (interface=public, service_id=280dce54ab6145d6aac502935f1e8684, region_id=RegionOne) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:21.865224 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8bf16b-50fa-4436-b0f4-3dee6bc57468 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:21.877343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8bf16b-50fa-4436-b0f4-3dee6bc57468 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:21.877343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 390/779] 10.222.0.61 () {56 vars in 1251 bytes} [Fri Jun 3 13:03:21 2022] GET /identity/v3/endpoints?service_id=280dce54ab6145d6aac502935f1e8684&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:21.880026 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02baa6c1-a8ea-4308-b664-2c0f3f4e8e24 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:22.046678 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02baa6c1-a8ea-4308-b664-2c0f3f4e8e24 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:22.079791 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:22.095322 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f7dbf-0678-461c-992d-2494a92feb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:22.096003 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f7dbf-0678-461c-992d-2494a92feb00 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:22.096313 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f7dbf-0678-461c-992d-2494a92feb00 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:22.096595 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f7dbf-0678-461c-992d-2494a92feb00 None admin] PATH_INFO: `/v3/services` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:22.097286 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f7dbf-0678-461c-992d-2494a92feb00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:22.098922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f7dbf-0678-461c-992d-2494a92feb00 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:22.108695 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 390/780] 10.222.0.61 () {56 vars in 1087 bytes} [Fri Jun 3 13:03:21 2022] GET /identity/v3/services => generated 772 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:22.820802 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc03771-3ecd-4baa-9b17-536f39b347c3 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:22.821844 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc03771-3ecd-4baa-9b17-536f39b347c3 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:22.822329 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc03771-3ecd-4baa-9b17-536f39b347c3 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:22.824187 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 391/781] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:03:22.829662 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f161b-d3cb-420b-859f-715a6ecf7d15 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:22.830503 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f161b-d3cb-420b-859f-715a6ecf7d15 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:22.830987 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f161b-d3cb-420b-859f-715a6ecf7d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:22.849013 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-ba2f161b-d3cb-420b-859f-715a6ecf7d15 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:22.850555 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-ba2f161b-d3cb-420b-859f-715a6ecf7d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:22.893402 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a95c33-a468-47c9-8c61-2e737a029069 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:22.893955 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a95c33-a468-47c9-8c61-2e737a029069 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:22.893955 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a95c33-a468-47c9-8c61-2e737a029069 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:22.895577 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 392/782] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:03:22.902902 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aabe3b-9064-4896-8d9e-b89b65d971e2 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:22.903193 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aabe3b-9064-4896-8d9e-b89b65d971e2 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:22.903476 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aabe3b-9064-4896-8d9e-b89b65d971e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:22.941664 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 391/783] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:03:22.943623 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-e0aabe3b-9064-4896-8d9e-b89b65d971e2 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:22.944896 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-e0aabe3b-9064-4896-8d9e-b89b65d971e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:22.964445 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f161b-d3cb-420b-859f-715a6ecf7d15 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:23.024523 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:23.059099 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 393/784] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 13:03:23.060819 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9c05d-ee8e-4dbb-b6da-b1757c421165 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:23.061916 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9c05d-ee8e-4dbb-b6da-b1757c421165 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:23.062433 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9c05d-ee8e-4dbb-b6da-b1757c421165 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:23.064505 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 394/785] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:03:23.082385 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89adf2d-b18e-449a-b1c8-ecdebc05b84a None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:23.082969 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89adf2d-b18e-449a-b1c8-ecdebc05b84a None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:23.083489 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89adf2d-b18e-449a-b1c8-ecdebc05b84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:23.101455 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-b89adf2d-b18e-449a-b1c8-ecdebc05b84a None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:23.103079 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-b89adf2d-b18e-449a-b1c8-ecdebc05b84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:23.132180 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f161b-d3cb-420b-859f-715a6ecf7d15 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:23.148014 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:23.166251 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf262fb1-5e32-4798-a65c-1a859de38fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:23.167248 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf262fb1-5e32-4798-a65c-1a859de38fef None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:23.167597 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf262fb1-5e32-4798-a65c-1a859de38fef None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:23.167942 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf262fb1-5e32-4798-a65c-1a859de38fef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:23.180890 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf262fb1-5e32-4798-a65c-1a859de38fef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:03:23.190160 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-cf262fb1-5e32-4798-a65c-1a859de38fef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:03:23.190160 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:23.190160 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:23.190160 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:23.190160 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:23.190160 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:23.190160 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:23.190160 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:23.190160 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:23.190160 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:23.190160 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:23.190160 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:23.190160 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:03:23.190160 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:03:23.190160 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:03:23.190160 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:03:23.191300 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:03:23.191300 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:03:23.191300 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:03:23.191300 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:03:23.191300 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:23.191300 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:23.191300 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:23.191300 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:23.191300 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:23.191300 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:23.191300 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:23.191300 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:23.191300 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:23.191300 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:23.191300 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:23.191300 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:23.192352 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:23.192352 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:23.192352 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:23.192352 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:23.192352 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:03:23.192352 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:03:23.192352 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:03:23.192352 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:03:23.192352 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:03:23.192352 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:03:23.192352 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:03:23.192352 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:23.197792 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 392/786] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 13:03:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:03:23.197792 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf262fb1-5e32-4798-a65c-1a859de38fef None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:23.198109 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 395/787] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 13:03:23.199835 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89adf2d-b18e-449a-b1c8-ecdebc05b84a None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:23.325943 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf262fb1-5e32-4798-a65c-1a859de38fef None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:23.341483 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89adf2d-b18e-449a-b1c8-ecdebc05b84a None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:23.350554 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:23.365839 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b156f74-8e52-43c4-9752-4db8b9e2aafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:23.366632 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b156f74-8e52-43c4-9752-4db8b9e2aafa None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:23.366910 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b156f74-8e52-43c4-9752-4db8b9e2aafa None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:23.367180 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b156f74-8e52-43c4-9752-4db8b9e2aafa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:23.378271 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b156f74-8e52-43c4-9752-4db8b9e2aafa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:03:23.379735 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c9724-6ca8-4363-a49d-9198a2697137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:23.380440 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c9724-6ca8-4363-a49d-9198a2697137 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:23.380723 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c9724-6ca8-4363-a49d-9198a2697137 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:23.381021 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c9724-6ca8-4363-a49d-9198a2697137 None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:23.381774 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861c9724-6ca8-4363-a49d-9198a2697137 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:23.382081 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861c9724-6ca8-4363-a49d-9198a2697137 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:23.383495 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861c9724-6ca8-4363-a49d-9198a2697137 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:23.385896 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-4b156f74-8e52-43c4-9752-4db8b9e2aafa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:03:23.385896 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:23.385896 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:23.385896 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:23.385896 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:23.385896 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:23.385896 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:23.385896 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:23.385896 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:23.385896 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:23.385896 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:23.385896 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:23.385896 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:03:23.385896 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:03:23.385896 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:03:23.385896 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:03:23.387996 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:03:23.387996 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:03:23.387996 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:03:23.387996 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:03:23.387996 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:23.387996 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:23.387996 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:23.387996 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:23.387996 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:23.387996 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:23.387996 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:23.387996 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:23.387996 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:23.387996 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:23.387996 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:23.387996 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:23.390584 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:23.390584 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:23.390584 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:23.390584 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:23.390584 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:03:23.390584 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:03:23.390584 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:03:23.390584 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:03:23.390584 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:03:23.390584 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:03:23.390584 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:03:23.390584 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:23.400205 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 393/788] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 13:03:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:23.400205 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b156f74-8e52-43c4-9752-4db8b9e2aafa None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:23.400624 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 396/789] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:03:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:03:23.400774 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c9724-6ca8-4363-a49d-9198a2697137 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:23.436783 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:23.502092 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b156f74-8e52-43c4-9752-4db8b9e2aafa None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:23.516107 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c9724-6ca8-4363-a49d-9198a2697137 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:23.538511 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad0687-17ff-42b7-84ca-d6f933cf6ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:23.539305 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad0687-17ff-42b7-84ca-d6f933cf6ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:23.539586 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad0687-17ff-42b7-84ca-d6f933cf6ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:23.539858 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad0687-17ff-42b7-84ca-d6f933cf6ca3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:23.550614 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad0687-17ff-42b7-84ca-d6f933cf6ca3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:03:23.552671 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872566e6-5c89-4245-ab88-aef64307bd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:23.553341 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872566e6-5c89-4245-ab88-aef64307bd74 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:23.553623 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872566e6-5c89-4245-ab88-aef64307bd74 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:23.553928 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872566e6-5c89-4245-ab88-aef64307bd74 None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:23.554673 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872566e6-5c89-4245-ab88-aef64307bd74 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:23.554982 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872566e6-5c89-4245-ab88-aef64307bd74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:23.556455 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872566e6-5c89-4245-ab88-aef64307bd74 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:23.558303 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-faad0687-17ff-42b7-84ca-d6f933cf6ca3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 13:03:23.558303 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:23.558303 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:23.558303 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:23.558303 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:23.558303 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:23.558303 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:23.558303 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:23.558303 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:23.558303 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:23.558303 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:23.558303 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:23.558303 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:03:23.558303 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:03:23.558303 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:03:23.558303 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:03:23.560359 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:03:23.560359 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:03:23.560359 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:03:23.560359 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:03:23.560359 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:23.560359 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:23.560359 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:23.560359 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:23.560359 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:23.560359 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:23.560359 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:23.560359 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:23.560359 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:23.560359 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:23.560359 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:23.560359 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:23.563018 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:23.563018 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:23.563018 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:23.563018 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:23.563018 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:03:23.563018 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:03:23.563018 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:03:23.563018 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:03:23.563018 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:03:23.563018 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:03:23.563018 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 13:03:23.563018 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:23.564515 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 394/790] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jun 3 13:03:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:23.572180 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad0687-17ff-42b7-84ca-d6f933cf6ca3 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:23.572508 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 397/791] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:03:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:23.572508 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872566e6-5c89-4245-ab88-aef64307bd74 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:23.606267 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:23.671314 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:23.675866 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad0687-17ff-42b7-84ca-d6f933cf6ca3 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:23.683313 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872566e6-5c89-4245-ab88-aef64307bd74 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:23.712675 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da39df5e-c66b-4654-be31-1fc0e57227e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:23.713474 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39df5e-c66b-4654-be31-1fc0e57227e6 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:23.713760 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39df5e-c66b-4654-be31-1fc0e57227e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:23.714139 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39df5e-c66b-4654-be31-1fc0e57227e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:23.720834 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046fd50-d157-4255-b0e8-2701b9338705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:23.721558 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046fd50-d157-4255-b0e8-2701b9338705 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:23.721870 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046fd50-d157-4255-b0e8-2701b9338705 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:23.722155 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046fd50-d157-4255-b0e8-2701b9338705 None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:23.723151 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046fd50-d157-4255-b0e8-2701b9338705 None admin] RBAC: Adding query filter params (name=service) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:23.723478 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046fd50-d157-4255-b0e8-2701b9338705 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:23.724905 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046fd50-d157-4255-b0e8-2701b9338705 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:23.726694 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da39df5e-c66b-4654-be31-1fc0e57227e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:23.728313 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da39df5e-c66b-4654-be31-1fc0e57227e6 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:23.734766 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 398/792] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jun 3 13:03:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:23.735634 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046fd50-d157-4255-b0e8-2701b9338705 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:23.754889 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-da39df5e-c66b-4654-be31-1fc0e57227e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:23.754889 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:23.754889 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:23.754889 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:23.754889 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:23.754889 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:23.754889 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:23.754889 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:23.754889 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:23.754889 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:23.754889 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:23.754889 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:23.754889 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:03:23.754889 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:03:23.754889 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:03:23.757032 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:03:23.757032 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:23.757032 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:23.757032 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:23.757032 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:23.757032 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:23.757032 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:23.757032 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:23.757032 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:23.757032 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:23.757032 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:23.757032 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:23.757032 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:23.757032 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:23.757032 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:23.757032 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:23.757032 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:23.759078 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:03:23.759078 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:03:23.759078 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:23.759078 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:23.759078 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 395/793] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:23.759078 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da39df5e-c66b-4654-be31-1fc0e57227e6 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:23.845714 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:23.855767 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046fd50-d157-4255-b0e8-2701b9338705 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:23.876831 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da39df5e-c66b-4654-be31-1fc0e57227e6 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:23.894147 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7fac23-bfbd-4745-bed4-4546323533a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:23.895337 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7fac23-bfbd-4745-bed4-4546323533a8 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:23.895628 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7fac23-bfbd-4745-bed4-4546323533a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:23.896054 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7fac23-bfbd-4745-bed4-4546323533a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:23.910548 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7fac23-bfbd-4745-bed4-4546323533a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:23.912623 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7fac23-bfbd-4745-bed4-4546323533a8 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:23.917378 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce261b7d-1229-467d-b8df-36f25a4cc44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:23.918415 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce261b7d-1229-467d-b8df-36f25a4cc44a None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:23.918931 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce261b7d-1229-467d-b8df-36f25a4cc44a None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:23.919434 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce261b7d-1229-467d-b8df-36f25a4cc44a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:23.931850 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce261b7d-1229-467d-b8df-36f25a4cc44a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:23.933690 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce261b7d-1229-467d-b8df-36f25a4cc44a None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:23.933802 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-ed7fac23-bfbd-4745-bed4-4546323533a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:23.933802 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:23.933802 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:23.933802 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:23.933802 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:23.933802 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:23.933802 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:23.933802 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:23.933802 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:23.933802 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:23.933802 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:23.933802 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:23.933802 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:03:23.933802 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:03:23.933802 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:03:23.934630 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:03:23.934630 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:23.934630 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:23.934630 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:23.934630 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:23.934630 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:23.934630 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:23.934630 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:23.934630 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:23.934630 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:23.934630 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:23.934630 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:23.934630 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:23.934630 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:23.934630 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:23.934630 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:23.934630 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:23.935510 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:03:23.935510 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:03:23.935510 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:23.935510 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:23.940121 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 399/794] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:23.941410 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7fac23-bfbd-4745-bed4-4546323533a8 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:23.957797 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-ce261b7d-1229-467d-b8df-36f25a4cc44a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:23.957797 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:23.957797 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:23.957797 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:23.957797 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:23.957797 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:23.957797 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:23.957797 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:23.957797 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:23.957797 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:23.957797 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:23.957797 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:23.957797 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:03:23.957797 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:03:23.957797 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:03:23.958729 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:03:23.958729 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:23.958729 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:23.958729 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:23.958729 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:23.958729 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:23.958729 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:23.958729 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:23.958729 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:23.958729 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:23.958729 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:23.958729 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:23.958729 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:23.958729 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:23.958729 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:23.958729 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:23.958729 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:23.959615 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:03:23.959615 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:03:23.959615 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:23.959615 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:23.966192 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 396/795] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:23.967488 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce261b7d-1229-467d-b8df-36f25a4cc44a None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:23.970522 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:24.064850 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7fac23-bfbd-4745-bed4-4546323533a8 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:24.094662 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce261b7d-1229-467d-b8df-36f25a4cc44a None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:24.102087 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fe454-1650-4920-922f-b407b7ba83c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:24.103043 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fe454-1650-4920-922f-b407b7ba83c5 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:24.103532 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fe454-1650-4920-922f-b407b7ba83c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:24.104036 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fe454-1650-4920-922f-b407b7ba83c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:24.105026 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6fe454-1650-4920-922f-b407b7ba83c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:24.105539 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6fe454-1650-4920-922f-b407b7ba83c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:24.107158 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6fe454-1650-4920-922f-b407b7ba83c5 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:24.121439 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 400/796] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:24.122640 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fe454-1650-4920-922f-b407b7ba83c5 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:24.128612 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:24.137898 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0691844d-1607-4332-8cb1-523e40f37d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:24.138568 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691844d-1607-4332-8cb1-523e40f37d13 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:24.138878 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691844d-1607-4332-8cb1-523e40f37d13 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:24.140584 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691844d-1607-4332-8cb1-523e40f37d13 None admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:24.140584 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0691844d-1607-4332-8cb1-523e40f37d13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:24.140756 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0691844d-1607-4332-8cb1-523e40f37d13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:24.142057 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0691844d-1607-4332-8cb1-523e40f37d13 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:24.159272 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 397/797] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:24.160211 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0691844d-1607-4332-8cb1-523e40f37d13 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:24.225217 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:24.232217 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fe454-1650-4920-922f-b407b7ba83c5 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:24.265696 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0691844d-1607-4332-8cb1-523e40f37d13 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:24.271441 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2900820e-661c-40d7-97dd-258b26d3e775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:24.272310 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900820e-661c-40d7-97dd-258b26d3e775 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:24.273165 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900820e-661c-40d7-97dd-258b26d3e775 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:24.273590 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900820e-661c-40d7-97dd-258b26d3e775 None admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:24.274791 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2900820e-661c-40d7-97dd-258b26d3e775 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:24.275248 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2900820e-661c-40d7-97dd-258b26d3e775 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:24.277374 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2900820e-661c-40d7-97dd-258b26d3e775 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:24.291595 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 401/798] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:03:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:24.292460 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2900820e-661c-40d7-97dd-258b26d3e775 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:24.306267 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b540dae-c0e9-43a0-9dba-2c284d9aac9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:24.307328 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b540dae-c0e9-43a0-9dba-2c284d9aac9a None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:24.307610 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b540dae-c0e9-43a0-9dba-2c284d9aac9a None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:24.307888 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b540dae-c0e9-43a0-9dba-2c284d9aac9a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:24.317095 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b540dae-c0e9-43a0-9dba-2c284d9aac9a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:24.318554 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b540dae-c0e9-43a0-9dba-2c284d9aac9a None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:24.333843 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-0b540dae-c0e9-43a0-9dba-2c284d9aac9a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 03 13:03:24.333843 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:24.333843 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:24.333843 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:24.333843 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:24.333843 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:24.333843 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:24.333843 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:24.333843 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:24.333843 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:24.333843 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:24.333843 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:24.333843 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 13:03:24.333843 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 13:03:24.333843 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 13:03:24.333843 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 13:03:24.334839 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:24.334839 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:24.334839 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 13:03:24.334839 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:03:24.334839 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 13:03:24.334839 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:03:24.334839 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:24.334839 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:24.334839 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:24.334839 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:24.334839 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:24.334839 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:24.334839 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:24.334839 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:24.334839 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:24.334839 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:24.334839 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:24.334839 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:24.340885 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:24.340885 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:24.340885 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 13:03:24.340885 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 13:03:24.340885 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 13:03:24.340885 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 13:03:24.340885 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 13:03:24.340885 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 13:03:24.340885 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 03 13:03:24.340885 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:24.340885 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 398/799] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 13:03:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:24.340885 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5c961-6cf0-47bd-bc52-d978729d1262 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:24.340885 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5c961-6cf0-47bd-bc52-d978729d1262 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:24.341582 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5c961-6cf0-47bd-bc52-d978729d1262 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:24.341582 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 399/800] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:03:24.341582 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb5c961-6cf0-47bd-bc52-d978729d1262 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:24.370110 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:24.420248 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2900820e-661c-40d7-97dd-258b26d3e775 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:24.447262 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb5c961-6cf0-47bd-bc52-d978729d1262 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:24.461262 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76ccce-443d-4884-a2a9-3cd7d53a2413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:24.462065 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76ccce-443d-4884-a2a9-3cd7d53a2413 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:24.462346 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76ccce-443d-4884-a2a9-3cd7d53a2413 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:24.462620 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76ccce-443d-4884-a2a9-3cd7d53a2413 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:24.470504 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd76ccce-443d-4884-a2a9-3cd7d53a2413 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:24.471960 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd76ccce-443d-4884-a2a9-3cd7d53a2413 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:24.473560 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:24.485475 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d5e34-f01b-4397-8cdf-bbef4f13c797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:24.486286 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d5e34-f01b-4397-8cdf-bbef4f13c797 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:24.487878 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d5e34-f01b-4397-8cdf-bbef4f13c797 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:24.487878 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d5e34-f01b-4397-8cdf-bbef4f13c797 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:24.488052 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-cd76ccce-443d-4884-a2a9-3cd7d53a2413 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 13:03:24.488052 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:24.488052 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:24.488052 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:24.488052 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:24.488052 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:24.488052 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:24.488052 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:24.488052 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:24.488052 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:24.488052 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:24.488052 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:24.488052 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 13:03:24.488052 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 13:03:24.488052 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 13:03:24.488052 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 13:03:24.489114 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:24.489114 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:24.489114 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 13:03:24.489114 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:03:24.489114 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 13:03:24.489114 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:03:24.489114 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:24.489114 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:24.489114 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:24.489114 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:24.489114 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:24.489114 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:24.489114 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:24.489114 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:24.489114 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:24.489114 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:24.489114 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:24.489114 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:24.490059 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:24.490059 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:24.490059 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 13:03:24.490059 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 13:03:24.490059 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 13:03:24.490059 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 13:03:24.490059 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 13:03:24.490059 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 13:03:24.490059 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 13:03:24.490059 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:24.493067 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 402/801] 10.222.0.61 () {56 vars in 1093 bytes} [Fri Jun 3 13:03:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:24.493790 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76ccce-443d-4884-a2a9-3cd7d53a2413 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:24.496386 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d5e34-f01b-4397-8cdf-bbef4f13c797 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:24.497851 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d5e34-f01b-4397-8cdf-bbef4f13c797 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:24.514161 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-582d5e34-f01b-4397-8cdf-bbef4f13c797 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 13:03:24.514161 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:24.514161 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:24.514161 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:24.514161 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:24.514161 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:24.514161 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:24.514161 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:24.514161 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:24.514161 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:24.514161 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:24.514161 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:24.514161 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 13:03:24.514161 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 13:03:24.514161 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 13:03:24.514161 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 13:03:24.515788 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:24.515788 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:24.515788 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 13:03:24.515788 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:03:24.515788 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 13:03:24.515788 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:03:24.515788 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:24.515788 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:24.515788 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:24.515788 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:24.515788 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:24.515788 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:24.515788 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:24.515788 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:24.515788 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:24.515788 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:24.515788 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:24.515788 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:24.516780 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:24.516780 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:24.516780 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 13:03:24.516780 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 13:03:24.516780 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 13:03:24.516780 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 13:03:24.516780 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 13:03:24.516780 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 13:03:24.516780 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 13:03:24.516780 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:24.524393 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 400/802] 10.222.0.61 () {56 vars in 1117 bytes} [Fri Jun 3 13:03:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:24.525983 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd82c8-b9aa-4fed-aa51-0013283ba604 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:24.526274 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd82c8-b9aa-4fed-aa51-0013283ba604 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:24.526553 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd82c8-b9aa-4fed-aa51-0013283ba604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:24.544636 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-cbdd82c8-b9aa-4fed-aa51-0013283ba604 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:24.546502 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-cbdd82c8-b9aa-4fed-aa51-0013283ba604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:24.611852 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76ccce-443d-4884-a2a9-3cd7d53a2413 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:24.628221 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 401/803] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:03:24.628221 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd82c8-b9aa-4fed-aa51-0013283ba604 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:24.635608 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:24.648185 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b963aa-314f-459e-b477-68655f29aeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:24.649187 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b963aa-314f-459e-b477-68655f29aeb4 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:24.649611 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b963aa-314f-459e-b477-68655f29aeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:24.649905 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b963aa-314f-459e-b477-68655f29aeb4 None admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:24.650728 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b963aa-314f-459e-b477-68655f29aeb4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:24.651074 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b963aa-314f-459e-b477-68655f29aeb4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:24.652483 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b963aa-314f-459e-b477-68655f29aeb4 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:24.674230 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 403/804] 10.222.0.61 () {56 vars in 1135 bytes} [Fri Jun 3 13:03:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:24.679237 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b963aa-314f-459e-b477-68655f29aeb4 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:24.742089 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd82c8-b9aa-4fed-aa51-0013283ba604 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:24.755445 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:24.777947 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e4102-38da-4bea-8169-b96d7af69705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:24.778621 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e4102-38da-4bea-8169-b96d7af69705 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:24.778906 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e4102-38da-4bea-8169-b96d7af69705 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:24.779176 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e4102-38da-4bea-8169-b96d7af69705 None admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:24.780061 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e4102-38da-4bea-8169-b96d7af69705 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:24.780610 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e4102-38da-4bea-8169-b96d7af69705 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:24.782064 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e4102-38da-4bea-8169-b96d7af69705 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:24.786291 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b963aa-314f-459e-b477-68655f29aeb4 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:24.801789 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 402/805] 10.222.0.61 () {56 vars in 1133 bytes} [Fri Jun 3 13:03:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:24.802893 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e4102-38da-4bea-8169-b96d7af69705 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:24.826316 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb23a9d6-36b3-47fe-9914-073ae4ee704e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:24.827940 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23a9d6-36b3-47fe-9914-073ae4ee704e None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:24.828248 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23a9d6-36b3-47fe-9914-073ae4ee704e None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:24.828524 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23a9d6-36b3-47fe-9914-073ae4ee704e None admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:24.829356 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb23a9d6-36b3-47fe-9914-073ae4ee704e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:24.829660 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb23a9d6-36b3-47fe-9914-073ae4ee704e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:24.831082 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb23a9d6-36b3-47fe-9914-073ae4ee704e None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:24.853569 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 404/806] 10.222.0.61 () {56 vars in 1149 bytes} [Fri Jun 3 13:03:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:24.853569 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb23a9d6-36b3-47fe-9914-073ae4ee704e None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:24.894517 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:24.919010 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e4102-38da-4bea-8169-b96d7af69705 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:24.952533 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925d00d-68df-480c-b135-a9354c483dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:24.952904 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb23a9d6-36b3-47fe-9914-073ae4ee704e None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:24.953259 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925d00d-68df-480c-b135-a9354c483dac None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:24.953536 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925d00d-68df-480c-b135-a9354c483dac None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:24.953805 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925d00d-68df-480c-b135-a9354c483dac None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:24.954452 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d925d00d-68df-480c-b135-a9354c483dac None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:24.955811 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d925d00d-68df-480c-b135-a9354c483dac None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:24.968424 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-d925d00d-68df-480c-b135-a9354c483dac None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 13:03:24.968424 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:24.968424 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 13:03:24.968424 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 13:03:24.968424 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 13:03:24.968424 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 13:03:24.968424 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 13:03:24.968424 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:03:24.968424 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 13:03:24.968424 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:24.968424 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 13:03:24.968424 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:24.968424 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:24.968424 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:24.968424 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:24.968424 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:24.969492 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:24.969492 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:24.969492 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:24.969492 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:24.969492 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:24.969492 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:24.969492 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:24.969492 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 13:03:24.969492 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 13:03:24.969492 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 13:03:24.969492 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 13:03:24.969492 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:24.969492 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:24.969492 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:24.969492 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:24.969492 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:24.970342 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:24.970342 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:24.970342 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:24.970342 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:24.970342 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:24.970342 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:24.970342 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:24.970342 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:24.970342 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:24.970342 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:24.970342 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:24.970342 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 13:03:24.970342 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:03:24.970342 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 13:03:24.970342 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:24.970342 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 403/807] 10.222.0.61 () {56 vars in 1129 bytes} [Fri Jun 3 13:03:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:24.971190 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925d00d-68df-480c-b135-a9354c483dac None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:24.991594 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8e245-180d-4cef-9dbc-5c5223f8aed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:24.992425 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8e245-180d-4cef-9dbc-5c5223f8aed8 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:24.992709 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8e245-180d-4cef-9dbc-5c5223f8aed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:24.992981 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8e245-180d-4cef-9dbc-5c5223f8aed8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:25.003918 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b8e245-180d-4cef-9dbc-5c5223f8aed8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:25.005390 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b8e245-180d-4cef-9dbc-5c5223f8aed8 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:25.010185 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:25.023116 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-04b8e245-180d-4cef-9dbc-5c5223f8aed8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:25.023116 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:25.023116 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:25.023116 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:25.023116 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:25.023116 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:25.023116 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:25.023116 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:25.023116 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:25.023116 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:25.023116 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:25.023116 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:25.023116 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:03:25.023116 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:03:25.023116 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:03:25.024230 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:03:25.024230 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:25.024230 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:25.024230 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:25.024230 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:25.024230 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:25.024230 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:25.024230 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:25.024230 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:25.024230 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:25.024230 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:25.024230 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:25.024230 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:25.024230 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:25.024230 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:25.024230 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:25.024230 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:25.025434 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:03:25.025434 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:03:25.025434 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:25.025434 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:25.025434 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 405/808] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:25.025434 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8e245-180d-4cef-9dbc-5c5223f8aed8 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:25.078882 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925d00d-68df-480c-b135-a9354c483dac None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:25.111204 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604e5d5-b422-4361-8cc5-da2f41fdc8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:25.111847 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604e5d5-b422-4361-8cc5-da2f41fdc8e7 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:25.112126 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604e5d5-b422-4361-8cc5-da2f41fdc8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:25.112438 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604e5d5-b422-4361-8cc5-da2f41fdc8e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:25.118653 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:25.127457 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8e245-180d-4cef-9dbc-5c5223f8aed8 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:25.162023 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b61e6-c916-4ee8-978b-117dab5c8f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:25.162803 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b61e6-c916-4ee8-978b-117dab5c8f82 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:25.163084 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b61e6-c916-4ee8-978b-117dab5c8f82 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:25.163365 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b61e6-c916-4ee8-978b-117dab5c8f82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:25.173266 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b61e6-c916-4ee8-978b-117dab5c8f82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:25.174706 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b61e6-c916-4ee8-978b-117dab5c8f82 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:25.179202 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604e5d5-b422-4361-8cc5-da2f41fdc8e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:25.180704 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604e5d5-b422-4361-8cc5-da2f41fdc8e7 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:25.192744 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-510b61e6-c916-4ee8-978b-117dab5c8f82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:25.192744 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:25.192744 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:25.192744 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:25.192744 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:25.192744 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:25.192744 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:25.192744 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:25.192744 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:25.192744 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:25.192744 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:25.192744 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:25.192744 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:03:25.192744 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:03:25.192744 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:03:25.193636 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:03:25.193636 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:25.193636 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:25.193636 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:25.193636 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:25.193636 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:25.193636 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:25.193636 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:25.193636 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:25.193636 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:25.193636 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:25.193636 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:25.193636 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:25.193636 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:25.193636 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:25.193636 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:25.193636 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:25.194545 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:03:25.194545 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:03:25.194545 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:25.194545 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:25.196286 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 406/809] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:25.197693 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292cb5f9-5af2-484e-b1da-327660cb854d None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:25.197990 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292cb5f9-5af2-484e-b1da-327660cb854d None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:25.198246 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292cb5f9-5af2-484e-b1da-327660cb854d None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:25.199522 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 407/810] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:03:25.200325 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292cb5f9-5af2-484e-b1da-327660cb854d None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:25.214266 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:25.281786 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 404/811] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:03:24 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 13:03:25.282639 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604e5d5-b422-4361-8cc5-da2f41fdc8e7 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:25.300744 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292cb5f9-5af2-484e-b1da-327660cb854d None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:25.335032 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ac1bd-fb8a-4627-9be3-c47a11dbed38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:25.335690 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ac1bd-fb8a-4627-9be3-c47a11dbed38 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:25.335974 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ac1bd-fb8a-4627-9be3-c47a11dbed38 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:25.336281 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ac1bd-fb8a-4627-9be3-c47a11dbed38 None admin] PATH_INFO: `/v3/services` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:25.336979 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0ac1bd-fb8a-4627-9be3-c47a11dbed38 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:25.337283 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0ac1bd-fb8a-4627-9be3-c47a11dbed38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:25.338645 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0ac1bd-fb8a-4627-9be3-c47a11dbed38 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:25.343074 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 408/812] 10.222.0.61 () {56 vars in 1124 bytes} [Fri Jun 3 13:03:25 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:25.343837 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ac1bd-fb8a-4627-9be3-c47a11dbed38 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:25.354773 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:25.381160 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604e5d5-b422-4361-8cc5-da2f41fdc8e7 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:25.413697 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3bd79-2b50-4e2d-ade5-2c52ba0abc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:25.414360 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3bd79-2b50-4e2d-ade5-2c52ba0abc76 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:25.414643 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3bd79-2b50-4e2d-ade5-2c52ba0abc76 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:25.414913 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3bd79-2b50-4e2d-ade5-2c52ba0abc76 None admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:25.415625 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a3bd79-2b50-4e2d-ade5-2c52ba0abc76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:25.415927 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a3bd79-2b50-4e2d-ade5-2c52ba0abc76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:25.417350 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a3bd79-2b50-4e2d-ade5-2c52ba0abc76 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:25.418752 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:25.430226 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 405/813] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:03:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:25.444125 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe416f-d87e-4d59-a395-b3c354e9e747 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:25.444125 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe416f-d87e-4d59-a395-b3c354e9e747 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:25.444125 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe416f-d87e-4d59-a395-b3c354e9e747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:25.444475 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ac1bd-fb8a-4627-9be3-c47a11dbed38 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:25.448300 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-1afe416f-d87e-4d59-a395-b3c354e9e747 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:25.449487 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-1afe416f-d87e-4d59-a395-b3c354e9e747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:25.476838 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe391c54-a3cf-4a29-a814-f960ffed4359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:25.477419 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe391c54-a3cf-4a29-a814-f960ffed4359 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:25.477698 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe391c54-a3cf-4a29-a814-f960ffed4359 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:25.477969 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe391c54-a3cf-4a29-a814-f960ffed4359 None admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:25.478675 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe391c54-a3cf-4a29-a814-f960ffed4359 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:25.478976 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe391c54-a3cf-4a29-a814-f960ffed4359 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:25.480354 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe391c54-a3cf-4a29-a814-f960ffed4359 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:25.491923 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 409/814] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:03:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:25.492592 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe391c54-a3cf-4a29-a814-f960ffed4359 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:25.520956 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 406/815] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:03:25.528385 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe416f-d87e-4d59-a395-b3c354e9e747 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:25.566977 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:25.601234 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe391c54-a3cf-4a29-a814-f960ffed4359 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:25.626935 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe416f-d87e-4d59-a395-b3c354e9e747 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:25.635478 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e25557-4434-42dd-8cbf-00cdf377e0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:25.636307 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e25557-4434-42dd-8cbf-00cdf377e0d2 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:25.636590 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e25557-4434-42dd-8cbf-00cdf377e0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:25.636866 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e25557-4434-42dd-8cbf-00cdf377e0d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:25.647469 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e25557-4434-42dd-8cbf-00cdf377e0d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:25.648937 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e25557-4434-42dd-8cbf-00cdf377e0d2 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:25.649866 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:25.660306 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c53a55-574f-45db-a142-e34a348ed1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:25.661001 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c53a55-574f-45db-a142-e34a348ed1b6 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:25.661292 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c53a55-574f-45db-a142-e34a348ed1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:25.661574 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c53a55-574f-45db-a142-e34a348ed1b6 None admin] PATH_INFO: `/v3/services` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:25.662700 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c53a55-574f-45db-a142-e34a348ed1b6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:25.662700 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c53a55-574f-45db-a142-e34a348ed1b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:25.664098 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c53a55-574f-45db-a142-e34a348ed1b6 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:25.665712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-c2e25557-4434-42dd-8cbf-00cdf377e0d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:25.665712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:25.665712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:25.665712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:25.665712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:25.665712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:25.665712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:25.665712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:25.665712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:25.665712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:25.665712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:25.665712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:25.665712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:03:25.665712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:03:25.665712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:03:25.666634 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:03:25.666634 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:25.666634 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:25.666634 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:25.666634 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:25.666634 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:25.666634 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:25.666634 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:25.666634 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:25.666634 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:25.666634 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:25.666634 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:25.666634 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:25.666634 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:25.666634 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:25.666634 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:25.666634 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:25.667769 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:03:25.667769 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:03:25.667769 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:25.667769 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:25.667769 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 410/816] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:25.668231 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e25557-4434-42dd-8cbf-00cdf377e0d2 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:25.674841 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 407/817] 10.222.0.61 () {56 vars in 1124 bytes} [Fri Jun 3 13:03:25 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:25.675835 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c53a55-574f-45db-a142-e34a348ed1b6 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:25.769453 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e25557-4434-42dd-8cbf-00cdf377e0d2 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:25.776525 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c53a55-574f-45db-a142-e34a348ed1b6 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:25.789741 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:25.803426 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3c2ac-0fed-4cdd-91cb-bde06080781f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:25.804444 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3c2ac-0fed-4cdd-91cb-bde06080781f None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:25.805699 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3c2ac-0fed-4cdd-91cb-bde06080781f None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:25.805699 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3c2ac-0fed-4cdd-91cb-bde06080781f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:25.811593 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4c901-e454-4360-b222-88cd4a28e704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:25.812130 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d3c2ac-0fed-4cdd-91cb-bde06080781f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:25.812379 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4c901-e454-4360-b222-88cd4a28e704 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:25.812831 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4c901-e454-4360-b222-88cd4a28e704 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:25.813043 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4c901-e454-4360-b222-88cd4a28e704 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:25.813628 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d3c2ac-0fed-4cdd-91cb-bde06080781f None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:25.819953 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4c901-e454-4360-b222-88cd4a28e704 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:25.821422 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4c901-e454-4360-b222-88cd4a28e704 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:25.828676 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-16d3c2ac-0fed-4cdd-91cb-bde06080781f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:03:25.828676 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:25.828676 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:25.828676 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:25.828676 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:25.828676 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:25.828676 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:25.828676 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:25.828676 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:25.828676 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:25.828676 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:25.828676 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:25.828676 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 13:03:25.828676 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 13:03:25.828676 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 13:03:25.829745 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 13:03:25.829745 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:25.829745 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:25.829745 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:25.829745 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:25.829745 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:25.829745 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:25.829745 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:25.829745 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:25.829745 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:25.829745 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:25.829745 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:25.829745 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:25.829745 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:25.829745 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:25.829745 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:25.829745 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:25.830720 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 13:03:25.830720 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 13:03:25.830720 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 13:03:25.830720 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 13:03:25.830720 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 13:03:25.830720 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 13:03:25.830720 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:03:25.830720 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:25.830720 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 411/818] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:03:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:25.831456 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3c2ac-0fed-4cdd-91cb-bde06080781f None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:25.836359 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-4cd4c901-e454-4360-b222-88cd4a28e704 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:03:25.836359 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:25.836359 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:25.836359 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:25.836359 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:25.836359 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:25.836359 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:25.836359 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:25.836359 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:25.836359 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:25.836359 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:25.836359 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:25.836359 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 13:03:25.836359 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 13:03:25.836359 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 13:03:25.837450 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 13:03:25.837450 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:25.837450 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:25.837450 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:25.837450 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:25.837450 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:25.837450 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:25.837450 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:25.837450 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:25.837450 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:25.837450 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:25.837450 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:25.837450 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:25.837450 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:25.837450 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:25.837450 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:25.837450 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:25.838381 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 13:03:25.838381 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 13:03:25.838381 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 13:03:25.838381 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 13:03:25.838381 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 13:03:25.838381 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 13:03:25.838381 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:03:25.838381 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:25.838381 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 408/819] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:03:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:25.838863 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4c901-e454-4360-b222-88cd4a28e704 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:25.891944 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:25.933426 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3c2ac-0fed-4cdd-91cb-bde06080781f None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:25.943081 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4c901-e454-4360-b222-88cd4a28e704 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:25.967696 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445bb4ff-ef8a-4b1c-baca-c41781a1e539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:25.968587 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bb4ff-ef8a-4b1c-baca-c41781a1e539 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:25.968923 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bb4ff-ef8a-4b1c-baca-c41781a1e539 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:25.969199 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bb4ff-ef8a-4b1c-baca-c41781a1e539 None admin] PATH_INFO: `/v3/services/network` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:25.969843 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445bb4ff-ef8a-4b1c-baca-c41781a1e539 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:25.971205 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445bb4ff-ef8a-4b1c-baca-c41781a1e539 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:25.977653 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87cfdfe-40cb-44e5-8471-f372ea1d057b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:25.978329 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cfdfe-40cb-44e5-8471-f372ea1d057b None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:25.978609 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cfdfe-40cb-44e5-8471-f372ea1d057b None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:25.978878 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cfdfe-40cb-44e5-8471-f372ea1d057b None admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:25.979588 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87cfdfe-40cb-44e5-8471-f372ea1d057b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:25.979889 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87cfdfe-40cb-44e5-8471-f372ea1d057b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:25.981286 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87cfdfe-40cb-44e5-8471-f372ea1d057b None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:25.985052 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-445bb4ff-ef8a-4b1c-baca-c41781a1e539 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 13:03:25.985052 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:25.985052 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 13:03:25.985052 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 13:03:25.985052 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 13:03:25.985052 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 13:03:25.985052 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 13:03:25.985052 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:03:25.985052 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 13:03:25.985052 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:25.985052 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 13:03:25.985052 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:25.985052 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:25.985052 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:25.985052 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:25.985052 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:25.985052 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:25.986214 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:25.986214 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:25.986214 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:25.986214 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:25.986214 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:25.986214 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:25.986214 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 13:03:25.986214 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 13:03:25.986214 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 13:03:25.986214 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 13:03:25.986214 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:25.986214 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:25.986214 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:25.986214 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:25.986214 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:25.986214 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:25.987404 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:25.987404 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:25.987404 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:25.987404 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:25.987404 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:25.987404 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:25.987404 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:25.987404 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:25.987404 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:25.987404 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:25.987404 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 13:03:25.987404 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:03:25.987404 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 13:03:25.987404 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:25.987404 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 412/820] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:03:25 2022] GET /identity/v3/services/network => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:25.988501 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445bb4ff-ef8a-4b1c-baca-c41781a1e539 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:26.004246 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 409/821] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:03:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:26.004246 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87cfdfe-40cb-44e5-8471-f372ea1d057b None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:26.038785 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:26.094165 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445bb4ff-ef8a-4b1c-baca-c41781a1e539 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:26.107249 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87cfdfe-40cb-44e5-8471-f372ea1d057b None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:26.117188 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:26.128942 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f87d9-71f9-4c53-b848-1501146c71d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:26.129594 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f87d9-71f9-4c53-b848-1501146c71d9 None admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:26.129875 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f87d9-71f9-4c53-b848-1501146c71d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:26.130149 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f87d9-71f9-4c53-b848-1501146c71d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:26.130878 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f87d9-71f9-4c53-b848-1501146c71d9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:26.132270 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f87d9-71f9-4c53-b848-1501146c71d9 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:26.142008 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8461dc81-91ff-44e2-9847-799ee32c8870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:26.142671 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461dc81-91ff-44e2-9847-799ee32c8870 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:26.142949 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461dc81-91ff-44e2-9847-799ee32c8870 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:26.143218 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461dc81-91ff-44e2-9847-799ee32c8870 None admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:26.143988 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8461dc81-91ff-44e2-9847-799ee32c8870 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:26.144331 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8461dc81-91ff-44e2-9847-799ee32c8870 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:26.145930 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8461dc81-91ff-44e2-9847-799ee32c8870 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:26.158204 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 410/822] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 13:03:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:26.159005 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8461dc81-91ff-44e2-9847-799ee32c8870 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:26.238809 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 413/823] 10.222.0.61 () {60 vars in 1144 bytes} [Fri Jun 3 13:03:25 2022] POST /identity/v3/endpoints => generated 346 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:26.239579 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f87d9-71f9-4c53-b848-1501146c71d9 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:26.270763 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8461dc81-91ff-44e2-9847-799ee32c8870 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:26.322190 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bda0b8-e652-4fdd-b991-e552f2174a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:26.322781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bda0b8-e652-4fdd-b991-e552f2174a8d None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:26.323062 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bda0b8-e652-4fdd-b991-e552f2174a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:26.323333 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bda0b8-e652-4fdd-b991-e552f2174a8d None admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:26.324132 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bda0b8-e652-4fdd-b991-e552f2174a8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:26.324462 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bda0b8-e652-4fdd-b991-e552f2174a8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:26.325940 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bda0b8-e652-4fdd-b991-e552f2174a8d None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:26.345924 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 411/824] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 13:03:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:26.345924 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bda0b8-e652-4fdd-b991-e552f2174a8d None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:26.356013 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:26.360225 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f87d9-71f9-4c53-b848-1501146c71d9 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:26.373172 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:26.395997 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801499a0-eae5-46a5-8f6f-79e5823335e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:26.396794 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801499a0-eae5-46a5-8f6f-79e5823335e3 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:26.397186 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801499a0-eae5-46a5-8f6f-79e5823335e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:26.397693 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801499a0-eae5-46a5-8f6f-79e5823335e3 None admin] PATH_INFO: `/v3/services` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:26.398582 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801499a0-eae5-46a5-8f6f-79e5823335e3 None admin] RBAC: Adding query filter params (name=network) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:26.399314 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801499a0-eae5-46a5-8f6f-79e5823335e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:26.400898 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801499a0-eae5-46a5-8f6f-79e5823335e3 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:26.410742 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 414/825] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Jun 3 13:03:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:26.410742 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801499a0-eae5-46a5-8f6f-79e5823335e3 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:26.472356 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bda0b8-e652-4fdd-b991-e552f2174a8d None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:26.520271 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801499a0-eae5-46a5-8f6f-79e5823335e3 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:26.524710 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610c4cd-0473-4a65-b89c-46abc77e46e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:26.525509 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610c4cd-0473-4a65-b89c-46abc77e46e5 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:26.525794 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610c4cd-0473-4a65-b89c-46abc77e46e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:26.526072 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610c4cd-0473-4a65-b89c-46abc77e46e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:26.533658 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610c4cd-0473-4a65-b89c-46abc77e46e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:26.535112 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610c4cd-0473-4a65-b89c-46abc77e46e5 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:26.549637 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-e610c4cd-0473-4a65-b89c-46abc77e46e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:03:26.549637 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:26.549637 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:26.549637 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:26.549637 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:26.549637 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:26.549637 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:26.549637 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:26.549637 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:26.549637 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:26.549637 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:26.549637 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:26.549637 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 13:03:26.549637 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 13:03:26.549637 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 13:03:26.550749 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 13:03:26.550749 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:26.550749 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:26.550749 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:26.550749 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:26.550749 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:26.550749 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:26.550749 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:26.550749 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:26.550749 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:26.550749 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:26.550749 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:26.550749 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:26.550749 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:26.550749 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:26.550749 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:26.550749 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:26.551656 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 13:03:26.551656 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 13:03:26.551656 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 13:03:26.551656 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 13:03:26.551656 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 13:03:26.551656 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 13:03:26.551656 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:03:26.551656 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:26.551656 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 412/826] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:03:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:26.551656 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610c4cd-0473-4a65-b89c-46abc77e46e5 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:26.561180 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621a157-4d0f-458c-bdda-18b40817b11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:26.562115 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621a157-4d0f-458c-bdda-18b40817b11b None admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:26.562398 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621a157-4d0f-458c-bdda-18b40817b11b None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:26.562684 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621a157-4d0f-458c-bdda-18b40817b11b None admin] PATH_INFO: `/v3/projects/c8c0bf799c9f451b8167a646a5c82eda/users/b07ad3dd7477497ea25c2a01bff35712/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:26.565462 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3621a157-4d0f-458c-bdda-18b40817b11b None admin] RBAC: Authorizing `identity:create_grant(project_id=c8c0bf799c9f451b8167a646a5c82eda, user_id=b07ad3dd7477497ea25c2a01bff35712, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:26.567207 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3621a157-4d0f-458c-bdda-18b40817b11b None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:26.644800 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 415/827] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jun 3 13:03:26 2022] PUT /identity/v3/projects/c8c0bf799c9f451b8167a646a5c82eda/users/b07ad3dd7477497ea25c2a01bff35712/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:26.645793 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621a157-4d0f-458c-bdda-18b40817b11b None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:26.651171 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:26.668807 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610c4cd-0473-4a65-b89c-46abc77e46e5 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:26.693217 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:26.729729 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9295b-bee7-4f18-8af9-219346980562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:26.731679 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9295b-bee7-4f18-8af9-219346980562 None admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:26.732137 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9295b-bee7-4f18-8af9-219346980562 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:26.732607 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9295b-bee7-4f18-8af9-219346980562 None admin] PATH_INFO: `/v3/projects/c8c0bf799c9f451b8167a646a5c82eda/users/06c55d0ea52f40ae9125d2efe1d159a3/roles/eb985092d5f14e92a783e26568bf457b` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:26.758952 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e9295b-bee7-4f18-8af9-219346980562 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8c0bf799c9f451b8167a646a5c82eda, user_id=06c55d0ea52f40ae9125d2efe1d159a3, role_id=eb985092d5f14e92a783e26568bf457b)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:26.761018 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e9295b-bee7-4f18-8af9-219346980562 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:26.783851 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621a157-4d0f-458c-bdda-18b40817b11b None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:26.824525 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28facb13-d302-4c7d-aefc-dd546eb76289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:26.825202 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28facb13-d302-4c7d-aefc-dd546eb76289 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:26.825542 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28facb13-d302-4c7d-aefc-dd546eb76289 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:26.825822 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28facb13-d302-4c7d-aefc-dd546eb76289 None admin] PATH_INFO: `/v3/services` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:26.826574 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28facb13-d302-4c7d-aefc-dd546eb76289 None admin] RBAC: Adding query filter params (type=network) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:26.826910 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28facb13-d302-4c7d-aefc-dd546eb76289 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:26.828494 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28facb13-d302-4c7d-aefc-dd546eb76289 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:26.839159 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 413/828] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jun 3 13:03:26 2022] PUT /identity/v3/projects/c8c0bf799c9f451b8167a646a5c82eda/users/06c55d0ea52f40ae9125d2efe1d159a3/roles/eb985092d5f14e92a783e26568bf457b => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:26.840615 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9295b-bee7-4f18-8af9-219346980562 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:26.850471 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 416/829] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Jun 3 13:03:26 2022] GET /identity/v3/services?type=network => generated 350 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:26.852613 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28facb13-d302-4c7d-aefc-dd546eb76289 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:26.977858 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:26.991271 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9295b-bee7-4f18-8af9-219346980562 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:26.992686 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28facb13-d302-4c7d-aefc-dd546eb76289 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:27.030693 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f815021-5602-4ef8-8c05-4102c2629f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:27.031406 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f815021-5602-4ef8-8c05-4102c2629f3d None admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:27.031689 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f815021-5602-4ef8-8c05-4102c2629f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:27.031962 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f815021-5602-4ef8-8c05-4102c2629f3d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:27.032366 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ea66c-7b8b-46c8-b58a-68123c811eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:27.032744 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f815021-5602-4ef8-8c05-4102c2629f3d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:27.033153 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ea66c-7b8b-46c8-b58a-68123c811eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:27.033504 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ea66c-7b8b-46c8-b58a-68123c811eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:27.033844 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ea66c-7b8b-46c8-b58a-68123c811eb2 None admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:27.034172 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f815021-5602-4ef8-8c05-4102c2629f3d None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:27.034752 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ea66c-7b8b-46c8-b58a-68123c811eb2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:27.035127 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ea66c-7b8b-46c8-b58a-68123c811eb2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:27.036670 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ea66c-7b8b-46c8-b58a-68123c811eb2 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:27.038716 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:27.052027 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 414/830] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 13:03:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:27.060967 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ea66c-7b8b-46c8-b58a-68123c811eb2 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:27.108615 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 417/831] 10.222.0.61 () {60 vars in 1144 bytes} [Fri Jun 3 13:03:26 2022] POST /identity/v3/endpoints => generated 327 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:27.191639 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ea66c-7b8b-46c8-b58a-68123c811eb2 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:27.241123 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0cb737-2276-4369-8480-d1405bd08f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:27.241710 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0cb737-2276-4369-8480-d1405bd08f58 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:27.241995 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0cb737-2276-4369-8480-d1405bd08f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:27.242269 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0cb737-2276-4369-8480-d1405bd08f58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:27.243112 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0cb737-2276-4369-8480-d1405bd08f58 None admin] RBAC: Adding query filter params (role.id=bbd5f3e0c18e4992886fcfb4a3feb426, scope.project.id=c8c0bf799c9f451b8167a646a5c82eda, user.id=066aaba3e9af4f85ab0cba89a3d32e34) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:27.243425 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0cb737-2276-4369-8480-d1405bd08f58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:27.244908 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0cb737-2276-4369-8480-d1405bd08f58 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:27.252880 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 415/832] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 13:03:27 2022] GET /identity/v3/role_assignments?user.id=066aaba3e9af4f85ab0cba89a3d32e34&scope.project.id=c8c0bf799c9f451b8167a646a5c82eda&role.id=bbd5f3e0c18e4992886fcfb4a3feb426 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:28.657776 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630dc19-d484-46e9-9eb0-af8a76a6047f None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:28.658376 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630dc19-d484-46e9-9eb0-af8a76a6047f None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:28.658376 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630dc19-d484-46e9-9eb0-af8a76a6047f None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:28.660121 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 418/833] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:03:28.665399 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94616343-ad80-41ec-8f68-8251149757a2 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:28.665843 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94616343-ad80-41ec-8f68-8251149757a2 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:28.665937 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94616343-ad80-41ec-8f68-8251149757a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:28.683646 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-94616343-ad80-41ec-8f68-8251149757a2 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:28.684855 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-94616343-ad80-41ec-8f68-8251149757a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:28.738436 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:28.756101 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 416/834] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:28 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:03:28.778416 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630dc19-d484-46e9-9eb0-af8a76a6047f None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:28.888807 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630dc19-d484-46e9-9eb0-af8a76a6047f None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:28.926171 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd250be8-441f-4250-91fb-48703a67d666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:28.926896 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd250be8-441f-4250-91fb-48703a67d666 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:28.927181 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd250be8-441f-4250-91fb-48703a67d666 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:28.927460 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd250be8-441f-4250-91fb-48703a67d666 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:28.928118 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd250be8-441f-4250-91fb-48703a67d666 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:28.929570 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd250be8-441f-4250-91fb-48703a67d666 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:28.943130 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-fd250be8-441f-4250-91fb-48703a67d666 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 13:03:28.943130 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:28.943130 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 13:03:28.943130 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 13:03:28.943130 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 13:03:28.943130 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 13:03:28.943130 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 13:03:28.943130 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:03:28.943130 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 13:03:28.943130 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:28.943130 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 13:03:28.943130 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:28.943130 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:28.943130 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:28.943130 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:28.943130 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:28.943130 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:28.944308 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:28.944308 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:28.944308 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:28.944308 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:28.944308 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:28.944308 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:28.944308 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 13:03:28.944308 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 13:03:28.944308 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 13:03:28.944308 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 13:03:28.944308 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:28.944308 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:28.944308 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:28.944308 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:28.944308 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:28.944308 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:28.945285 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:28.945285 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:28.945285 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:28.945285 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:28.945285 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:28.945285 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:28.945285 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:28.945285 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:28.945285 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:28.945285 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:28.945285 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 13:03:28.945285 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:03:28.945285 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 13:03:28.945285 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:28.945285 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 419/835] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jun 3 13:03:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:28.950554 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94616343-ad80-41ec-8f68-8251149757a2 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:29.071020 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94616343-ad80-41ec-8f68-8251149757a2 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:29.106567 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff3387-d6ca-4f6e-8eec-ba9365422be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:29.107240 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff3387-d6ca-4f6e-8eec-ba9365422be8 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:29.107524 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff3387-d6ca-4f6e-8eec-ba9365422be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:29.108376 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff3387-d6ca-4f6e-8eec-ba9365422be8 None admin] PATH_INFO: `/v3/services` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:29.109430 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dff3387-d6ca-4f6e-8eec-ba9365422be8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:29.109752 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dff3387-d6ca-4f6e-8eec-ba9365422be8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:29.111131 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dff3387-d6ca-4f6e-8eec-ba9365422be8 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:29.116359 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 417/836] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jun 3 13:03:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:29.121565 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd250be8-441f-4250-91fb-48703a67d666 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:29.167901 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:29.232373 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd250be8-441f-4250-91fb-48703a67d666 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:29.270285 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe05ea76-2204-43c8-a0b4-7dbc3b94cc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:29.270956 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05ea76-2204-43c8-a0b4-7dbc3b94cc32 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:29.271243 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05ea76-2204-43c8-a0b4-7dbc3b94cc32 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:29.271523 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05ea76-2204-43c8-a0b4-7dbc3b94cc32 None admin] PATH_INFO: `/v3/services` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:29.272267 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe05ea76-2204-43c8-a0b4-7dbc3b94cc32 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:29.272573 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe05ea76-2204-43c8-a0b4-7dbc3b94cc32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:29.273951 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe05ea76-2204-43c8-a0b4-7dbc3b94cc32 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:29.279045 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 420/837] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jun 3 13:03:29 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:29.319528 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832381e1-8c35-455d-a92e-0f00095c75ef None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:29.319879 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832381e1-8c35-455d-a92e-0f00095c75ef None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:29.320086 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832381e1-8c35-455d-a92e-0f00095c75ef None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:29.321973 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 418/838] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:03:29.328510 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8be13-ceb3-4ced-97ac-0fbc59d44794 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:29.328834 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8be13-ceb3-4ced-97ac-0fbc59d44794 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:29.329082 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8be13-ceb3-4ced-97ac-0fbc59d44794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:29.348545 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-4da8be13-ceb3-4ced-97ac-0fbc59d44794 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:29.349796 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-4da8be13-ceb3-4ced-97ac-0fbc59d44794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:29.361971 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebc229-057d-4141-96e3-cf4f6b90cf2b None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:29.362332 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebc229-057d-4141-96e3-cf4f6b90cf2b None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:29.362530 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebc229-057d-4141-96e3-cf4f6b90cf2b None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:29.365499 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 419/839] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:03:29.370155 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7716015-d7b6-4862-bfe7-63030a35d2d8 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:29.370489 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7716015-d7b6-4862-bfe7-63030a35d2d8 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:29.370717 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7716015-d7b6-4862-bfe7-63030a35d2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:29.390679 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-a7716015-d7b6-4862-bfe7-63030a35d2d8 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:29.392408 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-a7716015-d7b6-4862-bfe7-63030a35d2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:29.435313 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 421/840] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:03:29.460533 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:29.461051 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da8be13-ceb3-4ced-97ac-0fbc59d44794 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:29.463384 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:29.476922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 420/841] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 13:03:29.501940 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7716015-d7b6-4862-bfe7-63030a35d2d8 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:29.573028 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da8be13-ceb3-4ced-97ac-0fbc59d44794 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:29.611349 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ff231-4248-4b57-ada2-30db01a0a60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:29.612166 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ff231-4248-4b57-ada2-30db01a0a60d None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:29.612518 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ff231-4248-4b57-ada2-30db01a0a60d None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:29.612748 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ff231-4248-4b57-ada2-30db01a0a60d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:29.624946 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8ff231-4248-4b57-ada2-30db01a0a60d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:03:29.628604 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7716015-d7b6-4862-bfe7-63030a35d2d8 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:29.632986 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-cc8ff231-4248-4b57-ada2-30db01a0a60d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:03:29.632986 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:29.632986 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:29.632986 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:29.632986 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:29.632986 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:29.632986 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:29.632986 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:29.632986 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:29.632986 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:29.632986 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:29.632986 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:29.632986 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:03:29.632986 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:03:29.632986 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:03:29.632986 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:03:29.633927 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:03:29.633927 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:03:29.633927 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:03:29.633927 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:03:29.633927 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:29.633927 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:29.633927 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:29.633927 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:29.633927 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:29.633927 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:29.633927 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:29.633927 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:29.633927 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:29.633927 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:29.633927 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:29.633927 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:29.634772 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:29.634772 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:29.634772 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:29.634772 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:29.634772 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:03:29.634772 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:03:29.634772 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:03:29.634772 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:03:29.634772 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:03:29.634772 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:03:29.634772 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:03:29.634772 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:29.634772 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 422/842] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 13:03:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:03:29.641384 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ff231-4248-4b57-ada2-30db01a0a60d None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:29.677755 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8eabed-8c4a-49e3-ad52-d8bc2f16d65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:29.679538 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8eabed-8c4a-49e3-ad52-d8bc2f16d65c None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:29.680046 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8eabed-8c4a-49e3-ad52-d8bc2f16d65c None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:29.681499 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8eabed-8c4a-49e3-ad52-d8bc2f16d65c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:29.696245 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8eabed-8c4a-49e3-ad52-d8bc2f16d65c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:03:29.707844 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-fe8eabed-8c4a-49e3-ad52-d8bc2f16d65c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 13:03:29.707844 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:29.707844 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:29.707844 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:29.707844 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:29.707844 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:29.707844 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:29.707844 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:29.707844 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:29.707844 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:29.707844 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:29.707844 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:29.707844 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:03:29.707844 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:03:29.707844 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:03:29.707844 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:03:29.708916 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:03:29.708916 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:03:29.708916 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:03:29.708916 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:03:29.708916 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:29.708916 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:29.708916 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:29.708916 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:29.708916 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:29.708916 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:29.708916 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:29.708916 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:29.708916 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:29.708916 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:29.708916 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:29.708916 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:29.709752 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:29.709752 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:29.709752 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:29.709752 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:29.709752 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:03:29.709752 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:03:29.709752 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:03:29.709752 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:03:29.709752 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:03:29.709752 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:03:29.709752 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 13:03:29.709752 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:29.712764 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 421/843] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jun 3 13:03:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:03:29.713424 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:29.725177 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8eabed-8c4a-49e3-ad52-d8bc2f16d65c None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:29.757375 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ff231-4248-4b57-ada2-30db01a0a60d None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:29.769688 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:29.798566 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e7f58-2ba1-4bf1-8951-f31792964bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:29.799382 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e7f58-2ba1-4bf1-8951-f31792964bb2 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:29.799728 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e7f58-2ba1-4bf1-8951-f31792964bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:29.800006 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e7f58-2ba1-4bf1-8951-f31792964bb2 None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:29.800778 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e7f58-2ba1-4bf1-8951-f31792964bb2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:29.801081 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e7f58-2ba1-4bf1-8951-f31792964bb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:29.803217 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e7f58-2ba1-4bf1-8951-f31792964bb2 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:29.816026 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 423/844] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:03:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:29.816026 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed306bad-e9b3-47de-9205-47190c78d2b3 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:29.816026 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed306bad-e9b3-47de-9205-47190c78d2b3 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:29.816026 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed306bad-e9b3-47de-9205-47190c78d2b3 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:29.816026 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 424/845] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:03:29.818822 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed306bad-e9b3-47de-9205-47190c78d2b3 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:29.841643 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8eabed-8c4a-49e3-ad52-d8bc2f16d65c None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:29.882500 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270cba40-da9f-4701-a466-867db53148b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:29.883221 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270cba40-da9f-4701-a466-867db53148b6 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:29.883513 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270cba40-da9f-4701-a466-867db53148b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:29.883785 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270cba40-da9f-4701-a466-867db53148b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:29.884612 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270cba40-da9f-4701-a466-867db53148b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:29.885029 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270cba40-da9f-4701-a466-867db53148b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:29.886633 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270cba40-da9f-4701-a466-867db53148b6 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:29.900907 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 422/846] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jun 3 13:03:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:29.902258 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b56134-a82a-4fee-ae10-3ecfe5e81a9c None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:29.902558 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b56134-a82a-4fee-ae10-3ecfe5e81a9c None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:29.902877 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b56134-a82a-4fee-ae10-3ecfe5e81a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:29.919560 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-16b56134-a82a-4fee-ae10-3ecfe5e81a9c None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:29.920831 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-16b56134-a82a-4fee-ae10-3ecfe5e81a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:29.932696 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed306bad-e9b3-47de-9205-47190c78d2b3 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:29.959307 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:29.971716 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288422dd-93b5-4316-8f2c-1f55a1809229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:29.972541 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288422dd-93b5-4316-8f2c-1f55a1809229 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:29.973077 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288422dd-93b5-4316-8f2c-1f55a1809229 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:29.973354 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288422dd-93b5-4316-8f2c-1f55a1809229 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:29.985368 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288422dd-93b5-4316-8f2c-1f55a1809229 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:29.987005 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288422dd-93b5-4316-8f2c-1f55a1809229 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:30.006119 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 423/847] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:03:30.006466 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-288422dd-93b5-4316-8f2c-1f55a1809229 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:30.006466 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:30.006466 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:30.006466 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:30.006466 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:30.006466 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:30.006466 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:30.006466 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:30.006466 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:30.006466 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:30.006466 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:30.006466 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:30.006466 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:03:30.006466 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:03:30.006466 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:03:30.007424 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:03:30.007424 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:30.007424 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:30.007424 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:30.007424 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:30.007424 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:30.007424 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:30.007424 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:30.007424 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:30.007424 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:30.007424 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:30.007424 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:30.007424 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:30.007424 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:30.007424 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:30.007424 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:30.007424 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:30.008907 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:03:30.008907 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:03:30.008907 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:30.008907 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:30.010865 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b56134-a82a-4fee-ae10-3ecfe5e81a9c None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:30.012516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 425/848] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:03:30.013347 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288422dd-93b5-4316-8f2c-1f55a1809229 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:30.044680 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:30.117574 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b56134-a82a-4fee-ae10-3ecfe5e81a9c None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:30.131166 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288422dd-93b5-4316-8f2c-1f55a1809229 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:30.154864 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cabcca-5e77-482b-982d-5a78162857fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:30.156005 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cabcca-5e77-482b-982d-5a78162857fe None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:30.156326 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cabcca-5e77-482b-982d-5a78162857fe None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:30.156771 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cabcca-5e77-482b-982d-5a78162857fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:30.167344 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cabcca-5e77-482b-982d-5a78162857fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:30.167486 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fac68d-6b79-4a3b-bcc0-26c2f96abcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:30.168006 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fac68d-6b79-4a3b-bcc0-26c2f96abcc0 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:30.168322 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fac68d-6b79-4a3b-bcc0-26c2f96abcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:30.168600 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fac68d-6b79-4a3b-bcc0-26c2f96abcc0 None admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:30.168837 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cabcca-5e77-482b-982d-5a78162857fe None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:30.169310 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fac68d-6b79-4a3b-bcc0-26c2f96abcc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:30.169613 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fac68d-6b79-4a3b-bcc0-26c2f96abcc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:30.171498 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fac68d-6b79-4a3b-bcc0-26c2f96abcc0 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:30.188188 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 426/849] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:03:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:30.188188 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fac68d-6b79-4a3b-bcc0-26c2f96abcc0 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:30.190585 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-41cabcca-5e77-482b-982d-5a78162857fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:30.190585 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:30.190585 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:30.190585 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:30.190585 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:30.190585 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:30.190585 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:30.190585 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:30.190585 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:30.190585 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:30.190585 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:30.190585 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:30.190585 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:03:30.190585 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:03:30.190585 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:03:30.191496 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:03:30.191496 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:30.191496 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:30.191496 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:30.191496 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:30.191496 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:30.191496 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:30.191496 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:30.191496 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:30.191496 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:30.191496 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:30.191496 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:30.191496 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:30.191496 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:30.191496 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:30.191496 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:30.191496 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:30.192419 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:03:30.192419 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:03:30.192419 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:30.192419 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:30.192419 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 424/850] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:30.192717 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cabcca-5e77-482b-982d-5a78162857fe None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:30.231245 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:30.277837 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:30.297169 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cabcca-5e77-482b-982d-5a78162857fe None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:30.299118 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fac68d-6b79-4a3b-bcc0-26c2f96abcc0 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:30.336050 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131bd082-a7c2-434a-89f8-22827cdce65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:30.336888 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bd082-a7c2-434a-89f8-22827cdce65f None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:30.337172 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bd082-a7c2-434a-89f8-22827cdce65f None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:30.337449 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bd082-a7c2-434a-89f8-22827cdce65f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:30.338099 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131bd082-a7c2-434a-89f8-22827cdce65f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:30.339206 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a89eac-5030-437e-af59-3e8b63bc901b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:30.339470 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131bd082-a7c2-434a-89f8-22827cdce65f None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:30.340529 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a89eac-5030-437e-af59-3e8b63bc901b None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:30.341333 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a89eac-5030-437e-af59-3e8b63bc901b None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:30.341754 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a89eac-5030-437e-af59-3e8b63bc901b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:30.349942 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a89eac-5030-437e-af59-3e8b63bc901b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:30.351556 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a89eac-5030-437e-af59-3e8b63bc901b None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:30.352345 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-131bd082-a7c2-434a-89f8-22827cdce65f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 13:03:30.352345 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:30.352345 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 13:03:30.352345 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 13:03:30.352345 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 13:03:30.352345 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 13:03:30.352345 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 13:03:30.352345 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:03:30.352345 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 13:03:30.352345 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:30.352345 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 13:03:30.352345 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:30.352345 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:30.352345 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:30.352345 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:30.352345 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:30.353452 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:30.353452 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:30.353452 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:30.353452 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:30.353452 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:30.353452 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:30.353452 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:30.353452 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 13:03:30.353452 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 13:03:30.353452 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 13:03:30.353452 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 13:03:30.353452 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:30.353452 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:30.353452 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:30.353452 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:30.353452 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:30.354480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:30.354480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:30.354480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:30.354480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:30.354480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:30.354480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:30.354480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:30.354480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:30.354480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:30.354480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:30.354480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:30.354480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 13:03:30.354480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:03:30.354480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 13:03:30.354480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:30.358634 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 427/851] 10.222.0.61 () {56 vars in 1132 bytes} [Fri Jun 3 13:03:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:30.359512 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131bd082-a7c2-434a-89f8-22827cdce65f None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:30.372292 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-76a89eac-5030-437e-af59-3e8b63bc901b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 03 13:03:30.372292 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:30.372292 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:30.372292 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:30.372292 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:30.372292 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:30.372292 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:30.372292 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:30.372292 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:30.372292 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:30.372292 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:30.372292 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:30.372292 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 13:03:30.372292 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 13:03:30.372292 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 13:03:30.372292 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 13:03:30.373950 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:30.373950 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:30.373950 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 13:03:30.373950 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:03:30.373950 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 13:03:30.373950 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:03:30.373950 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:30.373950 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:30.373950 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:30.373950 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:30.373950 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:30.373950 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:30.373950 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:30.373950 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:30.373950 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:30.373950 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:30.373950 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:30.373950 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:30.375233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:30.375233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:30.375233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 13:03:30.375233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 13:03:30.375233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 13:03:30.375233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 13:03:30.375233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 13:03:30.375233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 13:03:30.375233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 03 13:03:30.375233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:30.376499 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 425/852] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 13:03:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:30.377364 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a89eac-5030-437e-af59-3e8b63bc901b None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:30.468061 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:30.471406 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131bd082-a7c2-434a-89f8-22827cdce65f None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:30.489315 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a89eac-5030-437e-af59-3e8b63bc901b None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:30.509848 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481de2a-deea-4e6b-8499-4aba97ddff27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:30.510788 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481de2a-deea-4e6b-8499-4aba97ddff27 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:30.511075 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481de2a-deea-4e6b-8499-4aba97ddff27 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:30.511351 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481de2a-deea-4e6b-8499-4aba97ddff27 None admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:30.512080 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b481de2a-deea-4e6b-8499-4aba97ddff27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:30.512423 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b481de2a-deea-4e6b-8499-4aba97ddff27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:30.513797 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b481de2a-deea-4e6b-8499-4aba97ddff27 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:30.526948 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 428/853] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:03:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:30.527778 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481de2a-deea-4e6b-8499-4aba97ddff27 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:30.532475 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0797ec-77ac-4e3a-84d3-4b48b37d20a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:30.533331 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0797ec-77ac-4e3a-84d3-4b48b37d20a0 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:30.533614 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0797ec-77ac-4e3a-84d3-4b48b37d20a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:30.534023 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0797ec-77ac-4e3a-84d3-4b48b37d20a0 None admin] PATH_INFO: `/v3/services` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:30.534593 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0797ec-77ac-4e3a-84d3-4b48b37d20a0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:30.534904 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0797ec-77ac-4e3a-84d3-4b48b37d20a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:30.536372 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0797ec-77ac-4e3a-84d3-4b48b37d20a0 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:30.541463 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 426/854] 10.222.0.61 () {56 vars in 1126 bytes} [Fri Jun 3 13:03:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:30.542087 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0797ec-77ac-4e3a-84d3-4b48b37d20a0 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:30.551857 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:30.645988 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481de2a-deea-4e6b-8499-4aba97ddff27 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:30.647034 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0797ec-77ac-4e3a-84d3-4b48b37d20a0 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:30.681437 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e545c2a-0d3c-4939-b2ad-6854fbcac375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:30.682105 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e545c2a-0d3c-4939-b2ad-6854fbcac375 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:30.682392 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e545c2a-0d3c-4939-b2ad-6854fbcac375 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:30.682665 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e545c2a-0d3c-4939-b2ad-6854fbcac375 None admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:30.683487 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e545c2a-0d3c-4939-b2ad-6854fbcac375 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:30.683590 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3af7e-cfea-4b20-a03e-a0c5e8378902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:30.684035 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e545c2a-0d3c-4939-b2ad-6854fbcac375 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:30.684326 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3af7e-cfea-4b20-a03e-a0c5e8378902 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:30.684610 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3af7e-cfea-4b20-a03e-a0c5e8378902 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:30.684884 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3af7e-cfea-4b20-a03e-a0c5e8378902 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:30.685250 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e545c2a-0d3c-4939-b2ad-6854fbcac375 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:30.693358 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef3af7e-cfea-4b20-a03e-a0c5e8378902 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:30.694796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef3af7e-cfea-4b20-a03e-a0c5e8378902 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:30.703635 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 429/855] 10.222.0.61 () {56 vars in 1135 bytes} [Fri Jun 3 13:03:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:30.704656 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e545c2a-0d3c-4939-b2ad-6854fbcac375 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:30.710627 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-9ef3af7e-cfea-4b20-a03e-a0c5e8378902 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 13:03:30.710627 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:30.710627 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:30.710627 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:30.710627 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:30.710627 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:30.710627 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:30.710627 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:30.710627 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:30.710627 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:30.710627 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:30.710627 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:30.710627 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 13:03:30.710627 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 13:03:30.710627 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 13:03:30.710627 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 13:03:30.711590 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:30.711590 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:30.711590 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 13:03:30.711590 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:03:30.711590 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 13:03:30.711590 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:03:30.711590 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:30.711590 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:30.711590 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:30.711590 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:30.711590 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:30.711590 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:30.711590 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:30.711590 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:30.711590 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:30.711590 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:30.711590 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:30.711590 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:30.717427 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:30.717427 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:30.717427 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 13:03:30.717427 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 13:03:30.717427 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 13:03:30.717427 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 13:03:30.717427 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 13:03:30.717427 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 13:03:30.717427 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 13:03:30.717427 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:30.717427 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 427/856] 10.222.0.61 () {56 vars in 1117 bytes} [Fri Jun 3 13:03:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:30.717427 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3af7e-cfea-4b20-a03e-a0c5e8378902 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:30.730436 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:30.789561 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:30.823961 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3af7e-cfea-4b20-a03e-a0c5e8378902 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:30.832562 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e545c2a-0d3c-4939-b2ad-6854fbcac375 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:30.863966 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46e7a0-3b45-4f3d-acd5-3063a9e062d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:30.864646 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46e7a0-3b45-4f3d-acd5-3063a9e062d7 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:30.865066 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46e7a0-3b45-4f3d-acd5-3063a9e062d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:30.865540 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46e7a0-3b45-4f3d-acd5-3063a9e062d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:30.872687 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf74cb-91f3-40ee-a48a-b77c1d60faa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:30.873404 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf74cb-91f3-40ee-a48a-b77c1d60faa9 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:30.873730 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf74cb-91f3-40ee-a48a-b77c1d60faa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:30.874146 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf74cb-91f3-40ee-a48a-b77c1d60faa9 None admin] PATH_INFO: `/v3/services` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:30.875291 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf74cb-91f3-40ee-a48a-b77c1d60faa9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:30.875605 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf74cb-91f3-40ee-a48a-b77c1d60faa9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:30.877371 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf74cb-91f3-40ee-a48a-b77c1d60faa9 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:30.882660 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 430/857] 10.222.0.61 () {56 vars in 1126 bytes} [Fri Jun 3 13:03:30 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:30.883517 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf74cb-91f3-40ee-a48a-b77c1d60faa9 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:30.953803 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a46e7a0-3b45-4f3d-acd5-3063a9e062d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:30.955312 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a46e7a0-3b45-4f3d-acd5-3063a9e062d7 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:31.003598 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:31.029043 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf74cb-91f3-40ee-a48a-b77c1d60faa9 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:31.040596 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:31.073764 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0bf2c6-26af-4fd5-88b7-010121519b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:31.074843 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bf2c6-26af-4fd5-88b7-010121519b0b None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:31.075351 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bf2c6-26af-4fd5-88b7-010121519b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:31.075853 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bf2c6-26af-4fd5-88b7-010121519b0b None admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:31.077284 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0bf2c6-26af-4fd5-88b7-010121519b0b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:31.077957 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0bf2c6-26af-4fd5-88b7-010121519b0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:31.080499 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0bf2c6-26af-4fd5-88b7-010121519b0b None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:31.084284 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 428/858] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:03:30 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 13:03:31.085583 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46e7a0-3b45-4f3d-acd5-3063a9e062d7 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:31.102579 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 431/859] 10.222.0.61 () {56 vars in 1149 bytes} [Fri Jun 3 13:03:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:31.109260 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0bf2c6-26af-4fd5-88b7-010121519b0b None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:31.193282 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46e7a0-3b45-4f3d-acd5-3063a9e062d7 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:31.212438 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0bf2c6-26af-4fd5-88b7-010121519b0b None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:31.230522 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a8458-56bc-44f7-b09c-9698f3fe5eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:31.231413 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a8458-56bc-44f7-b09c-9698f3fe5eaf None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:31.231699 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a8458-56bc-44f7-b09c-9698f3fe5eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:31.231980 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a8458-56bc-44f7-b09c-9698f3fe5eaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:31.243655 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a8458-56bc-44f7-b09c-9698f3fe5eaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:31.245371 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a8458-56bc-44f7-b09c-9698f3fe5eaf None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:31.249689 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc3546-7386-412f-adb0-0247cd8d757a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:31.250499 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc3546-7386-412f-adb0-0247cd8d757a None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:31.250854 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc3546-7386-412f-adb0-0247cd8d757a None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:31.251203 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc3546-7386-412f-adb0-0247cd8d757a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:31.262549 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:31.267010 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-e24a8458-56bc-44f7-b09c-9698f3fe5eaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:31.267010 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:31.267010 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:31.267010 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:31.267010 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:31.267010 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:31.267010 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:31.267010 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:31.267010 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:31.267010 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:31.267010 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:31.267010 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:31.267010 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:03:31.267010 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:03:31.267010 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:03:31.268104 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:03:31.268104 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:31.268104 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:31.268104 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:31.268104 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:31.268104 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:31.268104 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:31.268104 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:31.268104 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:31.268104 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:31.268104 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:31.268104 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:31.268104 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:31.268104 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:31.268104 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:31.268104 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:31.268104 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:31.269327 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:03:31.269327 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:03:31.269327 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:31.269327 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:31.272088 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 429/860] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:31.277305 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a8458-56bc-44f7-b09c-9698f3fe5eaf None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:31.310293 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:31.328595 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc3546-7386-412f-adb0-0247cd8d757a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:31.330173 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc3546-7386-412f-adb0-0247cd8d757a None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:31.393007 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a8458-56bc-44f7-b09c-9698f3fe5eaf None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:31.441535 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 432/861] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:03:31 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 03 13:03:31.446100 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61434977-c08a-40d1-ad3a-3369b9d3f0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:31.446670 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc3546-7386-412f-adb0-0247cd8d757a None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:31.446794 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61434977-c08a-40d1-ad3a-3369b9d3f0b9 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:31.447038 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61434977-c08a-40d1-ad3a-3369b9d3f0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:31.447306 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61434977-c08a-40d1-ad3a-3369b9d3f0b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:31.448037 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61434977-c08a-40d1-ad3a-3369b9d3f0b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:31.448372 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61434977-c08a-40d1-ad3a-3369b9d3f0b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:31.450915 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61434977-c08a-40d1-ad3a-3369b9d3f0b9 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:31.466422 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 430/862] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:03:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:03:31.472491 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61434977-c08a-40d1-ad3a-3369b9d3f0b9 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:31.510024 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:31.558392 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:31.581358 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61434977-c08a-40d1-ad3a-3369b9d3f0b9 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:31.592100 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc3546-7386-412f-adb0-0247cd8d757a None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:31.625673 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe0978-70a5-4452-825e-4f97690e156d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:31.626481 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe0978-70a5-4452-825e-4f97690e156d None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:31.626790 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe0978-70a5-4452-825e-4f97690e156d None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:31.627307 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe0978-70a5-4452-825e-4f97690e156d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:31.636315 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f2b4a-5616-43ed-8173-8a8f693cb5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:31.636509 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe0978-70a5-4452-825e-4f97690e156d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:31.637113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f2b4a-5616-43ed-8173-8a8f693cb5bc None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:31.637393 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f2b4a-5616-43ed-8173-8a8f693cb5bc None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:31.637666 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f2b4a-5616-43ed-8173-8a8f693cb5bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:31.637767 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe0978-70a5-4452-825e-4f97690e156d None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:31.648897 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7f2b4a-5616-43ed-8173-8a8f693cb5bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:31.650413 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7f2b4a-5616-43ed-8173-8a8f693cb5bc None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:31.652726 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-92fe0978-70a5-4452-825e-4f97690e156d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:03:31.652726 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:31.652726 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:31.652726 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:31.652726 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:31.652726 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:31.652726 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:31.652726 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:31.652726 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:31.652726 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:31.652726 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:31.652726 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:31.652726 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 13:03:31.652726 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 13:03:31.652726 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 13:03:31.653609 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 13:03:31.653609 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:31.653609 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:31.653609 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:31.653609 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:31.653609 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:31.653609 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:31.653609 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:31.653609 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:31.653609 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:31.653609 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:31.653609 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:31.653609 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:31.653609 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:31.653609 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:31.653609 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:31.653609 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:31.654506 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 13:03:31.654506 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 13:03:31.654506 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 13:03:31.654506 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 13:03:31.654506 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 13:03:31.654506 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 13:03:31.654506 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:03:31.654506 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:31.654506 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 431/863] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:03:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:03:31.656546 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8ee61-9c10-44d6-8f84-3ed04217e7d3 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:31.656546 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8ee61-9c10-44d6-8f84-3ed04217e7d3 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:31.656688 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8ee61-9c10-44d6-8f84-3ed04217e7d3 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:31.658031 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 432/864] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:03:31.663215 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12347b0-a8b3-413b-a62d-ad5fcd2bd42e None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:31.663510 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12347b0-a8b3-413b-a62d-ad5fcd2bd42e None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:31.663793 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12347b0-a8b3-413b-a62d-ad5fcd2bd42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:31.676748 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-1f7f2b4a-5616-43ed-8173-8a8f693cb5bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:31.676748 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:31.676748 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:31.676748 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:31.676748 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:31.676748 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:31.676748 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:31.676748 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:31.676748 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:31.676748 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:31.676748 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:31.676748 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:31.676748 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:03:31.676748 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:03:31.676748 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:03:31.677674 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:03:31.677674 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:31.677674 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:31.677674 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:31.677674 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:31.677674 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:31.677674 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:31.677674 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:31.677674 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:31.677674 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:31.677674 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:31.677674 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:31.677674 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:31.677674 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:31.677674 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:31.677674 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:31.677674 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:31.678559 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:03:31.678559 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:03:31.678559 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:31.678559 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:31.679349 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 433/865] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:03:31.680403 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f2b4a-5616-43ed-8173-8a8f693cb5bc None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:31.682020 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-a12347b0-a8b3-413b-a62d-ad5fcd2bd42e None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:31.683217 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-a12347b0-a8b3-413b-a62d-ad5fcd2bd42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:31.760504 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 433/866] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:31 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:03:31.762530 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12347b0-a8b3-413b-a62d-ad5fcd2bd42e None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:31.787375 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:31.797485 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f2b4a-5616-43ed-8173-8a8f693cb5bc None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:31.835148 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52a73d-8bd8-4793-8bcc-e4a1721ab843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:31.835920 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:31.836222 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52a73d-8bd8-4793-8bcc-e4a1721ab843 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:31.836526 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52a73d-8bd8-4793-8bcc-e4a1721ab843 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:31.836812 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52a73d-8bd8-4793-8bcc-e4a1721ab843 None admin] PATH_INFO: `/v3/projects` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:31.837600 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52a73d-8bd8-4793-8bcc-e4a1721ab843 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:31.838065 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52a73d-8bd8-4793-8bcc-e4a1721ab843 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:31.839506 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52a73d-8bd8-4793-8bcc-e4a1721ab843 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:31.857082 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 434/867] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 13:03:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:31.857082 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52a73d-8bd8-4793-8bcc-e4a1721ab843 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:31.876884 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12347b0-a8b3-413b-a62d-ad5fcd2bd42e None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:31.915195 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43458b9-62e2-449d-99b0-3cc2a717a08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:31.915899 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43458b9-62e2-449d-99b0-3cc2a717a08a None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:31.916221 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43458b9-62e2-449d-99b0-3cc2a717a08a None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:31.916501 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43458b9-62e2-449d-99b0-3cc2a717a08a None admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:31.917220 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43458b9-62e2-449d-99b0-3cc2a717a08a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:31.917528 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43458b9-62e2-449d-99b0-3cc2a717a08a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:31.918923 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43458b9-62e2-449d-99b0-3cc2a717a08a None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:31.932124 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 434/868] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:03:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:31.932444 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43458b9-62e2-449d-99b0-3cc2a717a08a None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:31.968434 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52a73d-8bd8-4793-8bcc-e4a1721ab843 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:32.007100 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e71e0-516b-4a29-a435-81ee9bd0dbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:32.007773 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e71e0-516b-4a29-a435-81ee9bd0dbb5 None admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:32.008112 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e71e0-516b-4a29-a435-81ee9bd0dbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:32.008425 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e71e0-516b-4a29-a435-81ee9bd0dbb5 None admin] PATH_INFO: `/v3/services` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:32.009247 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28e71e0-516b-4a29-a435-81ee9bd0dbb5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:32.010611 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28e71e0-516b-4a29-a435-81ee9bd0dbb5 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:32.046296 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43458b9-62e2-449d-99b0-3cc2a717a08a None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:32.074644 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:32.082747 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a3967-40df-46a5-8eb9-115e0f119334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:32.083403 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a3967-40df-46a5-8eb9-115e0f119334 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:32.083688 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a3967-40df-46a5-8eb9-115e0f119334 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:32.083965 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a3967-40df-46a5-8eb9-115e0f119334 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:32.084825 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a3967-40df-46a5-8eb9-115e0f119334 None admin] RBAC: Adding query filter params (role.id=bbd5f3e0c18e4992886fcfb4a3feb426, scope.project.id=c8c0bf799c9f451b8167a646a5c82eda, user.id=b07ad3dd7477497ea25c2a01bff35712) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:32.085138 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a3967-40df-46a5-8eb9-115e0f119334 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:32.086644 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a3967-40df-46a5-8eb9-115e0f119334 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:32.093271 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 435/869] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 13:03:31 2022] GET /identity/v3/role_assignments?user.id=b07ad3dd7477497ea25c2a01bff35712&scope.project.id=c8c0bf799c9f451b8167a646a5c82eda&role.id=bbd5f3e0c18e4992886fcfb4a3feb426 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:32.094127 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a3967-40df-46a5-8eb9-115e0f119334 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:32.108729 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 435/870] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Jun 3 13:03:31 2022] POST /identity/v3/services => generated 251 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:32.228750 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a3967-40df-46a5-8eb9-115e0f119334 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:32.280683 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c0e28-42d4-4f16-9608-7991b6baeca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:32.281668 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c0e28-42d4-4f16-9608-7991b6baeca7 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:32.281952 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c0e28-42d4-4f16-9608-7991b6baeca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:32.282227 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c0e28-42d4-4f16-9608-7991b6baeca7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:32.290468 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c0e28-42d4-4f16-9608-7991b6baeca7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:32.292041 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c0e28-42d4-4f16-9608-7991b6baeca7 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:32.308781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-a65c0e28-42d4-4f16-9608-7991b6baeca7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:03:32.308781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:32.308781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:32.308781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:32.308781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:32.308781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:32.308781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:32.308781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:32.308781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:32.308781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:32.308781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:32.308781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:32.308781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 13:03:32.308781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 13:03:32.308781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 13:03:32.309741 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 13:03:32.309741 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:32.309741 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:32.309741 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:32.309741 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:32.309741 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:32.309741 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:32.309741 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:32.309741 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:32.309741 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:32.309741 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:32.309741 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:32.309741 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:32.309741 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:32.309741 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:32.309741 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:32.309741 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:32.310641 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 13:03:32.310641 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 13:03:32.310641 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 13:03:32.310641 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 13:03:32.310641 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 13:03:32.310641 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 13:03:32.310641 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:03:32.310641 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:32.310641 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 436/871] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:03:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:32.318263 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e71e0-516b-4a29-a435-81ee9bd0dbb5 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:32.338208 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:32.434660 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e71e0-516b-4a29-a435-81ee9bd0dbb5 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:32.470364 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dffc9f-bf2c-41c6-9792-959913db469d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:32.471032 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dffc9f-bf2c-41c6-9792-959913db469d None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:32.471316 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dffc9f-bf2c-41c6-9792-959913db469d None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:32.471592 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dffc9f-bf2c-41c6-9792-959913db469d None admin] PATH_INFO: `/v3/projects` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:32.472395 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dffc9f-bf2c-41c6-9792-959913db469d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:32.472702 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dffc9f-bf2c-41c6-9792-959913db469d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:32.474373 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dffc9f-bf2c-41c6-9792-959913db469d None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:32.487499 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 436/872] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 13:03:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:32.493296 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c0e28-42d4-4f16-9608-7991b6baeca7 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:32.548765 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:32.603062 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c0e28-42d4-4f16-9608-7991b6baeca7 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:32.639290 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb6b1b6-b2e1-4071-8330-3f728a17d12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:32.640365 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6b1b6-b2e1-4071-8330-3f728a17d12a None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:32.640852 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6b1b6-b2e1-4071-8330-3f728a17d12a None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:32.641346 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6b1b6-b2e1-4071-8330-3f728a17d12a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:32.642381 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb6b1b6-b2e1-4071-8330-3f728a17d12a None admin] RBAC: Adding query filter params (role.id=eb985092d5f14e92a783e26568bf457b, scope.project.id=c8c0bf799c9f451b8167a646a5c82eda, user.id=06c55d0ea52f40ae9125d2efe1d159a3) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:32.642898 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb6b1b6-b2e1-4071-8330-3f728a17d12a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:32.644688 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb6b1b6-b2e1-4071-8330-3f728a17d12a None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:32.652011 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 437/873] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 13:03:32 2022] GET /identity/v3/role_assignments?user.id=06c55d0ea52f40ae9125d2efe1d159a3&scope.project.id=c8c0bf799c9f451b8167a646a5c82eda&role.id=eb985092d5f14e92a783e26568bf457b => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:33.204819 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241e3d0-ad77-420d-b442-91d11ce5b04b None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:33.205371 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241e3d0-ad77-420d-b442-91d11ce5b04b None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:33.205371 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241e3d0-ad77-420d-b442-91d11ce5b04b None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:33.206999 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 437/874] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:03:33.212329 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04ca54-f25c-42dc-88be-d3fa65f8d58a None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:33.212751 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04ca54-f25c-42dc-88be-d3fa65f8d58a None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:33.212944 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04ca54-f25c-42dc-88be-d3fa65f8d58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:33.230047 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-fc04ca54-f25c-42dc-88be-d3fa65f8d58a None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:33.231222 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-fc04ca54-f25c-42dc-88be-d3fa65f8d58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:33.300061 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 438/875] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:33 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 13:03:33.322643 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241e3d0-ad77-420d-b442-91d11ce5b04b None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:33.402917 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:33.439220 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241e3d0-ad77-420d-b442-91d11ce5b04b None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:33.478533 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c0baac-6129-46ef-be77-52feeb0f971f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:33.479203 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0baac-6129-46ef-be77-52feeb0f971f None admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:33.479488 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0baac-6129-46ef-be77-52feeb0f971f None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:33.479766 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0baac-6129-46ef-be77-52feeb0f971f None admin] PATH_INFO: `/v3/services` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:33.480534 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c0baac-6129-46ef-be77-52feeb0f971f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:33.481918 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c0baac-6129-46ef-be77-52feeb0f971f None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:33.588179 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 438/876] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Jun 3 13:03:33 2022] POST /identity/v3/services => generated 269 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:34.487381 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaae84f-267f-462c-9536-147e7d1ae44f None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:34.487908 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaae84f-267f-462c-9536-147e7d1ae44f None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:34.487908 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaae84f-267f-462c-9536-147e7d1ae44f None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:34.489597 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 439/877] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:03:34.495093 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7cf4d-11ef-4de0-9bb9-493a5215d0e1 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:34.495541 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7cf4d-11ef-4de0-9bb9-493a5215d0e1 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:34.495718 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7cf4d-11ef-4de0-9bb9-493a5215d0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:34.514173 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-b4f7cf4d-11ef-4de0-9bb9-493a5215d0e1 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:34.515931 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-b4f7cf4d-11ef-4de0-9bb9-493a5215d0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:34.595508 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 439/878] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:34 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:03:34.618085 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaae84f-267f-462c-9536-147e7d1ae44f None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:34.659715 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d42026-b415-4f36-a4b2-77aa2ff6f247 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:34.660030 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d42026-b415-4f36-a4b2-77aa2ff6f247 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:34.660321 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d42026-b415-4f36-a4b2-77aa2ff6f247 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:34.661850 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 440/879] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 13:03:34.666665 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0932787-7df7-4d82-94f5-e8e848a26147 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:34.667203 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0932787-7df7-4d82-94f5-e8e848a26147 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:34.667705 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0932787-7df7-4d82-94f5-e8e848a26147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:34.669891 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:34.688673 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-d0932787-7df7-4d82-94f5-e8e848a26147 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:34.690225 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-d0932787-7df7-4d82-94f5-e8e848a26147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:34.734600 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaae84f-267f-462c-9536-147e7d1ae44f None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:34.761221 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:34.773776 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354bbf9-0699-47ce-89d6-b6cca39c1940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:34.775020 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354bbf9-0699-47ce-89d6-b6cca39c1940 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:34.775494 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354bbf9-0699-47ce-89d6-b6cca39c1940 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:34.775951 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354bbf9-0699-47ce-89d6-b6cca39c1940 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:34.776838 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f354bbf9-0699-47ce-89d6-b6cca39c1940 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:34.778695 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f354bbf9-0699-47ce-89d6-b6cca39c1940 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:34.785878 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 441/880] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:34 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 13:03:34.793133 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-f354bbf9-0699-47ce-89d6-b6cca39c1940 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 13:03:34.793133 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:34.793133 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 13:03:34.793133 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 13:03:34.793133 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 13:03:34.793133 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 13:03:34.793133 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 13:03:34.793133 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:03:34.793133 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 13:03:34.793133 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:34.793133 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 13:03:34.793133 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:34.793133 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:34.793133 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:34.793133 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:34.793133 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:34.793133 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:34.794137 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:34.794137 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:34.794137 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:34.794137 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:34.794137 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:34.794137 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:34.794137 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 13:03:34.794137 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 13:03:34.794137 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 13:03:34.794137 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 13:03:34.794137 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:34.794137 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:34.794137 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:34.794137 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:34.794137 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:34.794137 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:34.795005 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:34.795005 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:34.795005 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:34.795005 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:34.795005 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:34.795005 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:34.795005 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:34.795005 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:34.795005 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:34.795005 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:34.795005 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 13:03:34.795005 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:03:34.795005 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 13:03:34.795005 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:34.795005 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 440/881] 10.222.0.61 () {56 vars in 1126 bytes} [Fri Jun 3 13:03:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:34.801656 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0932787-7df7-4d82-94f5-e8e848a26147 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:34.814111 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354bbf9-0699-47ce-89d6-b6cca39c1940 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:34.915234 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0932787-7df7-4d82-94f5-e8e848a26147 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:34.923766 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354bbf9-0699-47ce-89d6-b6cca39c1940 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:34.931610 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:34.955754 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1344f65-4be5-4372-9a89-63e0bdbe6541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:34.956756 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1344f65-4be5-4372-9a89-63e0bdbe6541 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:34.957194 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1344f65-4be5-4372-9a89-63e0bdbe6541 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:34.957621 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1344f65-4be5-4372-9a89-63e0bdbe6541 None admin] PATH_INFO: `/v3/services` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:34.958618 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1344f65-4be5-4372-9a89-63e0bdbe6541 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:34.959085 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1344f65-4be5-4372-9a89-63e0bdbe6541 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:34.960900 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1344f65-4be5-4372-9a89-63e0bdbe6541 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:34.961693 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36959f6a-4101-4510-a230-6fd4698d4a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:34.962657 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36959f6a-4101-4510-a230-6fd4698d4a51 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:34.963008 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36959f6a-4101-4510-a230-6fd4698d4a51 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:34.963350 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36959f6a-4101-4510-a230-6fd4698d4a51 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:34.964176 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36959f6a-4101-4510-a230-6fd4698d4a51 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:34.965627 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36959f6a-4101-4510-a230-6fd4698d4a51 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:34.968429 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 442/882] 10.222.0.61 () {56 vars in 1122 bytes} [Fri Jun 3 13:03:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:34.979833 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1344f65-4be5-4372-9a89-63e0bdbe6541 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:34.980006 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-36959f6a-4101-4510-a230-6fd4698d4a51 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 13:03:34.980006 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:34.980006 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 13:03:34.980006 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 13:03:34.980006 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 13:03:34.980006 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 13:03:34.980006 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 13:03:34.980006 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:03:34.980006 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 13:03:34.980006 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:34.980006 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 13:03:34.980006 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:34.980006 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:34.980006 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:34.980006 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:34.980006 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:34.980006 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:34.981068 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:34.981068 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:34.981068 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:34.981068 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:34.981068 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:34.981068 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:34.981068 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 13:03:34.981068 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 13:03:34.981068 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 13:03:34.981068 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 13:03:34.981068 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:34.981068 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:34.981068 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:34.981068 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:34.981068 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:34.981068 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:34.981927 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:34.981927 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:34.981927 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:34.981927 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:34.981927 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:34.981927 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:34.981927 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:34.981927 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:34.981927 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:34.981927 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:34.981927 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 13:03:34.981927 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:03:34.981927 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 13:03:34.981927 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:34.981927 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 441/883] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jun 3 13:03:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:03:34.997377 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36959f6a-4101-4510-a230-6fd4698d4a51 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:35.058588 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:35.108417 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36959f6a-4101-4510-a230-6fd4698d4a51 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:35.123086 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1344f65-4be5-4372-9a89-63e0bdbe6541 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:35.145441 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e956c-cae8-4056-989d-2fef72b19382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:35.146113 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e956c-cae8-4056-989d-2fef72b19382 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:35.146397 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e956c-cae8-4056-989d-2fef72b19382 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:35.146673 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e956c-cae8-4056-989d-2fef72b19382 None admin] PATH_INFO: `/v3/services` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:35.147382 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e956c-cae8-4056-989d-2fef72b19382 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:35.147689 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e956c-cae8-4056-989d-2fef72b19382 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:35.149095 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e956c-cae8-4056-989d-2fef72b19382 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:35.153926 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 442/884] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jun 3 13:03:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:03:35.155275 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b56d80-302d-4ce8-b14b-70882e9cf330 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:35.155585 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b56d80-302d-4ce8-b14b-70882e9cf330 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:35.155823 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b56d80-302d-4ce8-b14b-70882e9cf330 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:35.157471 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 443/885] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:03:35.161476 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b56d80-302d-4ce8-b14b-70882e9cf330 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:35.165276 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71417f56-63cb-4271-a5de-bca8d76e66db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:35.166146 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71417f56-63cb-4271-a5de-bca8d76e66db None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:35.166581 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71417f56-63cb-4271-a5de-bca8d76e66db None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:35.167025 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71417f56-63cb-4271-a5de-bca8d76e66db None admin] PATH_INFO: `/v3/services` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:35.167876 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71417f56-63cb-4271-a5de-bca8d76e66db None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:35.168369 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71417f56-63cb-4271-a5de-bca8d76e66db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:35.169876 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71417f56-63cb-4271-a5de-bca8d76e66db None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:35.176121 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 443/886] 10.222.0.61 () {56 vars in 1122 bytes} [Fri Jun 3 13:03:34 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:35.177376 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5453a6-18b8-4674-a672-02d352aafb9c None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:35.177662 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5453a6-18b8-4674-a672-02d352aafb9c None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:35.177937 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5453a6-18b8-4674-a672-02d352aafb9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:35.199941 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-9a5453a6-18b8-4674-a672-02d352aafb9c None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:35.202132 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-9a5453a6-18b8-4674-a672-02d352aafb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:35.207153 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:35.297085 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 444/887] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:03:35.308708 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b56d80-302d-4ce8-b14b-70882e9cf330 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:35.321177 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5453a6-18b8-4674-a672-02d352aafb9c None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:35.352101 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19835784-54d2-401d-a278-7f3320a4b9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:35.353172 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19835784-54d2-401d-a278-7f3320a4b9e5 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:35.353639 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19835784-54d2-401d-a278-7f3320a4b9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:35.354093 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19835784-54d2-401d-a278-7f3320a4b9e5 None admin] PATH_INFO: `/v3/services` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:35.355110 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19835784-54d2-401d-a278-7f3320a4b9e5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:35.355661 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19835784-54d2-401d-a278-7f3320a4b9e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:35.357461 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19835784-54d2-401d-a278-7f3320a4b9e5 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:35.364059 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 444/888] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jun 3 13:03:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:35.375626 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19835784-54d2-401d-a278-7f3320a4b9e5 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:35.375855 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:35.443076 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5453a6-18b8-4674-a672-02d352aafb9c None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:35.482058 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946521d4-55ab-4631-ad26-bf209f47e12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:35.483403 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946521d4-55ab-4631-ad26-bf209f47e12a None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:35.483884 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946521d4-55ab-4631-ad26-bf209f47e12a None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:35.484182 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946521d4-55ab-4631-ad26-bf209f47e12a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:35.495088 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946521d4-55ab-4631-ad26-bf209f47e12a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:03:35.500702 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19835784-54d2-401d-a278-7f3320a4b9e5 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:35.503960 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-946521d4-55ab-4631-ad26-bf209f47e12a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 13:03:35.503960 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:35.503960 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:35.503960 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:35.503960 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:35.503960 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:35.503960 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:35.503960 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:35.503960 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:35.503960 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:35.503960 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:35.503960 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:35.503960 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:03:35.503960 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:03:35.503960 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:03:35.503960 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:03:35.505313 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:03:35.505313 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:03:35.505313 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:03:35.505313 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:03:35.505313 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:35.505313 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:35.505313 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:35.505313 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:35.505313 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:35.505313 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:35.505313 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:35.505313 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:35.505313 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:35.505313 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:35.505313 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:35.505313 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:35.506149 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:35.506149 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:35.506149 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:35.506149 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:35.506149 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:03:35.506149 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:03:35.506149 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:03:35.506149 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:03:35.506149 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:03:35.506149 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:03:35.506149 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 13:03:35.506149 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:35.510194 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 445/889] 10.222.0.61 () {56 vars in 1120 bytes} [Fri Jun 3 13:03:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:03:35.511054 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946521d4-55ab-4631-ad26-bf209f47e12a None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:35.511708 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:35.542119 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad8488-091b-4a7e-a55c-83457cc6f163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:35.542915 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad8488-091b-4a7e-a55c-83457cc6f163 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:35.543206 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad8488-091b-4a7e-a55c-83457cc6f163 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:35.543485 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad8488-091b-4a7e-a55c-83457cc6f163 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:35.544603 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad8488-091b-4a7e-a55c-83457cc6f163 None admin] RBAC: Adding query filter params (interface=public, service_id=c59953e784f54d29950ae4d373bbae21, region_id=RegionOne) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:35.544752 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad8488-091b-4a7e-a55c-83457cc6f163 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:35.546630 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad8488-091b-4a7e-a55c-83457cc6f163 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:35.554645 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 445/890] 10.222.0.61 () {56 vars in 1251 bytes} [Fri Jun 3 13:03:35 2022] GET /identity/v3/endpoints?service_id=c59953e784f54d29950ae4d373bbae21&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:35.559975 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad8488-091b-4a7e-a55c-83457cc6f163 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:35.634129 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946521d4-55ab-4631-ad26-bf209f47e12a None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:35.642180 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:35.670971 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d41361-a726-4f4e-857b-5f6ebac91b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:35.671507 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad8488-091b-4a7e-a55c-83457cc6f163 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:35.671712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d41361-a726-4f4e-857b-5f6ebac91b11 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:35.671981 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d41361-a726-4f4e-857b-5f6ebac91b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:35.672368 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d41361-a726-4f4e-857b-5f6ebac91b11 None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:35.673173 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d41361-a726-4f4e-857b-5f6ebac91b11 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:35.673487 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d41361-a726-4f4e-857b-5f6ebac91b11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:35.674873 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d41361-a726-4f4e-857b-5f6ebac91b11 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:35.690287 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 446/891] 10.222.0.61 () {56 vars in 1115 bytes} [Fri Jun 3 13:03:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:03:35.691200 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d41361-a726-4f4e-857b-5f6ebac91b11 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:35.713561 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737897b-c030-4b3f-8b09-f8f9a10e3136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:35.714634 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737897b-c030-4b3f-8b09-f8f9a10e3136 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:35.715138 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737897b-c030-4b3f-8b09-f8f9a10e3136 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:35.715624 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737897b-c030-4b3f-8b09-f8f9a10e3136 None admin] PATH_INFO: `/v3/services` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:35.716583 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4737897b-c030-4b3f-8b09-f8f9a10e3136 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:35.719085 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4737897b-c030-4b3f-8b09-f8f9a10e3136 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:35.732272 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 446/892] 10.222.0.61 () {56 vars in 1087 bytes} [Fri Jun 3 13:03:35 2022] GET /identity/v3/services => generated 1268 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:03:35.808519 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d41361-a726-4f4e-857b-5f6ebac91b11 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:35.857022 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946116c-70be-4150-a39f-d498efce345a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:35.858976 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946116c-70be-4150-a39f-d498efce345a None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:35.859598 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946116c-70be-4150-a39f-d498efce345a None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:35.860086 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946116c-70be-4150-a39f-d498efce345a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:35.872498 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7946116c-70be-4150-a39f-d498efce345a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:35.875473 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7946116c-70be-4150-a39f-d498efce345a None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:35.895661 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-7946116c-70be-4150-a39f-d498efce345a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:35.895661 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:35.895661 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:35.895661 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:35.895661 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:35.895661 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:35.895661 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:35.895661 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:35.895661 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:35.895661 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:35.895661 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:35.895661 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:35.895661 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:03:35.895661 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:03:35.895661 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:03:35.896670 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:03:35.896670 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:35.896670 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:35.896670 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:35.896670 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:35.896670 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:35.896670 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:35.896670 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:35.896670 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:35.896670 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:35.896670 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:35.896670 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:35.896670 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:35.896670 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:35.896670 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:35.896670 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:35.896670 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:35.897609 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:03:35.897609 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:03:35.897609 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:35.897609 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:35.898496 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 447/893] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:35.899852 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e83e3-8652-47b5-b9e2-2a0a8fa760f8 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:35.900575 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e83e3-8652-47b5-b9e2-2a0a8fa760f8 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:35.901091 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e83e3-8652-47b5-b9e2-2a0a8fa760f8 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:35.908352 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 447/894] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:03:35.908492 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946116c-70be-4150-a39f-d498efce345a None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:35.908577 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609132b-7c5a-4ae9-998f-f73abd19677a None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:35.908577 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609132b-7c5a-4ae9-998f-f73abd19677a None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:35.908835 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609132b-7c5a-4ae9-998f-f73abd19677a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:35.927492 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-9609132b-7c5a-4ae9-998f-f73abd19677a None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:35.928800 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-9609132b-7c5a-4ae9-998f-f73abd19677a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:35.944574 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:35.952540 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:36.016119 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 448/895] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 13:03:36.038666 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946116c-70be-4150-a39f-d498efce345a None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:36.039224 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9609132b-7c5a-4ae9-998f-f73abd19677a None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:36.088522 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fcdaaa-9305-46aa-9717-25289338ef05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:36.090207 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fcdaaa-9305-46aa-9717-25289338ef05 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:36.090872 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fcdaaa-9305-46aa-9717-25289338ef05 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:36.091439 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fcdaaa-9305-46aa-9717-25289338ef05 None admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:36.092959 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fcdaaa-9305-46aa-9717-25289338ef05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:36.093940 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fcdaaa-9305-46aa-9717-25289338ef05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:36.095530 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fcdaaa-9305-46aa-9717-25289338ef05 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:36.116342 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 448/896] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:03:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:36.120409 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fcdaaa-9305-46aa-9717-25289338ef05 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:36.158504 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9609132b-7c5a-4ae9-998f-f73abd19677a None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:36.204437 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff6509-a2b0-4db5-bf20-a4f5e1d63cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:36.206251 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff6509-a2b0-4db5-bf20-a4f5e1d63cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:36.206737 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff6509-a2b0-4db5-bf20-a4f5e1d63cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:36.207208 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff6509-a2b0-4db5-bf20-a4f5e1d63cb4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:36.207373 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:36.208179 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff6509-a2b0-4db5-bf20-a4f5e1d63cb4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:36.210671 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff6509-a2b0-4db5-bf20-a4f5e1d63cb4 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:36.227372 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fcdaaa-9305-46aa-9717-25289338ef05 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:36.227625 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-59ff6509-a2b0-4db5-bf20-a4f5e1d63cb4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 13:03:36.227625 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:36.227625 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 13:03:36.227625 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 13:03:36.227625 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 13:03:36.227625 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 13:03:36.227625 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 13:03:36.227625 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:03:36.227625 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 13:03:36.227625 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:36.227625 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 13:03:36.227625 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:36.227625 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:36.227625 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:36.227625 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:36.227625 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:36.228625 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:36.228625 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:36.228625 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:36.228625 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:36.228625 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:36.228625 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:36.228625 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:36.228625 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 13:03:36.228625 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 13:03:36.228625 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 13:03:36.228625 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 13:03:36.228625 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:36.228625 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:36.228625 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:36.228625 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:36.228625 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:36.229479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:36.229479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:36.229479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:36.229479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:36.229479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:36.229479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:36.229479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:36.229479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:36.229479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:36.229479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:36.229479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:36.229479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 13:03:36.229479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:03:36.229479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 13:03:36.229479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:36.232223 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 449/897] 10.222.0.61 () {56 vars in 1132 bytes} [Fri Jun 3 13:03:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:03:36.236382 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff6509-a2b0-4db5-bf20-a4f5e1d63cb4 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:36.269090 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:36.283536 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4bc2ed-01e8-42be-9279-4fb6e2dc677c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:36.284810 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4bc2ed-01e8-42be-9279-4fb6e2dc677c None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:36.285309 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4bc2ed-01e8-42be-9279-4fb6e2dc677c None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:36.285788 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4bc2ed-01e8-42be-9279-4fb6e2dc677c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:36.296691 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4bc2ed-01e8-42be-9279-4fb6e2dc677c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:36.298941 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4bc2ed-01e8-42be-9279-4fb6e2dc677c None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:36.321639 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-ab4bc2ed-01e8-42be-9279-4fb6e2dc677c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 13:03:36.321639 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:36.321639 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:36.321639 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:36.321639 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:36.321639 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:36.321639 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:36.321639 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:36.321639 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:36.321639 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:36.321639 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:36.321639 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:36.321639 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 13:03:36.321639 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 13:03:36.321639 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 13:03:36.321639 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 13:03:36.322707 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:36.322707 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:36.322707 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 13:03:36.322707 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:03:36.322707 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 13:03:36.322707 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:03:36.322707 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:36.322707 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:36.322707 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:36.322707 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:36.322707 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:36.322707 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:36.322707 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:36.322707 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:36.322707 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:36.322707 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:36.322707 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:36.322707 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:36.323634 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:36.323634 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:36.323634 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 13:03:36.323634 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 13:03:36.323634 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 13:03:36.323634 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 13:03:36.323634 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 13:03:36.323634 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 13:03:36.323634 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 13:03:36.323634 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:36.327361 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 449/898] 10.222.0.61 () {56 vars in 1117 bytes} [Fri Jun 3 13:03:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:03:36.333167 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4bc2ed-01e8-42be-9279-4fb6e2dc677c None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:36.362893 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff6509-a2b0-4db5-bf20-a4f5e1d63cb4 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:36.409263 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78662ce7-d6e9-4ebc-9ba2-49da94255cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:36.409842 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78662ce7-d6e9-4ebc-9ba2-49da94255cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:36.410142 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78662ce7-d6e9-4ebc-9ba2-49da94255cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:36.410417 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78662ce7-d6e9-4ebc-9ba2-49da94255cf0 None admin] PATH_INFO: `/v3/services` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:36.411563 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78662ce7-d6e9-4ebc-9ba2-49da94255cf0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:36.411563 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78662ce7-d6e9-4ebc-9ba2-49da94255cf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:36.412822 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78662ce7-d6e9-4ebc-9ba2-49da94255cf0 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:36.423344 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 450/899] 10.222.0.61 () {56 vars in 1126 bytes} [Fri Jun 3 13:03:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:36.425865 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78662ce7-d6e9-4ebc-9ba2-49da94255cf0 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:36.453290 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4bc2ed-01e8-42be-9279-4fb6e2dc677c None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:36.494515 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7126b671-f202-462f-a0fe-7db135716011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:36.495577 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126b671-f202-462f-a0fe-7db135716011 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:36.496124 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126b671-f202-462f-a0fe-7db135716011 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:36.496616 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126b671-f202-462f-a0fe-7db135716011 None admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:36.497644 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7126b671-f202-462f-a0fe-7db135716011 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:36.498238 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7126b671-f202-462f-a0fe-7db135716011 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:36.500024 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7126b671-f202-462f-a0fe-7db135716011 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:36.518670 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:36.519710 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 450/900] 10.222.0.61 () {56 vars in 1149 bytes} [Fri Jun 3 13:03:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:36.528263 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7126b671-f202-462f-a0fe-7db135716011 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:36.534990 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:36.554928 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78662ce7-d6e9-4ebc-9ba2-49da94255cf0 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:36.600473 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a52afa-7c0a-4233-b44c-6913a8818308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:36.601154 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a52afa-7c0a-4233-b44c-6913a8818308 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:36.601442 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a52afa-7c0a-4233-b44c-6913a8818308 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:36.601721 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a52afa-7c0a-4233-b44c-6913a8818308 None admin] PATH_INFO: `/v3/services` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:36.602729 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a52afa-7c0a-4233-b44c-6913a8818308 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:36.603040 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a52afa-7c0a-4233-b44c-6913a8818308 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:36.604986 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a52afa-7c0a-4233-b44c-6913a8818308 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:36.617597 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 451/901] 10.222.0.61 () {56 vars in 1126 bytes} [Fri Jun 3 13:03:36 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:36.618693 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a52afa-7c0a-4233-b44c-6913a8818308 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:36.664308 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7126b671-f202-462f-a0fe-7db135716011 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:36.710137 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7f07c-5dd9-4e61-bfd9-7a579131e963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:36.711171 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7f07c-5dd9-4e61-bfd9-7a579131e963 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:36.712138 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7f07c-5dd9-4e61-bfd9-7a579131e963 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:36.712638 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7f07c-5dd9-4e61-bfd9-7a579131e963 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:36.739341 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a52afa-7c0a-4233-b44c-6913a8818308 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:36.778049 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9538b9-bbaf-4526-ae1e-19580d234caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:36.779351 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9538b9-bbaf-4526-ae1e-19580d234caf None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:36.780623 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9538b9-bbaf-4526-ae1e-19580d234caf None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:36.781189 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9538b9-bbaf-4526-ae1e-19580d234caf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:36.782698 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9538b9-bbaf-4526-ae1e-19580d234caf None admin] RBAC: Adding query filter params (interface=public, service_id=254bdca5778d43a2a7a5df28a6d63e0c, region_id=RegionOne) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:36.783245 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9538b9-bbaf-4526-ae1e-19580d234caf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:36.785337 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9538b9-bbaf-4526-ae1e-19580d234caf None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:36.798173 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 452/902] 10.222.0.61 () {56 vars in 1251 bytes} [Fri Jun 3 13:03:36 2022] GET /identity/v3/endpoints?service_id=254bdca5778d43a2a7a5df28a6d63e0c&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:36.799642 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9538b9-bbaf-4526-ae1e-19580d234caf None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:36.800534 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:36.804977 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7f07c-5dd9-4e61-bfd9-7a579131e963 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:36.806682 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7f07c-5dd9-4e61-bfd9-7a579131e963 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:36.816682 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:36.916608 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9538b9-bbaf-4526-ae1e-19580d234caf None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:36.937741 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 451/903] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:03:36 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 13:03:36.943183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7f07c-5dd9-4e61-bfd9-7a579131e963 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:36.967374 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19151f8-3b59-44bc-b5b9-56262e658576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:36.968468 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19151f8-3b59-44bc-b5b9-56262e658576 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:36.969063 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19151f8-3b59-44bc-b5b9-56262e658576 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:36.969824 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19151f8-3b59-44bc-b5b9-56262e658576 None admin] PATH_INFO: `/v3/services` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:36.970951 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19151f8-3b59-44bc-b5b9-56262e658576 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:36.973299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19151f8-3b59-44bc-b5b9-56262e658576 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:36.980265 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 453/904] 10.222.0.61 () {56 vars in 1087 bytes} [Fri Jun 3 13:03:36 2022] GET /identity/v3/services => generated 1268 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:03:37.064932 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:37.069317 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7f07c-5dd9-4e61-bfd9-7a579131e963 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:37.109590 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2cab1-76a5-43d1-ae4c-16cbc179e38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:37.110785 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2cab1-76a5-43d1-ae4c-16cbc179e38f None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:37.111069 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2cab1-76a5-43d1-ae4c-16cbc179e38f None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:37.111345 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2cab1-76a5-43d1-ae4c-16cbc179e38f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:37.122926 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d2cab1-76a5-43d1-ae4c-16cbc179e38f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:37.125228 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d2cab1-76a5-43d1-ae4c-16cbc179e38f None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:37.145398 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-88d2cab1-76a5-43d1-ae4c-16cbc179e38f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:37.145398 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:37.145398 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:37.145398 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:37.145398 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:37.145398 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:37.145398 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:37.145398 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:37.145398 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:37.145398 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:37.145398 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:37.145398 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:37.145398 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:03:37.145398 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:03:37.145398 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:03:37.146346 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:03:37.146346 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:37.146346 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:37.146346 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:37.146346 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:37.146346 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:37.146346 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:37.146346 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:37.146346 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:37.146346 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:37.146346 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:37.146346 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:37.146346 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:37.146346 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:37.146346 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:37.146346 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:37.146346 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:37.147223 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:03:37.147223 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:03:37.147223 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:37.147223 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:37.147223 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 452/905] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:37.153661 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19151f8-3b59-44bc-b5b9-56262e658576 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:37.237864 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:37.266284 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19151f8-3b59-44bc-b5b9-56262e658576 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:37.306930 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439a687-3642-4a16-b22f-c5d9fafc47b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:37.307969 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439a687-3642-4a16-b22f-c5d9fafc47b0 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:37.308468 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439a687-3642-4a16-b22f-c5d9fafc47b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:37.308963 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439a687-3642-4a16-b22f-c5d9fafc47b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:37.309938 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3439a687-3642-4a16-b22f-c5d9fafc47b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:37.310440 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3439a687-3642-4a16-b22f-c5d9fafc47b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:37.312697 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3439a687-3642-4a16-b22f-c5d9fafc47b0 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:37.325015 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 454/906] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:03:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:37.331301 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2cab1-76a5-43d1-ae4c-16cbc179e38f None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:37.437612 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2cab1-76a5-43d1-ae4c-16cbc179e38f None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:37.473495 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f152f-0e84-4981-88fe-74226465bf70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:37.474689 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f152f-0e84-4981-88fe-74226465bf70 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:37.475169 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f152f-0e84-4981-88fe-74226465bf70 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:37.475664 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f152f-0e84-4981-88fe-74226465bf70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:37.483289 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788f152f-0e84-4981-88fe-74226465bf70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:37.484977 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788f152f-0e84-4981-88fe-74226465bf70 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:37.500014 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-788f152f-0e84-4981-88fe-74226465bf70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:03:37.500014 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:37.500014 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:37.500014 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:37.500014 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:37.500014 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:37.500014 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:37.500014 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:37.500014 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:37.500014 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:37.500014 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:37.500014 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:37.500014 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 13:03:37.500014 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 13:03:37.500014 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 13:03:37.500986 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 13:03:37.500986 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:37.500986 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:37.500986 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:37.500986 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:37.500986 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:37.500986 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:37.500986 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:37.500986 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:37.500986 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:37.500986 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:37.500986 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:37.500986 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:37.500986 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:37.500986 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:37.500986 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:37.500986 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:37.501887 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 13:03:37.501887 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 13:03:37.501887 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 13:03:37.501887 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 13:03:37.501887 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 13:03:37.501887 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 13:03:37.501887 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:03:37.501887 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:37.504395 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 453/907] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:03:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:37.510334 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439a687-3642-4a16-b22f-c5d9fafc47b0 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:37.603882 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6037633-2e6b-4dd7-be3c-fba00fab4f9f None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:37.604912 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6037633-2e6b-4dd7-be3c-fba00fab4f9f None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:37.605413 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6037633-2e6b-4dd7-be3c-fba00fab4f9f None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:37.607235 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 454/908] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:03:37.613699 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44933d0-6d4c-4e58-966c-42004de82b35 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:37.614053 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44933d0-6d4c-4e58-966c-42004de82b35 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:37.614326 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44933d0-6d4c-4e58-966c-42004de82b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:37.616766 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439a687-3642-4a16-b22f-c5d9fafc47b0 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:37.633198 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-a44933d0-6d4c-4e58-966c-42004de82b35 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:37.634389 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-a44933d0-6d4c-4e58-966c-42004de82b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:37.653244 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:37.658769 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4b0b7-e1b3-44ef-887b-915b10850b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:37.659708 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4b0b7-e1b3-44ef-887b-915b10850b0a None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:37.660521 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4b0b7-e1b3-44ef-887b-915b10850b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:37.661017 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4b0b7-e1b3-44ef-887b-915b10850b0a None admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:37.662014 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a4b0b7-e1b3-44ef-887b-915b10850b0a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:37.662722 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a4b0b7-e1b3-44ef-887b-915b10850b0a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:37.664808 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a4b0b7-e1b3-44ef-887b-915b10850b0a None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:37.680681 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 455/909] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 13:03:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:37.681614 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:37.689117 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4b0b7-e1b3-44ef-887b-915b10850b0a None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:37.733802 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 455/910] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:37 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 13:03:37.756648 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44933d0-6d4c-4e58-966c-42004de82b35 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:37.802898 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4b0b7-e1b3-44ef-887b-915b10850b0a None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:37.841510 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4483a7be-e6d5-4958-bb86-7efcf362c144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:37.842477 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483a7be-e6d5-4958-bb86-7efcf362c144 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:37.842768 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483a7be-e6d5-4958-bb86-7efcf362c144 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:37.843041 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483a7be-e6d5-4958-bb86-7efcf362c144 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:37.843940 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4483a7be-e6d5-4958-bb86-7efcf362c144 None admin] RBAC: Adding query filter params (role.id=597251d134b24da6a79c4005736005a4, scope.project.id=c8c0bf799c9f451b8167a646a5c82eda, user.id=06c55d0ea52f40ae9125d2efe1d159a3) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:37.844278 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4483a7be-e6d5-4958-bb86-7efcf362c144 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:37.845935 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4483a7be-e6d5-4958-bb86-7efcf362c144 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:37.860187 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 456/911] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 13:03:37 2022] GET /identity/v3/role_assignments?user.id=06c55d0ea52f40ae9125d2efe1d159a3&scope.project.id=c8c0bf799c9f451b8167a646a5c82eda&role.id=597251d134b24da6a79c4005736005a4 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:37.879292 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44933d0-6d4c-4e58-966c-42004de82b35 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:37.921650 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1ade6-195a-4bbb-855d-bd6460c285ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:37.922624 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1ade6-195a-4bbb-855d-bd6460c285ab None admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:37.922911 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1ade6-195a-4bbb-855d-bd6460c285ab None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:37.923187 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1ade6-195a-4bbb-855d-bd6460c285ab None admin] PATH_INFO: `/v3/services` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:37.923988 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab1ade6-195a-4bbb-855d-bd6460c285ab None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:37.925444 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab1ade6-195a-4bbb-855d-bd6460c285ab None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:37.988832 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:37.995149 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 456/912] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Jun 3 13:03:37 2022] POST /identity/v3/services => generated 241 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:03:38.158957 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e94825-c6f3-403b-a4ec-a08c87dd317f None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:38.159266 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e94825-c6f3-403b-a4ec-a08c87dd317f None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:38.159445 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e94825-c6f3-403b-a4ec-a08c87dd317f None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:38.161190 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 457/913] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:03:38.167162 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5503f-1480-4a5d-828c-4e55d6174751 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:38.167473 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5503f-1480-4a5d-828c-4e55d6174751 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:38.167736 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5503f-1480-4a5d-828c-4e55d6174751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:38.187858 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-88a5503f-1480-4a5d-828c-4e55d6174751 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:38.189122 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-88a5503f-1480-4a5d-828c-4e55d6174751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:38.269767 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 457/914] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:03:38.293410 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e94825-c6f3-403b-a4ec-a08c87dd317f None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:38.360625 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:38.404362 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e94825-c6f3-403b-a4ec-a08c87dd317f None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:38.440692 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb36c2-269c-49d3-80b0-7ccda2d9dbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:38.441417 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb36c2-269c-49d3-80b0-7ccda2d9dbf1 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:38.441699 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb36c2-269c-49d3-80b0-7ccda2d9dbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:38.441973 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb36c2-269c-49d3-80b0-7ccda2d9dbf1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:38.442632 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb36c2-269c-49d3-80b0-7ccda2d9dbf1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:38.444012 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb36c2-269c-49d3-80b0-7ccda2d9dbf1 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:38.456675 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-3bfb36c2-269c-49d3-80b0-7ccda2d9dbf1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 13:03:38.456675 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:38.456675 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 13:03:38.456675 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 13:03:38.456675 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 13:03:38.456675 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 13:03:38.456675 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 13:03:38.456675 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:03:38.456675 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 13:03:38.456675 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:38.456675 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 13:03:38.456675 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:38.456675 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:38.456675 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:38.456675 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:38.456675 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:38.456675 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:38.457682 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:38.457682 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:38.457682 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:38.457682 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:38.457682 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:38.457682 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:38.457682 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 13:03:38.457682 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 13:03:38.457682 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 13:03:38.457682 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 13:03:38.457682 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:38.457682 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:38.457682 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:38.457682 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:38.457682 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:38.457682 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:38.458523 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:38.458523 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:38.458523 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:38.458523 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:38.458523 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:38.458523 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:38.458523 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:38.458523 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:38.458523 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:38.458523 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:38.458523 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 13:03:38.458523 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:03:38.458523 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 13:03:38.458523 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:38.458523 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 458/915] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jun 3 13:03:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:38.463839 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5503f-1480-4a5d-828c-4e55d6174751 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:38.573284 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5503f-1480-4a5d-828c-4e55d6174751 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:38.604805 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:38.611530 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c8d10-42a3-4675-99ff-670ded861d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:38.612613 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c8d10-42a3-4675-99ff-670ded861d0a None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:38.613167 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c8d10-42a3-4675-99ff-670ded861d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:38.613642 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c8d10-42a3-4675-99ff-670ded861d0a None admin] PATH_INFO: `/v3/services` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:38.614568 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c8d10-42a3-4675-99ff-670ded861d0a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:38.615070 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c8d10-42a3-4675-99ff-670ded861d0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:38.616713 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c8d10-42a3-4675-99ff-670ded861d0a None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:38.622391 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 458/916] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jun 3 13:03:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:38.632170 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb36c2-269c-49d3-80b0-7ccda2d9dbf1 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:38.732063 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb36c2-269c-49d3-80b0-7ccda2d9dbf1 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:38.756473 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:38.767671 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65cb816-d6db-4505-a01d-65c9b6c05e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:38.768363 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65cb816-d6db-4505-a01d-65c9b6c05e89 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:38.768645 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65cb816-d6db-4505-a01d-65c9b6c05e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:38.768915 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65cb816-d6db-4505-a01d-65c9b6c05e89 None admin] PATH_INFO: `/v3/services` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:38.769616 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65cb816-d6db-4505-a01d-65c9b6c05e89 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:38.769917 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65cb816-d6db-4505-a01d-65c9b6c05e89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:38.771287 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65cb816-d6db-4505-a01d-65c9b6c05e89 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:38.776558 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 459/917] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jun 3 13:03:38 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:38.783316 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c8d10-42a3-4675-99ff-670ded861d0a None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:38.892024 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c8d10-42a3-4675-99ff-670ded861d0a None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:38.932539 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081d6a2-b3ef-47cc-ba3c-5b3f77b7517b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:38.933195 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081d6a2-b3ef-47cc-ba3c-5b3f77b7517b None admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:38.933473 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081d6a2-b3ef-47cc-ba3c-5b3f77b7517b None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:38.933745 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081d6a2-b3ef-47cc-ba3c-5b3f77b7517b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:38.934472 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2081d6a2-b3ef-47cc-ba3c-5b3f77b7517b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:38.936612 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2081d6a2-b3ef-47cc-ba3c-5b3f77b7517b None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:39.007090 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 459/918] 10.222.0.61 () {60 vars in 1144 bytes} [Fri Jun 3 13:03:38 2022] POST /identity/v3/endpoints => generated 346 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:03:39.546164 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f32f52-0f51-4188-9f0b-1850c8603baa None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:39.546468 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f32f52-0f51-4188-9f0b-1850c8603baa None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:39.546843 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f32f52-0f51-4188-9f0b-1850c8603baa None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:39.548328 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 460/919] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:03:39.553945 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3240f1-bb70-48bf-8cab-f08113d4b4a8 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:39.554236 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3240f1-bb70-48bf-8cab-f08113d4b4a8 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:39.554509 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3240f1-bb70-48bf-8cab-f08113d4b4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:39.571712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-0c3240f1-bb70-48bf-8cab-f08113d4b4a8 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:39.572920 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-0c3240f1-bb70-48bf-8cab-f08113d4b4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:39.618298 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:39.649644 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 460/920] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:03:39.672991 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f32f52-0f51-4188-9f0b-1850c8603baa None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:39.779342 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f32f52-0f51-4188-9f0b-1850c8603baa None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:39.816254 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beccf57-3623-4dd6-b2b9-b39e5cfb1bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:39.816990 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beccf57-3623-4dd6-b2b9-b39e5cfb1bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:39.817278 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beccf57-3623-4dd6-b2b9-b39e5cfb1bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:39.817551 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beccf57-3623-4dd6-b2b9-b39e5cfb1bc0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:39.818202 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beccf57-3623-4dd6-b2b9-b39e5cfb1bc0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:39.819565 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beccf57-3623-4dd6-b2b9-b39e5cfb1bc0 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:39.832756 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-9beccf57-3623-4dd6-b2b9-b39e5cfb1bc0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 13:03:39.832756 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:39.832756 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 13:03:39.832756 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 13:03:39.832756 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 13:03:39.832756 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 13:03:39.832756 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 13:03:39.832756 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:03:39.832756 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 13:03:39.832756 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:39.832756 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 13:03:39.832756 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:39.832756 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:39.832756 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:39.832756 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:39.832756 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:39.833748 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:39.833748 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:39.833748 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:39.833748 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:39.833748 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:39.833748 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:39.833748 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:39.833748 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 13:03:39.833748 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 13:03:39.833748 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 13:03:39.833748 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 13:03:39.833748 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:39.833748 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:39.833748 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:39.833748 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:39.833748 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:39.834582 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:39.834582 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:39.834582 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:39.834582 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:39.834582 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:39.834582 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:39.834582 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:39.834582 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:39.834582 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:39.834582 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:39.834582 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:39.834582 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 13:03:39.834582 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:03:39.834582 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 13:03:39.834582 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:39.834582 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 461/921] 10.222.0.61 () {56 vars in 1132 bytes} [Fri Jun 3 13:03:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:39.840249 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3240f1-bb70-48bf-8cab-f08113d4b4a8 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:39.956011 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3240f1-bb70-48bf-8cab-f08113d4b4a8 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:39.996051 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac036722-2bfe-472e-892f-257e3ac8b575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:39.996756 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac036722-2bfe-472e-892f-257e3ac8b575 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:39.997036 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac036722-2bfe-472e-892f-257e3ac8b575 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:39.997307 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac036722-2bfe-472e-892f-257e3ac8b575 None admin] PATH_INFO: `/v3/services` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:39.998009 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac036722-2bfe-472e-892f-257e3ac8b575 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:39.999919 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac036722-2bfe-472e-892f-257e3ac8b575 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:40.001334 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac036722-2bfe-472e-892f-257e3ac8b575 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:40.006603 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 461/922] 10.222.0.61 () {56 vars in 1126 bytes} [Fri Jun 3 13:03:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:40.012210 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beccf57-3623-4dd6-b2b9-b39e5cfb1bc0 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:40.066044 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:40.121806 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beccf57-3623-4dd6-b2b9-b39e5cfb1bc0 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:40.156837 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7548ec-2e8f-428a-97b8-d82c5a9fc703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:40.157504 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7548ec-2e8f-428a-97b8-d82c5a9fc703 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:40.157786 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7548ec-2e8f-428a-97b8-d82c5a9fc703 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:40.158061 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7548ec-2e8f-428a-97b8-d82c5a9fc703 None admin] PATH_INFO: `/v3/services` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:40.158772 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7548ec-2e8f-428a-97b8-d82c5a9fc703 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:40.159079 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7548ec-2e8f-428a-97b8-d82c5a9fc703 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:40.160492 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7548ec-2e8f-428a-97b8-d82c5a9fc703 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:40.165928 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 462/923] 10.222.0.61 () {56 vars in 1126 bytes} [Fri Jun 3 13:03:40 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:40.171873 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac036722-2bfe-472e-892f-257e3ac8b575 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:40.214002 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:40.254657 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8a833-30e6-4901-8826-2d0ad5cf67a7 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:40.255311 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8a833-30e6-4901-8826-2d0ad5cf67a7 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:40.255790 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8a833-30e6-4901-8826-2d0ad5cf67a7 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:40.257772 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 463/924] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 13:03:40.265893 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51d36e-e132-4efc-bc8f-cb3cad314771 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:40.266475 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51d36e-e132-4efc-bc8f-cb3cad314771 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:40.266981 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51d36e-e132-4efc-bc8f-cb3cad314771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:40.288089 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-aa51d36e-e132-4efc-bc8f-cb3cad314771 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:40.288909 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac036722-2bfe-472e-892f-257e3ac8b575 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:40.289864 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-aa51d36e-e132-4efc-bc8f-cb3cad314771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:40.333472 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39054f3-82c4-4c42-95a4-a09ad152424b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:40.334137 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39054f3-82c4-4c42-95a4-a09ad152424b None admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:40.334420 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39054f3-82c4-4c42-95a4-a09ad152424b None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:40.334695 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39054f3-82c4-4c42-95a4-a09ad152424b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:40.335442 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39054f3-82c4-4c42-95a4-a09ad152424b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:40.336829 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39054f3-82c4-4c42-95a4-a09ad152424b None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:40.381464 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 464/925] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:03:40.403560 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51d36e-e132-4efc-bc8f-cb3cad314771 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:40.439124 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 462/926] 10.222.0.61 () {60 vars in 1144 bytes} [Fri Jun 3 13:03:40 2022] POST /identity/v3/endpoints => generated 347 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:40.454006 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff8cd2-0525-4ed5-92bf-c62b93b7414c None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:40.454355 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff8cd2-0525-4ed5-92bf-c62b93b7414c None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:40.454548 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff8cd2-0525-4ed5-92bf-c62b93b7414c None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:40.456804 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 463/927] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 13:03:40.462036 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff76c9-d008-44e0-8989-c83dc3c5a372 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:40.462358 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff76c9-d008-44e0-8989-c83dc3c5a372 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:40.462586 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff76c9-d008-44e0-8989-c83dc3c5a372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:40.466204 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:40.482186 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-52ff76c9-d008-44e0-8989-c83dc3c5a372 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:40.483541 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-52ff76c9-d008-44e0-8989-c83dc3c5a372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:40.541805 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51d36e-e132-4efc-bc8f-cb3cad314771 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:40.575353 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 464/928] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 13:03:40.585656 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1bcab-6ff2-4256-8480-1d7b40b83886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:40.586800 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1bcab-6ff2-4256-8480-1d7b40b83886 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:40.587267 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1bcab-6ff2-4256-8480-1d7b40b83886 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:40.587719 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1bcab-6ff2-4256-8480-1d7b40b83886 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:40.595601 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff76c9-d008-44e0-8989-c83dc3c5a372 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:40.602627 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea1bcab-6ff2-4256-8480-1d7b40b83886 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:03:40.613958 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-7ea1bcab-6ff2-4256-8480-1d7b40b83886 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 13:03:40.613958 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:40.613958 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:40.613958 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:40.613958 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:40.613958 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:40.613958 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:40.613958 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:40.613958 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:40.613958 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:40.613958 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:40.613958 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:40.613958 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:03:40.613958 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:03:40.613958 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:03:40.613958 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:03:40.614960 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:03:40.614960 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:03:40.614960 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:03:40.614960 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:03:40.614960 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:40.614960 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:40.614960 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:40.614960 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:40.614960 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:40.614960 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:40.614960 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:40.614960 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:40.614960 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:40.614960 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:40.614960 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:40.614960 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:40.615820 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:40.615820 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:40.615820 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:40.615820 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:40.615820 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:03:40.615820 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:03:40.615820 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:03:40.615820 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:03:40.615820 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:03:40.615820 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:03:40.615820 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 13:03:40.615820 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:40.618127 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:40.618553 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 465/929] 10.222.0.61 () {56 vars in 1120 bytes} [Fri Jun 3 13:03:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:03:40.624201 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1bcab-6ff2-4256-8480-1d7b40b83886 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:40.721584 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff76c9-d008-44e0-8989-c83dc3c5a372 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:40.756065 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1bcab-6ff2-4256-8480-1d7b40b83886 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:40.761619 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8a624-4433-4475-959f-646e76f178e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:40.762652 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8a624-4433-4475-959f-646e76f178e3 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:40.763147 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8a624-4433-4475-959f-646e76f178e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:40.763560 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8a624-4433-4475-959f-646e76f178e3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:40.764979 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c8a624-4433-4475-959f-646e76f178e3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:40.765123 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:40.766701 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c8a624-4433-4475-959f-646e76f178e3 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:40.779830 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-88c8a624-4433-4475-959f-646e76f178e3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 13:03:40.779830 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:40.779830 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 13:03:40.779830 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 13:03:40.779830 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 13:03:40.779830 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 13:03:40.779830 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 13:03:40.779830 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:03:40.779830 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 13:03:40.779830 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:40.779830 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 13:03:40.779830 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:40.779830 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:40.779830 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:40.779830 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:40.779830 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:40.779830 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:40.781118 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:40.781118 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:40.781118 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:40.781118 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:40.781118 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:40.781118 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:40.781118 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 13:03:40.781118 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 13:03:40.781118 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 13:03:40.781118 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 13:03:40.781118 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:40.781118 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:40.781118 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:40.781118 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:40.781118 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:40.781118 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:40.782086 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:40.782086 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:40.782086 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:40.782086 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:40.782086 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:40.782086 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:40.782086 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:40.782086 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:40.782086 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:40.782086 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:40.782086 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 13:03:40.782086 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:03:40.782086 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 13:03:40.782086 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:40.784595 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 465/930] 10.222.0.61 () {56 vars in 1126 bytes} [Fri Jun 3 13:03:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:40.790971 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8a624-4433-4475-959f-646e76f178e3 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:40.796999 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701d2cf-f36e-40ef-9157-a0408ffe82d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:40.797680 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701d2cf-f36e-40ef-9157-a0408ffe82d7 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:40.797966 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701d2cf-f36e-40ef-9157-a0408ffe82d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:40.798247 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701d2cf-f36e-40ef-9157-a0408ffe82d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:40.798993 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1701d2cf-f36e-40ef-9157-a0408ffe82d7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:40.799303 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1701d2cf-f36e-40ef-9157-a0408ffe82d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:40.800769 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1701d2cf-f36e-40ef-9157-a0408ffe82d7 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:40.814053 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 466/931] 10.222.0.61 () {56 vars in 1115 bytes} [Fri Jun 3 13:03:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:03:40.819643 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701d2cf-f36e-40ef-9157-a0408ffe82d7 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:40.903958 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:40.929269 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8a624-4433-4475-959f-646e76f178e3 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:40.930530 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701d2cf-f36e-40ef-9157-a0408ffe82d7 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:40.966716 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8547c6bb-48ef-4bf0-b1c9-f15a47561322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:40.968308 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547c6bb-48ef-4bf0-b1c9-f15a47561322 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:40.968748 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547c6bb-48ef-4bf0-b1c9-f15a47561322 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:40.968863 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bfbdd0-7c7f-405a-8a56-4d6eba127b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:40.969284 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547c6bb-48ef-4bf0-b1c9-f15a47561322 None admin] PATH_INFO: `/v3/services` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:40.969556 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfbdd0-7c7f-405a-8a56-4d6eba127b25 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:40.969846 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfbdd0-7c7f-405a-8a56-4d6eba127b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:40.970201 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfbdd0-7c7f-405a-8a56-4d6eba127b25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:40.970853 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8547c6bb-48ef-4bf0-b1c9-f15a47561322 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:40.971412 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8547c6bb-48ef-4bf0-b1c9-f15a47561322 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:40.973268 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8547c6bb-48ef-4bf0-b1c9-f15a47561322 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:40.983514 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 466/932] 10.222.0.61 () {56 vars in 1122 bytes} [Fri Jun 3 13:03:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:40.983690 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bfbdd0-7c7f-405a-8a56-4d6eba127b25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:40.985070 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bfbdd0-7c7f-405a-8a56-4d6eba127b25 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:40.986333 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8547c6bb-48ef-4bf0-b1c9-f15a47561322 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:41.015148 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-31bfbdd0-7c7f-405a-8a56-4d6eba127b25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:41.015148 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:41.015148 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:41.015148 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:41.015148 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:41.015148 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:41.015148 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:41.015148 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:41.015148 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:41.015148 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:41.015148 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:41.015148 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:41.015148 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:03:41.015148 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:03:41.015148 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:03:41.016309 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:03:41.016309 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:41.016309 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:41.016309 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:41.016309 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:41.016309 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:41.016309 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:41.016309 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:41.016309 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:41.016309 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:41.016309 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:41.016309 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:41.016309 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:41.016309 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:41.016309 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:41.016309 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:41.016309 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:41.017260 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:03:41.017260 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:03:41.017260 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:41.017260 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:41.021399 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 467/933] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:03:41.022245 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bfbdd0-7c7f-405a-8a56-4d6eba127b25 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:41.045907 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:41.099875 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8547c6bb-48ef-4bf0-b1c9-f15a47561322 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:41.135015 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bfbdd0-7c7f-405a-8a56-4d6eba127b25 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:41.138021 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca463a1-5e87-492b-9680-db40f4fe01b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:41.139268 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca463a1-5e87-492b-9680-db40f4fe01b7 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:41.139887 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca463a1-5e87-492b-9680-db40f4fe01b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:41.140422 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca463a1-5e87-492b-9680-db40f4fe01b7 None admin] PATH_INFO: `/v3/services` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:41.141359 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca463a1-5e87-492b-9680-db40f4fe01b7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:41.141901 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca463a1-5e87-492b-9680-db40f4fe01b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:41.143550 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca463a1-5e87-492b-9680-db40f4fe01b7 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:41.154021 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 467/934] 10.222.0.61 () {56 vars in 1122 bytes} [Fri Jun 3 13:03:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:03:41.155349 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca463a1-5e87-492b-9680-db40f4fe01b7 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:41.170904 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321bfcdd-0f99-483b-9c5b-45661be82a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:41.171579 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321bfcdd-0f99-483b-9c5b-45661be82a5b None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:41.171864 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321bfcdd-0f99-483b-9c5b-45661be82a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:41.172140 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321bfcdd-0f99-483b-9c5b-45661be82a5b None admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:41.172878 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321bfcdd-0f99-483b-9c5b-45661be82a5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:41.173184 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321bfcdd-0f99-483b-9c5b-45661be82a5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:41.174557 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321bfcdd-0f99-483b-9c5b-45661be82a5b None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:41.186932 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 468/935] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:03:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:03:41.191464 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:41.192591 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321bfcdd-0f99-483b-9c5b-45661be82a5b None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:41.268077 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca463a1-5e87-492b-9680-db40f4fe01b7 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:41.281395 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:41.302804 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321bfcdd-0f99-483b-9c5b-45661be82a5b None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:41.315155 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73d744-3aab-44c2-93eb-d30d0ced7ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:41.316222 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73d744-3aab-44c2-93eb-d30d0ced7ff5 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:41.316667 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73d744-3aab-44c2-93eb-d30d0ced7ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:41.317795 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73d744-3aab-44c2-93eb-d30d0ced7ff5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:41.318666 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b73d744-3aab-44c2-93eb-d30d0ced7ff5 None admin] RBAC: Adding query filter params (interface=public, service_id=a7afc3b9c01f4ece8475f24e24a4e7a4, region_id=RegionOne) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:41.318973 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b73d744-3aab-44c2-93eb-d30d0ced7ff5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:41.321361 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b73d744-3aab-44c2-93eb-d30d0ced7ff5 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:41.332311 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 468/936] 10.222.0.61 () {56 vars in 1251 bytes} [Fri Jun 3 13:03:41 2022] GET /identity/v3/endpoints?service_id=a7afc3b9c01f4ece8475f24e24a4e7a4&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:41.333836 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73d744-3aab-44c2-93eb-d30d0ced7ff5 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:41.348331 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83040d6-e362-4ef8-9fd6-303bb907ad27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:41.349242 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83040d6-e362-4ef8-9fd6-303bb907ad27 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:41.349540 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83040d6-e362-4ef8-9fd6-303bb907ad27 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:41.349904 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83040d6-e362-4ef8-9fd6-303bb907ad27 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:41.358611 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83040d6-e362-4ef8-9fd6-303bb907ad27 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:41.360134 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83040d6-e362-4ef8-9fd6-303bb907ad27 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:41.376682 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-a83040d6-e362-4ef8-9fd6-303bb907ad27 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 13:03:41.376682 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:41.376682 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:41.376682 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:41.376682 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:41.376682 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:41.376682 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:41.376682 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:41.376682 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:41.376682 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:41.376682 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:41.376682 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:41.376682 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 13:03:41.376682 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 13:03:41.376682 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 13:03:41.376682 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 13:03:41.377696 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:41.377696 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:41.377696 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 13:03:41.377696 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:03:41.377696 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 13:03:41.377696 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:03:41.377696 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:41.377696 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:41.377696 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:41.377696 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:41.377696 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:41.377696 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:41.377696 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:41.377696 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:41.377696 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:41.377696 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:41.377696 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:41.377696 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:41.378644 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:41.378644 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:41.378644 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 13:03:41.378644 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 13:03:41.378644 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 13:03:41.378644 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 13:03:41.378644 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 13:03:41.378644 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 13:03:41.378644 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 13:03:41.378644 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:41.382634 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 469/937] 10.222.0.61 () {56 vars in 1117 bytes} [Fri Jun 3 13:03:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:41.384395 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83040d6-e362-4ef8-9fd6-303bb907ad27 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:41.430165 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:41.461138 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73d744-3aab-44c2-93eb-d30d0ced7ff5 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:41.497362 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83040d6-e362-4ef8-9fd6-303bb907ad27 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:41.502619 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484d3dd-582d-4300-8731-8c159d4c5678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:41.503287 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484d3dd-582d-4300-8731-8c159d4c5678 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:41.503572 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484d3dd-582d-4300-8731-8c159d4c5678 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:41.503848 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484d3dd-582d-4300-8731-8c159d4c5678 None admin] PATH_INFO: `/v3/services` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:41.504556 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f484d3dd-582d-4300-8731-8c159d4c5678 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:41.505953 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f484d3dd-582d-4300-8731-8c159d4c5678 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:41.520264 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 469/938] 10.222.0.61 () {56 vars in 1087 bytes} [Fri Jun 3 13:03:41 2022] GET /identity/v3/services => generated 1497 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:03:41.520264 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e4c3b-c072-4c7e-9c27-e43993362365 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:41.520264 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e4c3b-c072-4c7e-9c27-e43993362365 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:41.520264 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e4c3b-c072-4c7e-9c27-e43993362365 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:41.520264 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 470/939] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:03:41.522147 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477964f1-52ab-47a8-8c85-31fb40b03a05 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:41.522440 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477964f1-52ab-47a8-8c85-31fb40b03a05 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:41.522713 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477964f1-52ab-47a8-8c85-31fb40b03a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:41.545989 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-477964f1-52ab-47a8-8c85-31fb40b03a05 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:41.546522 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa59ff6-a830-4e06-a8d2-de75077d255c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:41.547406 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa59ff6-a830-4e06-a8d2-de75077d255c None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:41.547577 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-477964f1-52ab-47a8-8c85-31fb40b03a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:41.547817 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa59ff6-a830-4e06-a8d2-de75077d255c None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:41.548223 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa59ff6-a830-4e06-a8d2-de75077d255c None admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:41.549257 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa59ff6-a830-4e06-a8d2-de75077d255c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:41.549636 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa59ff6-a830-4e06-a8d2-de75077d255c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:41.551259 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa59ff6-a830-4e06-a8d2-de75077d255c None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:41.563055 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:41.573005 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 470/940] 10.222.0.61 () {56 vars in 1149 bytes} [Fri Jun 3 13:03:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:03:41.579680 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa59ff6-a830-4e06-a8d2-de75077d255c None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:41.648349 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 471/941] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 13:03:41.678204 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477964f1-52ab-47a8-8c85-31fb40b03a05 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:41.713298 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa59ff6-a830-4e06-a8d2-de75077d255c None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:41.755821 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f5fba8-1886-4e3b-bfc9-4917aba5eea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:41.756926 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5fba8-1886-4e3b-bfc9-4917aba5eea5 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:41.757469 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5fba8-1886-4e3b-bfc9-4917aba5eea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:41.757656 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5fba8-1886-4e3b-bfc9-4917aba5eea5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:41.766262 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:41.769883 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f5fba8-1886-4e3b-bfc9-4917aba5eea5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:41.771420 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f5fba8-1886-4e3b-bfc9-4917aba5eea5 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:41.790919 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-47f5fba8-1886-4e3b-bfc9-4917aba5eea5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:41.790919 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:41.790919 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:41.790919 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:41.790919 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:41.790919 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:41.790919 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:41.790919 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:41.790919 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:41.790919 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:41.790919 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:41.790919 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:41.790919 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:03:41.790919 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:03:41.790919 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:03:41.792503 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:03:41.792503 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:41.792503 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:41.792503 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:41.792503 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:41.792503 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:41.792503 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:41.792503 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:41.792503 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:41.792503 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:41.792503 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:41.792503 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:41.792503 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:41.792503 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:41.792503 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:41.792503 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:41.792503 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:41.794240 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:03:41.794240 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:03:41.794240 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:41.794240 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:41.794240 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 471/942] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:03:41.799515 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f5fba8-1886-4e3b-bfc9-4917aba5eea5 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:41.817462 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477964f1-52ab-47a8-8c85-31fb40b03a05 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:41.855636 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857a910-fb87-491b-8094-0ea07eadf883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:41.856714 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857a910-fb87-491b-8094-0ea07eadf883 None admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:41.857251 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857a910-fb87-491b-8094-0ea07eadf883 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:41.858329 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857a910-fb87-491b-8094-0ea07eadf883 None admin] PATH_INFO: `/v3/projects` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:41.859274 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1857a910-fb87-491b-8094-0ea07eadf883 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:41.861234 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1857a910-fb87-491b-8094-0ea07eadf883 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:41.862953 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: WARNING keystone.server.flask.common [None req-1857a910-fb87-491b-8094-0ea07eadf883 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 03 13:03:41.876594 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:41.916655 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f5fba8-1886-4e3b-bfc9-4917aba5eea5 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:41.935113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.sql.core [None req-1857a910-fb87-491b-8094-0ea07eadf883 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 03 13:03:41.935113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 03 13:03:41.935113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [parameters: {'id': 'b1341c0290a343da963939028d59b2f4', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 03 13:03:41.935113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80571) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 03 13:03:41.946647 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-1857a910-fb87-491b-8094-0ea07eadf883 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b1341c0290a343da963939028d59b2f4.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b1341c0290a343da963939028d59b2f4. Jun 03 13:03:41.946647 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:41.946647 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 03 13:03:41.946647 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 03 13:03:41.946647 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 03 13:03:41.946647 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 03 13:03:41.946647 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 03 13:03:41.946647 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application result = self._query(query) Jun 03 13:03:41.946647 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 03 13:03:41.946647 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application conn.query(q) Jun 03 13:03:41.946647 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 03 13:03:41.946647 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 03 13:03:41.946647 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 03 13:03:41.947508 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application result.read() Jun 03 13:03:41.947508 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 03 13:03:41.947508 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 03 13:03:41.947508 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 03 13:03:41.947508 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 03 13:03:41.947508 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 03 13:03:41.947508 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 03 13:03:41.947508 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 03 13:03:41.947508 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 03 13:03:41.947508 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 03 13:03:41.947508 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:41.947508 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 03 13:03:41.947508 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:41.947508 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:41.947508 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 03 13:03:41.947508 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 03 13:03:41.947508 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 03 13:03:41.947508 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 03 13:03:41.948511 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 03 13:03:41.948511 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application next(self.gen) Jun 03 13:03:41.948511 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 03 13:03:41.948511 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application yield resource Jun 03 13:03:41.948511 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 03 13:03:41.948511 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application next(self.gen) Jun 03 13:03:41.948511 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 03 13:03:41.948511 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application self.session.rollback() Jun 03 13:03:41.948511 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 03 13:03:41.948511 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application self.force_reraise() Jun 03 13:03:41.948511 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 03 13:03:41.948511 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise self.value Jun 03 13:03:41.948511 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 03 13:03:41.948511 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 03 13:03:41.948511 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 03 13:03:41.948511 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application session.commit() Jun 03 13:03:41.948511 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 03 13:03:41.949414 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 03 13:03:41.949414 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 03 13:03:41.949414 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application self._prepare_impl() Jun 03 13:03:41.949414 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 03 13:03:41.949414 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application self.session.flush() Jun 03 13:03:41.949414 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 03 13:03:41.949414 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application self._flush(objects) Jun 03 13:03:41.949414 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 03 13:03:41.949414 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 03 13:03:41.949414 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 03 13:03:41.949414 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application compat.raise_( Jun 03 13:03:41.949414 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 03 13:03:41.949414 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception Jun 03 13:03:41.949414 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 03 13:03:41.949414 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application flush_context.execute() Jun 03 13:03:41.949414 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 03 13:03:41.949414 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rec.execute(self) Jun 03 13:03:41.950312 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 03 13:03:41.950312 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 03 13:03:41.950312 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 03 13:03:41.950312 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 03 13:03:41.950312 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 03 13:03:41.950312 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 03 13:03:41.950312 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 03 13:03:41.950312 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 03 13:03:41.950312 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 03 13:03:41.950312 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 03 13:03:41.950312 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 03 13:03:41.950312 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 03 13:03:41.950312 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 03 13:03:41.950312 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 03 13:03:41.950312 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 03 13:03:41.951250 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 03 13:03:41.951250 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 03 13:03:41.951250 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception Jun 03 13:03:41.951250 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 03 13:03:41.951250 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 03 13:03:41.951250 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 03 13:03:41.951250 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 03 13:03:41.951250 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 03 13:03:41.951250 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application result = self._query(query) Jun 03 13:03:41.951250 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 03 13:03:41.951250 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application conn.query(q) Jun 03 13:03:41.951250 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 03 13:03:41.951250 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 03 13:03:41.951250 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 03 13:03:41.951250 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application result.read() Jun 03 13:03:41.951250 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 03 13:03:41.951250 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 03 13:03:41.964223 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 03 13:03:41.964223 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 03 13:03:41.964223 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 03 13:03:41.964223 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 03 13:03:41.964223 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 03 13:03:41.964223 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 03 13:03:41.964223 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 03 13:03:41.964223 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 03 13:03:41.964223 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [parameters: {'id': 'b1341c0290a343da963939028d59b2f4', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 03 13:03:41.964223 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 03 13:03:41.964223 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:41.964223 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 13:03:41.964223 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:41.964223 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:41.964223 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 03 13:03:41.965086 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 03 13:03:41.965086 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 03 13:03:41.965086 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 03 13:03:41.965086 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 03 13:03:41.965086 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:41.965086 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 13:03:41.965086 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:41.965086 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:41.965086 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:41.965086 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:41.965086 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:41.965086 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:41.965086 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:41.965086 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:41.965086 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:41.965086 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:41.965086 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:41.966670 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:41.966670 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 03 13:03:41.966670 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 03 13:03:41.966670 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:41.966670 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:41.966670 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 03 13:03:41.966670 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 03 13:03:41.966670 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b1341c0290a343da963939028d59b2f4. Jun 03 13:03:41.966670 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:41.966670 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 472/943] 10.222.0.61 () {60 vars in 1140 bytes} [Fri Jun 3 13:03:41 2022] POST /identity/v3/projects => generated 262 bytes in 278 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:03:41.967572 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2ef9f-0b83-4f94-a982-ecd9d9457207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:41.967572 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2ef9f-0b83-4f94-a982-ecd9d9457207 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:41.967572 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2ef9f-0b83-4f94-a982-ecd9d9457207 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:41.967572 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2ef9f-0b83-4f94-a982-ecd9d9457207 None admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:41.968038 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b2ef9f-0b83-4f94-a982-ecd9d9457207 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:41.968038 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b2ef9f-0b83-4f94-a982-ecd9d9457207 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:41.968218 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857a910-fb87-491b-8094-0ea07eadf883 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:41.968304 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b2ef9f-0b83-4f94-a982-ecd9d9457207 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:41.977805 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 472/944] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:03:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:03:41.984015 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2ef9f-0b83-4f94-a982-ecd9d9457207 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:42.102921 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2ef9f-0b83-4f94-a982-ecd9d9457207 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:42.103825 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857a910-fb87-491b-8094-0ea07eadf883 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:42.121519 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:42.139432 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:42.141362 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e047c-2dc2-4bf9-aba0-45f95d294e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:42.142371 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e047c-2dc2-4bf9-aba0-45f95d294e27 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:42.142867 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e047c-2dc2-4bf9-aba0-45f95d294e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:42.143323 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e047c-2dc2-4bf9-aba0-45f95d294e27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:42.150695 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412e047c-2dc2-4bf9-aba0-45f95d294e27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:42.151461 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5b659-d38d-4b15-8326-ae4fe1ea89c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:42.152397 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412e047c-2dc2-4bf9-aba0-45f95d294e27 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:42.152628 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5b659-d38d-4b15-8326-ae4fe1ea89c3 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:42.153049 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5b659-d38d-4b15-8326-ae4fe1ea89c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:42.153465 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5b659-d38d-4b15-8326-ae4fe1ea89c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:42.161603 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5b659-d38d-4b15-8326-ae4fe1ea89c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:42.165274 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5b659-d38d-4b15-8326-ae4fe1ea89c3 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:42.172838 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-412e047c-2dc2-4bf9-aba0-45f95d294e27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:03:42.172838 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:42.172838 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:42.172838 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:42.172838 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:42.172838 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:42.172838 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:42.172838 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:42.172838 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:42.172838 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:42.172838 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:42.172838 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:42.172838 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 13:03:42.172838 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 13:03:42.172838 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 13:03:42.173753 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 13:03:42.173753 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:42.173753 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:42.173753 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:42.173753 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:42.173753 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:42.173753 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:42.173753 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:42.173753 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:42.173753 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:42.173753 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:42.173753 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:42.173753 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:42.173753 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:42.173753 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:42.173753 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:42.173753 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:42.175118 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 13:03:42.175118 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 13:03:42.175118 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 13:03:42.175118 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 13:03:42.175118 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 13:03:42.175118 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 13:03:42.175118 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:03:42.175118 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:42.179098 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 473/945] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:03:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:03:42.179940 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e047c-2dc2-4bf9-aba0-45f95d294e27 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:42.182356 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-38c5b659-d38d-4b15-8326-ae4fe1ea89c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:03:42.182356 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:42.182356 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:42.182356 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:42.182356 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:42.182356 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:42.182356 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:42.182356 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:42.182356 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:42.182356 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:42.182356 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:42.182356 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:42.182356 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 13:03:42.182356 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 13:03:42.182356 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 13:03:42.183391 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 13:03:42.183391 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:42.183391 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:42.183391 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:42.183391 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:42.183391 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:42.183391 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:42.183391 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:42.183391 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:42.183391 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:42.183391 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:42.183391 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:42.183391 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:42.183391 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:42.183391 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:42.183391 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:42.183391 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:42.184495 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 13:03:42.184495 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 13:03:42.184495 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 13:03:42.184495 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 13:03:42.184495 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 13:03:42.184495 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 13:03:42.184495 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:03:42.184495 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:42.192291 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 473/946] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:03:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:42.193948 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5b659-d38d-4b15-8326-ae4fe1ea89c3 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:42.303125 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e047c-2dc2-4bf9-aba0-45f95d294e27 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:42.320626 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5b659-d38d-4b15-8326-ae4fe1ea89c3 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:42.338846 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ce645-2ad5-4615-a313-4afd63ed5177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:42.339769 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ce645-2ad5-4615-a313-4afd63ed5177 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:42.340275 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ce645-2ad5-4615-a313-4afd63ed5177 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:42.340692 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ce645-2ad5-4615-a313-4afd63ed5177 None admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:42.341630 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ce645-2ad5-4615-a313-4afd63ed5177 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:42.342643 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ce645-2ad5-4615-a313-4afd63ed5177 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:42.344337 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ce645-2ad5-4615-a313-4afd63ed5177 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:42.358455 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 474/947] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 13:03:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:42.362879 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9dcd07-d8fc-4075-bf6d-be3673f2187b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:42.363742 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9dcd07-d8fc-4075-bf6d-be3673f2187b None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:42.364028 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9dcd07-d8fc-4075-bf6d-be3673f2187b None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:42.365050 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ce645-2ad5-4615-a313-4afd63ed5177 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:42.365583 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9dcd07-d8fc-4075-bf6d-be3673f2187b None admin] PATH_INFO: `/v3/projects` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:42.366341 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9dcd07-d8fc-4075-bf6d-be3673f2187b None admin] RBAC: Adding query filter params (name=service) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:42.367083 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9dcd07-d8fc-4075-bf6d-be3673f2187b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:42.368594 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9dcd07-d8fc-4075-bf6d-be3673f2187b None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:42.404176 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 474/948] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Jun 3 13:03:42 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:42.412551 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:42.488443 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ce645-2ad5-4615-a313-4afd63ed5177 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:42.529980 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6fa93-18f2-44ab-bf71-233355227979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:42.530975 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6fa93-18f2-44ab-bf71-233355227979 None admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:42.531253 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6fa93-18f2-44ab-bf71-233355227979 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:42.531564 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6fa93-18f2-44ab-bf71-233355227979 None admin] PATH_INFO: `/v3/projects/c8c0bf799c9f451b8167a646a5c82eda/users/06c55d0ea52f40ae9125d2efe1d159a3/roles/597251d134b24da6a79c4005736005a4` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:42.534057 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6fa93-18f2-44ab-bf71-233355227979 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8c0bf799c9f451b8167a646a5c82eda, user_id=06c55d0ea52f40ae9125d2efe1d159a3, role_id=597251d134b24da6a79c4005736005a4)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:42.535754 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6fa93-18f2-44ab-bf71-233355227979 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:42.605459 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 475/949] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jun 3 13:03:42 2022] PUT /identity/v3/projects/c8c0bf799c9f451b8167a646a5c82eda/users/06c55d0ea52f40ae9125d2efe1d159a3/roles/597251d134b24da6a79c4005736005a4 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:03:42.874609 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40132234-16cd-4878-b585-17dd8c2835f5 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:42.875145 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40132234-16cd-4878-b585-17dd8c2835f5 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:42.875145 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40132234-16cd-4878-b585-17dd8c2835f5 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:42.876820 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 475/950] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:03:42.882497 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d2a94-40f8-42c2-a201-4a3c551c291e None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:42.882938 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d2a94-40f8-42c2-a201-4a3c551c291e None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:42.883140 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d2a94-40f8-42c2-a201-4a3c551c291e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:42.902770 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-307d2a94-40f8-42c2-a201-4a3c551c291e None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:42.904056 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-307d2a94-40f8-42c2-a201-4a3c551c291e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:42.977163 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 476/951] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:03:43.000859 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40132234-16cd-4878-b585-17dd8c2835f5 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:43.054354 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:43.113937 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40132234-16cd-4878-b585-17dd8c2835f5 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:43.149463 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa2332-19d2-4282-8a08-18497eef36ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:43.150202 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa2332-19d2-4282-8a08-18497eef36ab None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:43.150486 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa2332-19d2-4282-8a08-18497eef36ab None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:43.150762 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa2332-19d2-4282-8a08-18497eef36ab None admin] PATH_INFO: `/v3/services/compute` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:43.151415 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aa2332-19d2-4282-8a08-18497eef36ab None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:43.152888 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aa2332-19d2-4282-8a08-18497eef36ab None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:43.165359 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-95aa2332-19d2-4282-8a08-18497eef36ab None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 13:03:43.165359 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:43.165359 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 13:03:43.165359 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 13:03:43.165359 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 13:03:43.165359 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 13:03:43.165359 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 13:03:43.165359 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:03:43.165359 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 13:03:43.165359 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:43.165359 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 13:03:43.165359 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:43.165359 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:43.165359 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:43.165359 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:43.165359 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:43.165359 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:43.166470 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:43.166470 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:43.166470 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:43.166470 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:43.166470 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:43.166470 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:43.166470 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 13:03:43.166470 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 13:03:43.166470 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 13:03:43.166470 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 13:03:43.166470 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:43.166470 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:43.166470 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:43.166470 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:43.166470 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:43.166470 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:43.167771 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:43.167771 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:43.167771 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:43.167771 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:43.167771 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:43.167771 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:43.167771 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:43.167771 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:43.167771 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:43.167771 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:43.167771 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 13:03:43.167771 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:03:43.167771 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 13:03:43.167771 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:43.167771 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 476/952] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:03:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:43.175809 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d2a94-40f8-42c2-a201-4a3c551c291e None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:43.198947 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:43.284490 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d2a94-40f8-42c2-a201-4a3c551c291e None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:43.321349 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a578043d-e207-46f9-9017-f93396214ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:43.322018 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578043d-e207-46f9-9017-f93396214ceb None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:43.322326 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578043d-e207-46f9-9017-f93396214ceb None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:43.322602 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578043d-e207-46f9-9017-f93396214ceb None admin] PATH_INFO: `/v3/services` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:43.323313 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a578043d-e207-46f9-9017-f93396214ceb None admin] RBAC: Adding query filter params (name=compute) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:43.323618 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a578043d-e207-46f9-9017-f93396214ceb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:43.325039 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a578043d-e207-46f9-9017-f93396214ceb None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:43.331320 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 477/953] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Jun 3 13:03:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:43.337226 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa2332-19d2-4282-8a08-18497eef36ab None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:43.441083 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa2332-19d2-4282-8a08-18497eef36ab None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:43.451151 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:43.478822 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f49b5-c29e-4dd4-bf08-69d91c5c2210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:43.479498 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f49b5-c29e-4dd4-bf08-69d91c5c2210 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:43.479784 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f49b5-c29e-4dd4-bf08-69d91c5c2210 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:43.480061 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f49b5-c29e-4dd4-bf08-69d91c5c2210 None admin] PATH_INFO: `/v3/services` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:43.480804 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f49b5-c29e-4dd4-bf08-69d91c5c2210 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:43.481150 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f49b5-c29e-4dd4-bf08-69d91c5c2210 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:43.482599 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f49b5-c29e-4dd4-bf08-69d91c5c2210 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:43.488242 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 477/954] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Jun 3 13:03:43 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:43.925433 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a0399-b6e1-4625-b936-a2371b7e11a8 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:43.925975 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a0399-b6e1-4625-b936-a2371b7e11a8 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:43.925975 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a0399-b6e1-4625-b936-a2371b7e11a8 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:43.927565 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 478/955] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:03:43.933087 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746568c-ee13-457c-beb1-ea465ef8418c None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:43.933533 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746568c-ee13-457c-beb1-ea465ef8418c None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:43.933615 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746568c-ee13-457c-beb1-ea465ef8418c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:43.950958 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-5746568c-ee13-457c-beb1-ea465ef8418c None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:43.953033 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-5746568c-ee13-457c-beb1-ea465ef8418c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:44.030995 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 478/956] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:03:44.052922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a0399-b6e1-4625-b936-a2371b7e11a8 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:44.137831 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:44.153597 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a0399-b6e1-4625-b936-a2371b7e11a8 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:44.189247 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732f21b-7a29-4cc6-b024-2fd923082a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:44.189983 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732f21b-7a29-4cc6-b024-2fd923082a18 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:44.190265 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732f21b-7a29-4cc6-b024-2fd923082a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:44.190544 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732f21b-7a29-4cc6-b024-2fd923082a18 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:44.191262 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732f21b-7a29-4cc6-b024-2fd923082a18 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:44.193073 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732f21b-7a29-4cc6-b024-2fd923082a18 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:44.206476 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-4732f21b-7a29-4cc6-b024-2fd923082a18 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 13:03:44.206476 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:44.206476 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 13:03:44.206476 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 13:03:44.206476 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 13:03:44.206476 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 13:03:44.206476 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 13:03:44.206476 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:03:44.206476 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 13:03:44.206476 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:44.206476 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 13:03:44.206476 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:44.206476 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:44.206476 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:44.206476 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:44.206476 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:44.206476 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:44.207563 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:44.207563 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:44.207563 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:44.207563 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:44.207563 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:44.207563 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:44.207563 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 13:03:44.207563 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 13:03:44.207563 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 13:03:44.207563 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 13:03:44.207563 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:44.207563 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:44.207563 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:44.207563 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:44.207563 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:44.207563 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:44.208475 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:44.208475 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:44.208475 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:44.208475 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:44.208475 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:44.208475 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:44.208475 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:44.208475 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:44.208475 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:44.208475 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:44.208475 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 13:03:44.208475 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:03:44.208475 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 13:03:44.208475 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:44.208475 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 479/957] 10.222.0.61 () {56 vars in 1126 bytes} [Fri Jun 3 13:03:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:44.213802 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5746568c-ee13-457c-beb1-ea465ef8418c None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:44.319531 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5746568c-ee13-457c-beb1-ea465ef8418c None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:44.321133 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:44.357456 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d37d2-e424-4dcc-9ee4-46d4c6c7bedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:44.358174 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d37d2-e424-4dcc-9ee4-46d4c6c7bedc None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:44.358501 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d37d2-e424-4dcc-9ee4-46d4c6c7bedc None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:44.358775 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d37d2-e424-4dcc-9ee4-46d4c6c7bedc None admin] PATH_INFO: `/v3/services` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:44.359536 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d37d2-e424-4dcc-9ee4-46d4c6c7bedc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:44.359846 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d37d2-e424-4dcc-9ee4-46d4c6c7bedc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:44.361324 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d37d2-e424-4dcc-9ee4-46d4c6c7bedc None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:44.366859 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 479/958] 10.222.0.61 () {56 vars in 1122 bytes} [Fri Jun 3 13:03:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:03:44.372171 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732f21b-7a29-4cc6-b024-2fd923082a18 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:44.475991 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732f21b-7a29-4cc6-b024-2fd923082a18 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:44.510695 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf377a-dbb3-4d37-88f0-99ba16fe4725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:44.511361 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf377a-dbb3-4d37-88f0-99ba16fe4725 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:44.511642 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf377a-dbb3-4d37-88f0-99ba16fe4725 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:44.511916 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf377a-dbb3-4d37-88f0-99ba16fe4725 None admin] PATH_INFO: `/v3/services` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:44.512644 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf377a-dbb3-4d37-88f0-99ba16fe4725 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:44.512947 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf377a-dbb3-4d37-88f0-99ba16fe4725 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:44.514478 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf377a-dbb3-4d37-88f0-99ba16fe4725 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:44.519919 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 480/959] 10.222.0.61 () {56 vars in 1122 bytes} [Fri Jun 3 13:03:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:44.525470 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d37d2-e424-4dcc-9ee4-46d4c6c7bedc None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:44.638151 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d37d2-e424-4dcc-9ee4-46d4c6c7bedc None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:44.674296 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe317e-1351-40fa-b367-fb102f1794fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:44.674994 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe317e-1351-40fa-b367-fb102f1794fa None admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:44.675266 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe317e-1351-40fa-b367-fb102f1794fa None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:44.675542 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe317e-1351-40fa-b367-fb102f1794fa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:44.676351 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe317e-1351-40fa-b367-fb102f1794fa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:44.677762 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe317e-1351-40fa-b367-fb102f1794fa None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:44.776679 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 480/960] 10.222.0.61 () {60 vars in 1144 bytes} [Fri Jun 3 13:03:44 2022] POST /identity/v3/endpoints => generated 349 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:44.963803 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0b2da-b920-4a6e-8d42-9ab8cdf134a0 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:44.964355 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0b2da-b920-4a6e-8d42-9ab8cdf134a0 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:44.964657 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0b2da-b920-4a6e-8d42-9ab8cdf134a0 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:44.966422 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 481/961] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:03:44.972174 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c967c-65d1-4fca-a156-43fb0ad79d70 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:44.972712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c967c-65d1-4fca-a156-43fb0ad79d70 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:44.973244 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c967c-65d1-4fca-a156-43fb0ad79d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:44.991937 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-835c967c-65d1-4fca-a156-43fb0ad79d70 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:44.993210 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-835c967c-65d1-4fca-a156-43fb0ad79d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:45.013334 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:45.072724 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 481/962] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:03:45.097114 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fdc17-457c-439e-877d-829fece309a3 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:45.097637 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fdc17-457c-439e-877d-829fece309a3 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:45.098384 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fdc17-457c-439e-877d-829fece309a3 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:45.098803 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c967c-65d1-4fca-a156-43fb0ad79d70 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:45.100612 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 482/963] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:03:45.106025 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def427ac-ab5b-4248-a9f9-41a872b43afd None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:45.106571 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def427ac-ab5b-4248-a9f9-41a872b43afd None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:45.107057 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def427ac-ab5b-4248-a9f9-41a872b43afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:45.126979 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-def427ac-ab5b-4248-a9f9-41a872b43afd None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:45.128567 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-def427ac-ab5b-4248-a9f9-41a872b43afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:45.136669 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:45.209545 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 483/964] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 13:03:45.221294 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c967c-65d1-4fca-a156-43fb0ad79d70 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:45.234109 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def427ac-ab5b-4248-a9f9-41a872b43afd None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:45.259032 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d91408-e8c9-4c01-b7e8-9fece0aaf1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:45.259988 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d91408-e8c9-4c01-b7e8-9fece0aaf1f1 None admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:45.260461 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d91408-e8c9-4c01-b7e8-9fece0aaf1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:45.260888 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d91408-e8c9-4c01-b7e8-9fece0aaf1f1 None admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:45.261752 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d91408-e8c9-4c01-b7e8-9fece0aaf1f1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:45.263341 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d91408-e8c9-4c01-b7e8-9fece0aaf1f1 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:45.335449 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.sql.core [None req-41d91408-e8c9-4c01-b7e8-9fece0aaf1f1 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 03 13:03:45.335449 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 03 13:03:45.335449 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [parameters: {'user_id': 'ec44d02570f14269976bda60c72b88e6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 03 13:03:45.335449 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80571) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 03 13:03:45.341239 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def427ac-ab5b-4248-a9f9-41a872b43afd None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:45.345159 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-41d91408-e8c9-4c01-b7e8-9fece0aaf1f1 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 03 13:03:45.345159 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:45.345159 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 03 13:03:45.345159 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 03 13:03:45.345159 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 03 13:03:45.345159 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 03 13:03:45.345159 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 03 13:03:45.345159 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application result = self._query(query) Jun 03 13:03:45.345159 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 03 13:03:45.345159 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application conn.query(q) Jun 03 13:03:45.345159 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 03 13:03:45.345159 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 03 13:03:45.345159 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 03 13:03:45.345159 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application result.read() Jun 03 13:03:45.345159 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 03 13:03:45.346063 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 03 13:03:45.346063 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 03 13:03:45.346063 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 03 13:03:45.346063 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 03 13:03:45.346063 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 03 13:03:45.346063 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 03 13:03:45.346063 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 03 13:03:45.346063 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 03 13:03:45.346063 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:45.346063 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 03 13:03:45.346063 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:45.346063 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:45.346063 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 03 13:03:45.346063 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 03 13:03:45.346063 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 03 13:03:45.346063 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 03 13:03:45.346063 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 03 13:03:45.346063 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application next(self.gen) Jun 03 13:03:45.347036 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 03 13:03:45.347036 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application yield resource Jun 03 13:03:45.347036 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 03 13:03:45.347036 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application next(self.gen) Jun 03 13:03:45.347036 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 03 13:03:45.347036 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application self.session.rollback() Jun 03 13:03:45.347036 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 03 13:03:45.347036 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application self.force_reraise() Jun 03 13:03:45.347036 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 03 13:03:45.347036 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise self.value Jun 03 13:03:45.347036 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 03 13:03:45.347036 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 03 13:03:45.347036 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 03 13:03:45.347036 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application session.commit() Jun 03 13:03:45.347036 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 03 13:03:45.347036 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 03 13:03:45.347036 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 03 13:03:45.354646 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application self._prepare_impl() Jun 03 13:03:45.354646 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 03 13:03:45.354646 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application self.session.flush() Jun 03 13:03:45.354646 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 03 13:03:45.354646 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application self._flush(objects) Jun 03 13:03:45.354646 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 03 13:03:45.354646 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 03 13:03:45.354646 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 03 13:03:45.354646 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application compat.raise_( Jun 03 13:03:45.354646 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 03 13:03:45.354646 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception Jun 03 13:03:45.354646 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 03 13:03:45.354646 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application flush_context.execute() Jun 03 13:03:45.354646 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 03 13:03:45.354646 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rec.execute(self) Jun 03 13:03:45.354646 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 03 13:03:45.354646 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 03 13:03:45.355603 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 03 13:03:45.355603 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 03 13:03:45.355603 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 03 13:03:45.355603 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 03 13:03:45.355603 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 03 13:03:45.355603 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 03 13:03:45.355603 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 03 13:03:45.355603 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 03 13:03:45.355603 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 03 13:03:45.355603 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 03 13:03:45.355603 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 03 13:03:45.355603 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 03 13:03:45.355603 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 03 13:03:45.355603 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 03 13:03:45.355603 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 03 13:03:45.355603 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception Jun 03 13:03:45.357246 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 03 13:03:45.357246 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 03 13:03:45.357246 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 03 13:03:45.357246 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 03 13:03:45.357246 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 03 13:03:45.357246 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application result = self._query(query) Jun 03 13:03:45.357246 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 03 13:03:45.357246 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application conn.query(q) Jun 03 13:03:45.357246 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 03 13:03:45.357246 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 03 13:03:45.357246 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 03 13:03:45.357246 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application result.read() Jun 03 13:03:45.357246 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 03 13:03:45.357246 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 03 13:03:45.357246 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 03 13:03:45.357246 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 03 13:03:45.360113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 03 13:03:45.360113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 03 13:03:45.360113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 03 13:03:45.360113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 03 13:03:45.360113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 03 13:03:45.360113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 03 13:03:45.360113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ec44d02570f14269976bda60c72b88e6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 03 13:03:45.360113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 03 13:03:45.360113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:45.360113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 13:03:45.360113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:45.360113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:45.360113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:45.360113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:45.360113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:45.362285 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:45.362285 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:45.362285 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:45.362285 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:45.362285 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:45.362285 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:45.362285 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:45.362285 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 03 13:03:45.362285 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 03 13:03:45.362285 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:45.362285 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:45.362285 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 13:03:45.362285 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:03:45.362285 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 13:03:45.362285 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:03:45.362285 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 03 13:03:45.362285 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 03 13:03:45.364762 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 03 13:03:45.364762 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 03 13:03:45.364762 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 03 13:03:45.364762 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 03 13:03:45.364762 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 03 13:03:45.364762 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:45.364762 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 482/965] 10.222.0.61 () {60 vars in 1131 bytes} [Fri Jun 3 13:03:45 2022] POST /identity/v3/users => generated 160 bytes in 252 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:45.365679 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d91408-e8c9-4c01-b7e8-9fece0aaf1f1 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:45.379291 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b7678-8412-494b-b971-02bbd5083ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:45.380622 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b7678-8412-494b-b971-02bbd5083ea0 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:45.380622 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b7678-8412-494b-b971-02bbd5083ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:45.380822 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b7678-8412-494b-b971-02bbd5083ea0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:45.385081 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:45.400507 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b7678-8412-494b-b971-02bbd5083ea0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:03:45.409784 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-849b7678-8412-494b-b971-02bbd5083ea0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 13:03:45.409784 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:45.409784 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:45.409784 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:45.409784 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:45.409784 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:45.409784 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:45.409784 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:45.409784 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:45.409784 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:45.409784 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:45.409784 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:45.409784 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:03:45.409784 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:03:45.409784 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:03:45.409784 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:03:45.410809 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:03:45.410809 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:03:45.410809 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:03:45.410809 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:03:45.410809 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:45.410809 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:45.410809 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:45.410809 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:45.410809 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:45.410809 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:45.410809 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:45.410809 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:45.410809 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:45.410809 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:45.410809 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:45.410809 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:45.411650 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:45.411650 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:45.411650 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:45.411650 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:45.411650 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:03:45.411650 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:03:45.411650 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:03:45.411650 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:03:45.411650 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:03:45.411650 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:03:45.411650 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 13:03:45.411650 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:45.414551 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 484/966] 10.222.0.61 () {56 vars in 1120 bytes} [Fri Jun 3 13:03:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:03:45.417746 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b7678-8412-494b-b971-02bbd5083ea0 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:45.420768 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:45.490886 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d91408-e8c9-4c01-b7e8-9fece0aaf1f1 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:45.528986 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b7678-8412-494b-b971-02bbd5083ea0 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:45.531141 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5f20e-4da5-4918-8378-92d0902823e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:45.532375 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5f20e-4da5-4918-8378-92d0902823e5 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:45.532890 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5f20e-4da5-4918-8378-92d0902823e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:45.533394 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5f20e-4da5-4918-8378-92d0902823e5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:45.543235 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae5f20e-4da5-4918-8378-92d0902823e5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:45.546188 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae5f20e-4da5-4918-8378-92d0902823e5 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:45.563261 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-7ae5f20e-4da5-4918-8378-92d0902823e5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 03 13:03:45.563261 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:45.563261 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:45.563261 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:45.563261 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:45.563261 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:45.563261 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:45.563261 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:45.563261 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:45.563261 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:45.563261 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:45.563261 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:45.563261 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 13:03:45.563261 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 13:03:45.563261 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 13:03:45.563261 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 13:03:45.564293 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:45.564293 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:45.564293 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 13:03:45.564293 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:03:45.564293 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 13:03:45.564293 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:03:45.564293 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:45.564293 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:45.564293 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:45.564293 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:45.564293 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:45.564293 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:45.564293 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:45.564293 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:45.564293 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:45.564293 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:45.564293 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:45.564293 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:45.565246 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:45.565246 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:45.565246 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 13:03:45.565246 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 13:03:45.565246 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 13:03:45.565246 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 13:03:45.565246 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 13:03:45.565246 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 13:03:45.565246 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 03 13:03:45.565246 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:45.568675 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b419554-9288-4beb-9f41-6f2babb4b1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:45.572567 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b419554-9288-4beb-9f41-6f2babb4b1ba None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:45.572567 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b419554-9288-4beb-9f41-6f2babb4b1ba None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:45.572567 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b419554-9288-4beb-9f41-6f2babb4b1ba None admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:45.572567 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b419554-9288-4beb-9f41-6f2babb4b1ba None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:45.572567 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b419554-9288-4beb-9f41-6f2babb4b1ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:45.572567 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b419554-9288-4beb-9f41-6f2babb4b1ba None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:45.573167 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 483/967] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:03:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:45.574634 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5f20e-4da5-4918-8378-92d0902823e5 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:45.586541 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 485/968] 10.222.0.61 () {56 vars in 1115 bytes} [Fri Jun 3 13:03:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:03:45.587462 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b419554-9288-4beb-9f41-6f2babb4b1ba None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:45.653490 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:45.659422 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:45.694925 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5f20e-4da5-4918-8378-92d0902823e5 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:45.706541 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b419554-9288-4beb-9f41-6f2babb4b1ba None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:45.734336 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba254100-cb87-4a6e-99c0-246ba6d1dd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:45.735456 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba254100-cb87-4a6e-99c0-246ba6d1dd08 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:45.736180 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba254100-cb87-4a6e-99c0-246ba6d1dd08 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:45.736763 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba254100-cb87-4a6e-99c0-246ba6d1dd08 None admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:45.737906 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba254100-cb87-4a6e-99c0-246ba6d1dd08 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:45.738437 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba254100-cb87-4a6e-99c0-246ba6d1dd08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:45.740073 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba254100-cb87-4a6e-99c0-246ba6d1dd08 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:45.742443 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfbb7de-080b-4057-875f-26f014ee4883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:45.743234 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbb7de-080b-4057-875f-26f014ee4883 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:45.743616 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbb7de-080b-4057-875f-26f014ee4883 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:45.743893 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbb7de-080b-4057-875f-26f014ee4883 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:45.755337 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfbb7de-080b-4057-875f-26f014ee4883 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:45.756903 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfbb7de-080b-4057-875f-26f014ee4883 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:45.774815 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-1cfbb7de-080b-4057-875f-26f014ee4883 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:45.774815 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:45.774815 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:45.774815 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:45.774815 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:45.774815 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:45.774815 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:45.774815 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:45.774815 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:45.774815 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:45.774815 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:45.774815 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:45.774815 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:03:45.774815 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:03:45.774815 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:03:45.775769 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:03:45.775769 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:45.775769 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:45.775769 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:45.775769 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:45.775769 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:45.775769 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:45.775769 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:45.775769 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:45.775769 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:45.775769 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:45.775769 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:45.775769 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:45.775769 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:45.775769 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:45.775769 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:45.775769 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:45.776735 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:03:45.776735 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:03:45.776735 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:45.776735 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:45.780660 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 486/969] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:03:45.782903 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfbb7de-080b-4057-875f-26f014ee4883 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:45.792321 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 484/970] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jun 3 13:03:45 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:03:45.879914 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86e8de-0e7a-48c0-8680-8f450d7e22b3 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:45.880611 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86e8de-0e7a-48c0-8680-8f450d7e22b3 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:45.881099 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86e8de-0e7a-48c0-8680-8f450d7e22b3 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:45.887634 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 485/971] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:03:45.890419 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5bc7d-7dd3-48e8-99c9-4d785271167d None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:45.891070 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5bc7d-7dd3-48e8-99c9-4d785271167d None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:45.891453 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5bc7d-7dd3-48e8-99c9-4d785271167d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:45.897174 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfbb7de-080b-4057-875f-26f014ee4883 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:45.911911 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-6ab5bc7d-7dd3-48e8-99c9-4d785271167d None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:45.913918 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-6ab5bc7d-7dd3-48e8-99c9-4d785271167d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:45.921641 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:45.942413 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee27f6-e84b-4fac-876f-32c0c0bc4fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:45.943339 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee27f6-e84b-4fac-876f-32c0c0bc4fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:45.943528 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee27f6-e84b-4fac-876f-32c0c0bc4fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:45.943783 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee27f6-e84b-4fac-876f-32c0c0bc4fd6 None admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:45.944633 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ee27f6-e84b-4fac-876f-32c0c0bc4fd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:45.944954 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ee27f6-e84b-4fac-876f-32c0c0bc4fd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:45.946489 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ee27f6-e84b-4fac-876f-32c0c0bc4fd6 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:45.962519 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 487/972] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:03:45.969473 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee27f6-e84b-4fac-876f-32c0c0bc4fd6 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:46.016235 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 486/973] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:03:46.038666 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab5bc7d-7dd3-48e8-99c9-4d785271167d None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:46.100513 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee27f6-e84b-4fac-876f-32c0c0bc4fd6 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:46.111606 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:46.148639 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e9ff0-c140-444b-a58a-66c92882cab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:46.149380 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e9ff0-c140-444b-a58a-66c92882cab6 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:46.149666 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e9ff0-c140-444b-a58a-66c92882cab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:46.149945 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e9ff0-c140-444b-a58a-66c92882cab6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:46.159593 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812e9ff0-c140-444b-a58a-66c92882cab6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:46.161146 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812e9ff0-c140-444b-a58a-66c92882cab6 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:46.165515 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab5bc7d-7dd3-48e8-99c9-4d785271167d None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:46.176770 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-812e9ff0-c140-444b-a58a-66c92882cab6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 13:03:46.176770 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:46.176770 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:46.176770 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:46.176770 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:46.176770 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:46.176770 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:46.176770 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:46.176770 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:46.176770 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:46.176770 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:46.176770 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:46.176770 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 13:03:46.176770 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 13:03:46.176770 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 13:03:46.176770 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 13:03:46.177728 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:46.177728 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:46.177728 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 13:03:46.177728 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:03:46.177728 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 13:03:46.177728 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:03:46.177728 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:46.177728 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:46.177728 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:46.177728 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:46.177728 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:46.177728 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:46.177728 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:46.177728 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:46.177728 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:46.177728 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:46.177728 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:46.177728 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:46.179553 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:46.179553 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:46.179553 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 13:03:46.179553 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 13:03:46.179553 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 13:03:46.179553 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 13:03:46.179553 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 13:03:46.179553 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 13:03:46.179553 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 13:03:46.179553 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:46.179553 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 488/974] 10.222.0.61 () {56 vars in 1117 bytes} [Fri Jun 3 13:03:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:03:46.183515 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e9ff0-c140-444b-a58a-66c92882cab6 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:46.206249 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c18949-a5d0-42c3-8b36-ead68c14ac20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:46.206917 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c18949-a5d0-42c3-8b36-ead68c14ac20 None admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:46.207200 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c18949-a5d0-42c3-8b36-ead68c14ac20 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:46.207473 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c18949-a5d0-42c3-8b36-ead68c14ac20 None admin] PATH_INFO: `/v3/services` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:46.208208 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c18949-a5d0-42c3-8b36-ead68c14ac20 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:46.209591 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c18949-a5d0-42c3-8b36-ead68c14ac20 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:46.222585 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:46.285811 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e9ff0-c140-444b-a58a-66c92882cab6 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:46.292782 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 487/975] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Jun 3 13:03:46 2022] POST /identity/v3/services => generated 242 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:03:46.334048 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9f1a1-2952-493d-9a95-8a298216ca71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:46.334730 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9f1a1-2952-493d-9a95-8a298216ca71 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:46.335014 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9f1a1-2952-493d-9a95-8a298216ca71 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:46.335306 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9f1a1-2952-493d-9a95-8a298216ca71 None admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:46.336129 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a9f1a1-2952-493d-9a95-8a298216ca71 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:46.336498 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a9f1a1-2952-493d-9a95-8a298216ca71 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:46.337976 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a9f1a1-2952-493d-9a95-8a298216ca71 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:46.359402 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 489/976] 10.222.0.61 () {56 vars in 1149 bytes} [Fri Jun 3 13:03:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:03:46.365036 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c18949-a5d0-42c3-8b36-ead68c14ac20 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:46.474925 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c18949-a5d0-42c3-8b36-ead68c14ac20 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:46.493732 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:46.511699 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d7be51-9d72-408d-bcc3-a983622be403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:46.512386 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7be51-9d72-408d-bcc3-a983622be403 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:46.512747 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7be51-9d72-408d-bcc3-a983622be403 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:46.512952 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7be51-9d72-408d-bcc3-a983622be403 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:46.583169 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d7be51-9d72-408d-bcc3-a983622be403 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:46.584662 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d7be51-9d72-408d-bcc3-a983622be403 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:46.684176 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 488/977] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:03:46 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 13:03:46.690180 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9f1a1-2952-493d-9a95-8a298216ca71 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:46.783130 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:46.793358 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9f1a1-2952-493d-9a95-8a298216ca71 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:46.833913 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4142ed8-91b1-4bef-a174-c821d97bb1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:46.834717 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4142ed8-91b1-4bef-a174-c821d97bb1fd None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:46.835003 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4142ed8-91b1-4bef-a174-c821d97bb1fd None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:46.835281 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4142ed8-91b1-4bef-a174-c821d97bb1fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:46.846376 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4142ed8-91b1-4bef-a174-c821d97bb1fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:46.847827 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4142ed8-91b1-4bef-a174-c821d97bb1fd None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:46.866142 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-c4142ed8-91b1-4bef-a174-c821d97bb1fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:46.866142 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:46.866142 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:46.866142 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:46.866142 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:46.866142 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:46.866142 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:46.866142 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:46.866142 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:46.866142 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:46.866142 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:46.866142 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:46.866142 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:03:46.866142 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:03:46.866142 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:03:46.867150 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:03:46.867150 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:46.867150 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:46.867150 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:46.867150 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:46.867150 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:46.867150 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:46.867150 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:46.867150 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:46.867150 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:46.867150 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:46.867150 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:46.867150 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:46.867150 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:46.867150 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:46.867150 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:46.867150 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:46.868119 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:03:46.868119 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:03:46.868119 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:46.868119 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:46.872030 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 490/978] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:03:46.872877 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d7be51-9d72-408d-bcc3-a983622be403 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:46.891590 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:46.976508 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d7be51-9d72-408d-bcc3-a983622be403 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:47.027951 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81189b64-e0a7-46d0-b8d4-1ff294f4c2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:47.028683 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81189b64-e0a7-46d0-b8d4-1ff294f4c2b1 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:47.028930 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81189b64-e0a7-46d0-b8d4-1ff294f4c2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:47.029194 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81189b64-e0a7-46d0-b8d4-1ff294f4c2b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:47.030611 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81189b64-e0a7-46d0-b8d4-1ff294f4c2b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:47.030923 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81189b64-e0a7-46d0-b8d4-1ff294f4c2b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:47.032334 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81189b64-e0a7-46d0-b8d4-1ff294f4c2b1 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:47.049124 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 489/979] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:03:47.050717 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4142ed8-91b1-4bef-a174-c821d97bb1fd None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:47.142887 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2431cb-927f-4bcd-babc-fe9493064713 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:47.143179 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2431cb-927f-4bcd-babc-fe9493064713 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:47.143455 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2431cb-927f-4bcd-babc-fe9493064713 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:47.145124 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 490/980] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 13:03:47.149835 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c92fa3-861b-4b36-9594-94494caf79ba None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:47.150116 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c92fa3-861b-4b36-9594-94494caf79ba None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:47.150385 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c92fa3-861b-4b36-9594-94494caf79ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:47.154860 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4142ed8-91b1-4bef-a174-c821d97bb1fd None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:47.167445 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-e9c92fa3-861b-4b36-9594-94494caf79ba None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:47.168659 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-e9c92fa3-861b-4b36-9594-94494caf79ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:47.190957 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc999739-3b6f-4434-bd2d-1c90e03d031f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:47.191743 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc999739-3b6f-4434-bd2d-1c90e03d031f None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:47.192020 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc999739-3b6f-4434-bd2d-1c90e03d031f None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:47.192319 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc999739-3b6f-4434-bd2d-1c90e03d031f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:47.199112 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc999739-3b6f-4434-bd2d-1c90e03d031f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:47.200570 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc999739-3b6f-4434-bd2d-1c90e03d031f None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:47.214900 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-fc999739-3b6f-4434-bd2d-1c90e03d031f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:03:47.214900 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:47.214900 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:47.214900 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:47.214900 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:47.214900 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:47.214900 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:47.214900 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:47.214900 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:47.214900 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:47.214900 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:47.214900 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:47.214900 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 13:03:47.214900 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 13:03:47.214900 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 13:03:47.215997 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 13:03:47.215997 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:47.215997 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:47.215997 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:47.215997 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:47.215997 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:47.215997 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:47.215997 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:47.215997 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:47.215997 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:47.215997 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:47.215997 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:47.215997 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:47.215997 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:47.215997 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:47.215997 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:47.215997 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:47.217582 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 13:03:47.217582 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 13:03:47.217582 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 13:03:47.217582 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 13:03:47.217582 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 13:03:47.217582 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 13:03:47.217582 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:03:47.217582 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:47.217582 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 491/981] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:03:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:47.223239 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc999739-3b6f-4434-bd2d-1c90e03d031f None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:47.226038 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:47.242679 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 491/982] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:47 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 13:03:47.266262 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c92fa3-861b-4b36-9594-94494caf79ba None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:47.276577 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:47.331789 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc999739-3b6f-4434-bd2d-1c90e03d031f None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:47.370696 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1bb0a-0c26-4a5c-87a4-a7ac1973cdce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:47.371358 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1bb0a-0c26-4a5c-87a4-a7ac1973cdce None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:47.371645 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1bb0a-0c26-4a5c-87a4-a7ac1973cdce None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:47.371921 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1bb0a-0c26-4a5c-87a4-a7ac1973cdce None admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:47.372737 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1bb0a-0c26-4a5c-87a4-a7ac1973cdce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:47.373163 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1bb0a-0c26-4a5c-87a4-a7ac1973cdce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:47.374603 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1bb0a-0c26-4a5c-87a4-a7ac1973cdce None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:47.379752 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c92fa3-861b-4b36-9594-94494caf79ba None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:47.391913 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 492/983] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 13:03:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:47.393781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1bb0a-0c26-4a5c-87a4-a7ac1973cdce None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:47.421783 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84854461-8211-4379-b55e-092be80d74a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:47.422822 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84854461-8211-4379-b55e-092be80d74a1 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:47.423257 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84854461-8211-4379-b55e-092be80d74a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:47.423531 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84854461-8211-4379-b55e-092be80d74a1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:47.424322 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84854461-8211-4379-b55e-092be80d74a1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:47.426171 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84854461-8211-4379-b55e-092be80d74a1 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:47.440602 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-84854461-8211-4379-b55e-092be80d74a1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 13:03:47.440602 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:47.440602 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 13:03:47.440602 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 13:03:47.440602 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 13:03:47.440602 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 13:03:47.440602 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 13:03:47.440602 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:03:47.440602 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 13:03:47.440602 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:47.440602 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 13:03:47.440602 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:47.440602 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:47.440602 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:47.440602 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:47.440602 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:47.440602 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:47.441680 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:47.441680 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:47.441680 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:47.441680 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:47.441680 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:47.441680 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:47.441680 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 13:03:47.441680 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 13:03:47.441680 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 13:03:47.441680 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 13:03:47.441680 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:47.441680 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:47.441680 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:47.441680 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:47.441680 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:47.441680 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:47.442536 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:47.442536 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:47.442536 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:47.442536 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:47.442536 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:47.442536 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:47.442536 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:47.442536 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:47.442536 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:47.442536 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:47.442536 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 13:03:47.442536 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:03:47.442536 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 13:03:47.442536 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:47.442536 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 492/984] 10.222.0.61 () {56 vars in 1126 bytes} [Fri Jun 3 13:03:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:03:47.447621 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84854461-8211-4379-b55e-092be80d74a1 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:47.462356 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:47.506212 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1bb0a-0c26-4a5c-87a4-a7ac1973cdce None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:47.529099 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:47.541296 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80aebc2-b696-404b-b20c-bbdeb4568a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:47.541974 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80aebc2-b696-404b-b20c-bbdeb4568a57 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:47.542235 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80aebc2-b696-404b-b20c-bbdeb4568a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:47.542512 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80aebc2-b696-404b-b20c-bbdeb4568a57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:47.543336 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80aebc2-b696-404b-b20c-bbdeb4568a57 None admin] RBAC: Adding query filter params (role.id=597251d134b24da6a79c4005736005a4, scope.project.id=c8c0bf799c9f451b8167a646a5c82eda, user.id=06c55d0ea52f40ae9125d2efe1d159a3) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:47.543646 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80aebc2-b696-404b-b20c-bbdeb4568a57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:47.545149 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80aebc2-b696-404b-b20c-bbdeb4568a57 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:47.551837 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 493/985] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 13:03:47 2022] GET /identity/v3/role_assignments?user.id=06c55d0ea52f40ae9125d2efe1d159a3&scope.project.id=c8c0bf799c9f451b8167a646a5c82eda&role.id=597251d134b24da6a79c4005736005a4 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:03:47.560001 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84854461-8211-4379-b55e-092be80d74a1 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:47.601184 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a592d17-68d9-43f9-b64d-3d65f0e8bc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:47.601774 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a592d17-68d9-43f9-b64d-3d65f0e8bc50 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:47.602056 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a592d17-68d9-43f9-b64d-3d65f0e8bc50 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:47.602330 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a592d17-68d9-43f9-b64d-3d65f0e8bc50 None admin] PATH_INFO: `/v3/services` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:47.603108 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a592d17-68d9-43f9-b64d-3d65f0e8bc50 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:47.603416 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a592d17-68d9-43f9-b64d-3d65f0e8bc50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:47.604916 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a592d17-68d9-43f9-b64d-3d65f0e8bc50 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:47.616249 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 493/986] 10.222.0.61 () {56 vars in 1122 bytes} [Fri Jun 3 13:03:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:03:47.617755 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80aebc2-b696-404b-b20c-bbdeb4568a57 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:47.727712 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80aebc2-b696-404b-b20c-bbdeb4568a57 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:47.756742 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:47.765746 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c048c-2619-4e0c-a79d-0bf287ad8c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:47.766415 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c048c-2619-4e0c-a79d-0bf287ad8c14 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:47.766703 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c048c-2619-4e0c-a79d-0bf287ad8c14 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:47.766979 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c048c-2619-4e0c-a79d-0bf287ad8c14 None admin] PATH_INFO: `/v3/services` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:47.767759 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c048c-2619-4e0c-a79d-0bf287ad8c14 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:47.768075 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c048c-2619-4e0c-a79d-0bf287ad8c14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:47.769701 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c048c-2619-4e0c-a79d-0bf287ad8c14 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:47.774854 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 494/987] 10.222.0.61 () {56 vars in 1122 bytes} [Fri Jun 3 13:03:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:47.780936 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a592d17-68d9-43f9-b64d-3d65f0e8bc50 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:47.882886 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a592d17-68d9-43f9-b64d-3d65f0e8bc50 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:47.916623 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e4de02-4842-43f6-90aa-43ad2db0cc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:47.917271 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4de02-4842-43f6-90aa-43ad2db0cc30 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:47.917552 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4de02-4842-43f6-90aa-43ad2db0cc30 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:47.917822 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4de02-4842-43f6-90aa-43ad2db0cc30 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:47.918610 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e4de02-4842-43f6-90aa-43ad2db0cc30 None admin] RBAC: Adding query filter params (interface=admin, service_id=a7afc3b9c01f4ece8475f24e24a4e7a4, region_id=RegionOne) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:47.918918 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e4de02-4842-43f6-90aa-43ad2db0cc30 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:47.920448 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e4de02-4842-43f6-90aa-43ad2db0cc30 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:47.922833 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:47.926163 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 494/988] 10.222.0.61 () {56 vars in 1249 bytes} [Fri Jun 3 13:03:47 2022] GET /identity/v3/endpoints?service_id=a7afc3b9c01f4ece8475f24e24a4e7a4&interface=admin®ion_id=RegionOne => generated 193 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:47.932105 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c048c-2619-4e0c-a79d-0bf287ad8c14 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:48.044606 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c048c-2619-4e0c-a79d-0bf287ad8c14 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:48.078194 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c02944-609e-4e93-94f8-9c7d53683274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:48.078876 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c02944-609e-4e93-94f8-9c7d53683274 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:48.079118 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c02944-609e-4e93-94f8-9c7d53683274 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:48.079386 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c02944-609e-4e93-94f8-9c7d53683274 None admin] PATH_INFO: `/v3/services` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:48.080056 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c02944-609e-4e93-94f8-9c7d53683274 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:48.081448 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c02944-609e-4e93-94f8-9c7d53683274 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:48.095307 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 495/989] 10.222.0.61 () {56 vars in 1087 bytes} [Fri Jun 3 13:03:47 2022] GET /identity/v3/services => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:03:48.581730 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c2c99-5853-45da-a20c-01f25c7f55f4 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:48.582262 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c2c99-5853-45da-a20c-01f25c7f55f4 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:48.582262 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c2c99-5853-45da-a20c-01f25c7f55f4 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:48.583764 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 495/990] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:03:48.589198 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6e1e4-6511-43b0-bd12-d7c3fd6045dc None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:48.589493 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6e1e4-6511-43b0-bd12-d7c3fd6045dc None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:48.589772 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6e1e4-6511-43b0-bd12-d7c3fd6045dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:48.608821 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-fcd6e1e4-6511-43b0-bd12-d7c3fd6045dc None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:48.610020 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-fcd6e1e4-6511-43b0-bd12-d7c3fd6045dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:48.661821 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:48.679124 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 496/991] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:48 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:03:48.701703 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c2c99-5853-45da-a20c-01f25c7f55f4 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:48.812425 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c2c99-5853-45da-a20c-01f25c7f55f4 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:48.847708 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828ce28-2a8e-4923-afcd-3961dc5a81ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:48.849165 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828ce28-2a8e-4923-afcd-3961dc5a81ae None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:48.849458 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828ce28-2a8e-4923-afcd-3961dc5a81ae None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:48.849741 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828ce28-2a8e-4923-afcd-3961dc5a81ae None admin] PATH_INFO: `/v3/services/compute` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:48.850402 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1828ce28-2a8e-4923-afcd-3961dc5a81ae None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:48.851772 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1828ce28-2a8e-4923-afcd-3961dc5a81ae None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:48.864472 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-1828ce28-2a8e-4923-afcd-3961dc5a81ae None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 13:03:48.864472 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:48.864472 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 13:03:48.864472 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 13:03:48.864472 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 13:03:48.864472 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 13:03:48.864472 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 13:03:48.864472 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:03:48.864472 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 13:03:48.864472 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:48.864472 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 13:03:48.864472 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:48.864472 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:48.864472 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:48.864472 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:48.864472 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:48.864472 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:48.865535 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:48.865535 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:48.865535 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:48.865535 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:48.865535 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:48.865535 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:48.865535 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 13:03:48.865535 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 13:03:48.865535 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 13:03:48.865535 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 13:03:48.865535 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:48.865535 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:48.865535 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:48.865535 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:48.865535 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:48.865535 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:48.866396 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:48.866396 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:48.866396 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:48.866396 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:48.866396 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:48.866396 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:48.866396 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:48.866396 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:48.866396 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:48.866396 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:48.866396 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 13:03:48.866396 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:03:48.866396 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 13:03:48.866396 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:48.866396 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 496/992] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:03:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:48.873970 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd6e1e4-6511-43b0-bd12-d7c3fd6045dc None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:48.974196 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd6e1e4-6511-43b0-bd12-d7c3fd6045dc None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:49.014791 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41f3bc-c1e9-4289-853d-ba62d8970d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:49.015453 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41f3bc-c1e9-4289-853d-ba62d8970d00 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:49.015736 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41f3bc-c1e9-4289-853d-ba62d8970d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:49.015999 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41f3bc-c1e9-4289-853d-ba62d8970d00 None admin] PATH_INFO: `/v3/services` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:49.016728 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41f3bc-c1e9-4289-853d-ba62d8970d00 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:49.017032 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41f3bc-c1e9-4289-853d-ba62d8970d00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:49.018394 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41f3bc-c1e9-4289-853d-ba62d8970d00 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:49.023447 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 497/993] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Jun 3 13:03:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:49.028991 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828ce28-2a8e-4923-afcd-3961dc5a81ae None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:49.091426 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:49.129124 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828ce28-2a8e-4923-afcd-3961dc5a81ae None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:49.163096 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463830a-736b-4a66-837e-227a8e034405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:49.163752 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463830a-736b-4a66-837e-227a8e034405 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:49.164032 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463830a-736b-4a66-837e-227a8e034405 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:49.164358 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463830a-736b-4a66-837e-227a8e034405 None admin] PATH_INFO: `/v3/services` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:49.165053 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5463830a-736b-4a66-837e-227a8e034405 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:49.165355 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5463830a-736b-4a66-837e-227a8e034405 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:49.166701 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5463830a-736b-4a66-837e-227a8e034405 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:49.172368 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 497/994] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Jun 3 13:03:49 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:49.178013 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41f3bc-c1e9-4289-853d-ba62d8970d00 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:49.227326 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:49.283027 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41f3bc-c1e9-4289-853d-ba62d8970d00 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:49.318124 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d8403-5643-4650-b4ea-499d33bd496c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:49.318850 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d8403-5643-4650-b4ea-499d33bd496c None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:49.319137 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d8403-5643-4650-b4ea-499d33bd496c None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:49.319436 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d8403-5643-4650-b4ea-499d33bd496c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:49.320258 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d8403-5643-4650-b4ea-499d33bd496c None admin] RBAC: Adding query filter params (interface=public, service_id=299ab7d9c38d4a37b8945605702b5e53, region_id=RegionOne) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:49.320575 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d8403-5643-4650-b4ea-499d33bd496c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:49.321950 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d8403-5643-4650-b4ea-499d33bd496c None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:49.328643 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 498/995] 10.222.0.61 () {56 vars in 1251 bytes} [Fri Jun 3 13:03:49 2022] GET /identity/v3/endpoints?service_id=299ab7d9c38d4a37b8945605702b5e53&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:49.333886 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463830a-736b-4a66-837e-227a8e034405 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:49.438290 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463830a-736b-4a66-837e-227a8e034405 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:49.464277 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:49.472880 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220e1ff-ff91-44b0-b982-57e4b4305c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:49.473800 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220e1ff-ff91-44b0-b982-57e4b4305c67 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:49.474088 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220e1ff-ff91-44b0-b982-57e4b4305c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:49.474368 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220e1ff-ff91-44b0-b982-57e4b4305c67 None admin] PATH_INFO: `/v3/services` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:49.475043 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2220e1ff-ff91-44b0-b982-57e4b4305c67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:49.476440 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2220e1ff-ff91-44b0-b982-57e4b4305c67 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:49.482900 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 498/996] 10.222.0.61 () {56 vars in 1087 bytes} [Fri Jun 3 13:03:49 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:03:49.892737 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca718e-88d9-45e6-8ca6-31da6cd42f96 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:49.892941 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca718e-88d9-45e6-8ca6-31da6cd42f96 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:49.893241 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca718e-88d9-45e6-8ca6-31da6cd42f96 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:49.894715 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 499/997] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:03:49.900414 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3273fe6-7fe0-4d21-90b9-53346d84247b None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:49.900865 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3273fe6-7fe0-4d21-90b9-53346d84247b None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:49.900962 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3273fe6-7fe0-4d21-90b9-53346d84247b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:49.918315 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-e3273fe6-7fe0-4d21-90b9-53346d84247b None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:49.919549 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-e3273fe6-7fe0-4d21-90b9-53346d84247b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:49.995638 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 499/998] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:49 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:03:50.021610 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca718e-88d9-45e6-8ca6-31da6cd42f96 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:50.134754 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca718e-88d9-45e6-8ca6-31da6cd42f96 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:50.148969 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:50.171513 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa401b7e-75bc-4df0-ac82-dc60a6e9c924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:50.172338 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa401b7e-75bc-4df0-ac82-dc60a6e9c924 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:50.172623 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa401b7e-75bc-4df0-ac82-dc60a6e9c924 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:50.172898 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa401b7e-75bc-4df0-ac82-dc60a6e9c924 None admin] PATH_INFO: `/v3/services/image` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:50.173574 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa401b7e-75bc-4df0-ac82-dc60a6e9c924 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:50.175053 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa401b7e-75bc-4df0-ac82-dc60a6e9c924 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:50.188244 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-fa401b7e-75bc-4df0-ac82-dc60a6e9c924 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 13:03:50.188244 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:50.188244 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 13:03:50.188244 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 13:03:50.188244 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 13:03:50.188244 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 13:03:50.188244 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 13:03:50.188244 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:03:50.188244 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 13:03:50.188244 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:50.188244 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 13:03:50.188244 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:50.188244 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:50.188244 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:50.188244 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:50.188244 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:50.188244 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:50.194739 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:50.194739 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:50.194739 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:50.194739 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:50.194739 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:50.194739 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:50.194739 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 13:03:50.194739 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 13:03:50.194739 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 13:03:50.194739 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 13:03:50.194739 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:50.194739 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:50.194739 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:50.194739 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:50.194739 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:50.194739 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:50.195816 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:50.195816 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:50.195816 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:50.195816 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:50.195816 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:50.195816 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:50.195816 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:50.195816 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:50.195816 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:50.195816 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:50.195816 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 13:03:50.195816 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:03:50.195816 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 13:03:50.195816 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:50.195816 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 500/999] 10.222.0.61 () {56 vars in 1105 bytes} [Fri Jun 3 13:03:50 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:50.198187 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3273fe6-7fe0-4d21-90b9-53346d84247b None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:50.297950 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3273fe6-7fe0-4d21-90b9-53346d84247b None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:50.321192 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:50.332984 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d87e46-15a3-4f1d-a016-07970337a8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:50.333654 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d87e46-15a3-4f1d-a016-07970337a8ad None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:50.333974 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d87e46-15a3-4f1d-a016-07970337a8ad None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:50.334256 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d87e46-15a3-4f1d-a016-07970337a8ad None admin] PATH_INFO: `/v3/services` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:50.334955 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d87e46-15a3-4f1d-a016-07970337a8ad None admin] RBAC: Adding query filter params (name=image) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:50.335261 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d87e46-15a3-4f1d-a016-07970337a8ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:50.336669 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d87e46-15a3-4f1d-a016-07970337a8ad None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:50.345942 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 500/1000] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:50 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:50.347840 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa401b7e-75bc-4df0-ac82-dc60a6e9c924 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:50.427969 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf51f0e-44a4-4f1e-8926-25b60f27c55c None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:50.428316 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf51f0e-44a4-4f1e-8926-25b60f27c55c None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:50.428479 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf51f0e-44a4-4f1e-8926-25b60f27c55c None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:50.429978 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 501/1001] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 13:03:50.434850 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7edc8c-a0ff-43f1-bf75-a0c69e43c522 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:50.435141 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7edc8c-a0ff-43f1-bf75-a0c69e43c522 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:50.435456 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7edc8c-a0ff-43f1-bf75-a0c69e43c522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:50.449315 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa401b7e-75bc-4df0-ac82-dc60a6e9c924 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:50.453715 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-cf7edc8c-a0ff-43f1-bf75-a0c69e43c522 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:50.454913 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-cf7edc8c-a0ff-43f1-bf75-a0c69e43c522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:50.485452 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab7da8-0510-4ee6-828d-033c2baee6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:50.486135 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab7da8-0510-4ee6-828d-033c2baee6a9 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:50.486473 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab7da8-0510-4ee6-828d-033c2baee6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:50.486726 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab7da8-0510-4ee6-828d-033c2baee6a9 None admin] PATH_INFO: `/v3/services` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:50.487447 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eab7da8-0510-4ee6-828d-033c2baee6a9 None admin] RBAC: Adding query filter params (type=image) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:50.487739 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eab7da8-0510-4ee6-828d-033c2baee6a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:50.489182 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eab7da8-0510-4ee6-828d-033c2baee6a9 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:50.494324 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 501/1002] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:50 2022] GET /identity/v3/services?type=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:03:50.524732 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 502/1003] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:50 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 13:03:50.549593 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab7da8-0510-4ee6-828d-033c2baee6a9 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:50.599053 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:50.666114 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab7da8-0510-4ee6-828d-033c2baee6a9 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:50.705558 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfcd750-a913-493d-a8e0-f65fdf48fb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:50.706295 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcd750-a913-493d-a8e0-f65fdf48fb03 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:50.706582 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcd750-a913-493d-a8e0-f65fdf48fb03 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:50.706857 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcd750-a913-493d-a8e0-f65fdf48fb03 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:50.707543 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfcd750-a913-493d-a8e0-f65fdf48fb03 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:50.708941 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfcd750-a913-493d-a8e0-f65fdf48fb03 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:50.722929 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-3dfcd750-a913-493d-a8e0-f65fdf48fb03 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 13:03:50.722929 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:50.722929 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 13:03:50.722929 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 13:03:50.722929 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 13:03:50.722929 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 13:03:50.722929 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 13:03:50.722929 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:03:50.722929 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 13:03:50.722929 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:50.722929 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 13:03:50.722929 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:50.722929 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:50.722929 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:50.722929 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:50.722929 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:50.722929 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:50.724520 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:50.724520 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:50.724520 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:50.724520 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:50.724520 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:50.724520 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:50.724520 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 13:03:50.724520 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 13:03:50.724520 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 13:03:50.724520 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 13:03:50.724520 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:50.724520 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:50.724520 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:50.724520 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:50.724520 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:50.724520 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:50.725663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:50.725663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:50.725663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:50.725663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:50.725663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:50.725663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:50.725663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:50.725663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:50.725663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:50.725663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:50.725663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 13:03:50.725663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:03:50.725663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 13:03:50.725663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:50.725663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 502/1004] 10.222.0.61 () {56 vars in 1126 bytes} [Fri Jun 3 13:03:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:50.731827 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7edc8c-a0ff-43f1-bf75-a0c69e43c522 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:50.832851 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7edc8c-a0ff-43f1-bf75-a0c69e43c522 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:50.849253 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:50.867241 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918cc13-aaa2-43e1-9468-43e2ba84f7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:50.867965 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918cc13-aaa2-43e1-9468-43e2ba84f7ec None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:50.868347 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918cc13-aaa2-43e1-9468-43e2ba84f7ec None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:50.868642 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918cc13-aaa2-43e1-9468-43e2ba84f7ec None admin] PATH_INFO: `/v3/services` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:50.869390 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b918cc13-aaa2-43e1-9468-43e2ba84f7ec None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:50.869692 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b918cc13-aaa2-43e1-9468-43e2ba84f7ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:50.871041 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b918cc13-aaa2-43e1-9468-43e2ba84f7ec None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:50.880233 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 503/1005] 10.222.0.61 () {56 vars in 1122 bytes} [Fri Jun 3 13:03:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:50.882579 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfcd750-a913-493d-a8e0-f65fdf48fb03 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:50.982992 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfcd750-a913-493d-a8e0-f65fdf48fb03 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:50.985331 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:51.027902 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80518eb9-35b2-4079-82a4-1b29ac78f372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:51.028594 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80518eb9-35b2-4079-82a4-1b29ac78f372 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:51.028874 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80518eb9-35b2-4079-82a4-1b29ac78f372 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:51.029283 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80518eb9-35b2-4079-82a4-1b29ac78f372 None admin] PATH_INFO: `/v3/services` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:51.030181 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80518eb9-35b2-4079-82a4-1b29ac78f372 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:51.030485 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80518eb9-35b2-4079-82a4-1b29ac78f372 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:51.031853 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80518eb9-35b2-4079-82a4-1b29ac78f372 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:51.041539 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 503/1006] 10.222.0.61 () {56 vars in 1122 bytes} [Fri Jun 3 13:03:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:51.042633 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918cc13-aaa2-43e1-9468-43e2ba84f7ec None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:51.145300 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918cc13-aaa2-43e1-9468-43e2ba84f7ec None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:51.178927 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1609f-73b1-42ca-9cde-75d6e21050fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:51.179581 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1609f-73b1-42ca-9cde-75d6e21050fc None admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:51.179860 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1609f-73b1-42ca-9cde-75d6e21050fc None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:51.180131 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1609f-73b1-42ca-9cde-75d6e21050fc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:51.180883 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb1609f-73b1-42ca-9cde-75d6e21050fc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:51.182239 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb1609f-73b1-42ca-9cde-75d6e21050fc None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:51.251352 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 504/1007] 10.222.0.61 () {60 vars in 1144 bytes} [Fri Jun 3 13:03:51 2022] POST /identity/v3/endpoints => generated 325 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:51.767194 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ef8f9-55bf-43b7-8514-33feacd33214 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:51.767751 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ef8f9-55bf-43b7-8514-33feacd33214 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:51.767751 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ef8f9-55bf-43b7-8514-33feacd33214 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:51.769457 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 504/1008] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:03:51.775032 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4da82-6b07-4143-b6fd-73da8e10ef03 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:51.775327 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4da82-6b07-4143-b6fd-73da8e10ef03 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:51.775606 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4da82-6b07-4143-b6fd-73da8e10ef03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:51.792760 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-13a4da82-6b07-4143-b6fd-73da8e10ef03 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:51.793942 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-13a4da82-6b07-4143-b6fd-73da8e10ef03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:51.829686 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:51.869595 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 505/1009] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:51 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:03:51.892312 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ef8f9-55bf-43b7-8514-33feacd33214 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:52.005218 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ef8f9-55bf-43b7-8514-33feacd33214 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:52.043269 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00723dc-4d2a-4114-8d91-0c5fea1ebb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:52.043988 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00723dc-4d2a-4114-8d91-0c5fea1ebb8f None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:52.044299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00723dc-4d2a-4114-8d91-0c5fea1ebb8f None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:52.044574 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00723dc-4d2a-4114-8d91-0c5fea1ebb8f None admin] PATH_INFO: `/v3/services/compute` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:52.045366 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00723dc-4d2a-4114-8d91-0c5fea1ebb8f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:52.046741 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00723dc-4d2a-4114-8d91-0c5fea1ebb8f None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:52.058977 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-c00723dc-4d2a-4114-8d91-0c5fea1ebb8f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 13:03:52.058977 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:52.058977 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 13:03:52.058977 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 13:03:52.058977 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 13:03:52.058977 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 13:03:52.058977 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 13:03:52.058977 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:03:52.058977 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 13:03:52.058977 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:52.058977 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 13:03:52.058977 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:52.058977 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:52.058977 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:52.058977 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:52.058977 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:52.058977 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:52.060078 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:52.060078 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:52.060078 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:52.060078 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:52.060078 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:52.060078 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:52.060078 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 13:03:52.060078 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 13:03:52.060078 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 13:03:52.060078 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 13:03:52.060078 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:52.060078 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:52.060078 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:52.060078 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:52.060078 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:52.060078 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:52.067313 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:52.067313 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:52.067313 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:52.067313 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:52.067313 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:52.067313 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:52.067313 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:52.067313 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:52.067313 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:52.067313 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:52.067313 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 13:03:52.067313 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:03:52.067313 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 13:03:52.067313 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:52.067313 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 505/1010] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:03:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:52.068178 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4da82-6b07-4143-b6fd-73da8e10ef03 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:52.172867 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4da82-6b07-4143-b6fd-73da8e10ef03 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:52.207960 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94429dfa-f1fb-4b42-845e-d99f5d1e7127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:52.208645 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94429dfa-f1fb-4b42-845e-d99f5d1e7127 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:52.208924 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94429dfa-f1fb-4b42-845e-d99f5d1e7127 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:52.209356 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94429dfa-f1fb-4b42-845e-d99f5d1e7127 None admin] PATH_INFO: `/v3/services` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:52.210174 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94429dfa-f1fb-4b42-845e-d99f5d1e7127 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:52.210480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94429dfa-f1fb-4b42-845e-d99f5d1e7127 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:52.211843 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94429dfa-f1fb-4b42-845e-d99f5d1e7127 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:52.221420 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 506/1011] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Jun 3 13:03:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:03:52.222208 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00723dc-4d2a-4114-8d91-0c5fea1ebb8f None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:52.253964 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:52.322757 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00723dc-4d2a-4114-8d91-0c5fea1ebb8f None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:52.360017 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802973a-b6fb-4d4f-aee4-c2c981a47611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:52.360017 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802973a-b6fb-4d4f-aee4-c2c981a47611 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:52.360017 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802973a-b6fb-4d4f-aee4-c2c981a47611 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:52.360017 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802973a-b6fb-4d4f-aee4-c2c981a47611 None admin] PATH_INFO: `/v3/services` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:52.360452 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3802973a-b6fb-4d4f-aee4-c2c981a47611 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:52.360452 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3802973a-b6fb-4d4f-aee4-c2c981a47611 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:52.361635 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3802973a-b6fb-4d4f-aee4-c2c981a47611 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:52.366806 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 506/1012] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Jun 3 13:03:52 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:03:52.372175 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94429dfa-f1fb-4b42-845e-d99f5d1e7127 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:52.406167 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:52.482236 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94429dfa-f1fb-4b42-845e-d99f5d1e7127 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:52.517834 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03650715-60f4-4a07-a119-f8d0ed8cb0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:52.518543 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03650715-60f4-4a07-a119-f8d0ed8cb0f7 None admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:52.518762 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03650715-60f4-4a07-a119-f8d0ed8cb0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:52.519022 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03650715-60f4-4a07-a119-f8d0ed8cb0f7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:52.519755 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03650715-60f4-4a07-a119-f8d0ed8cb0f7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:52.521139 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03650715-60f4-4a07-a119-f8d0ed8cb0f7 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:52.593060 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 507/1013] 10.222.0.61 () {60 vars in 1144 bytes} [Fri Jun 3 13:03:52 2022] POST /identity/v3/endpoints => generated 334 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:52.796896 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74513bab-afae-46bc-98c3-5ebd59f242d2 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:52.797420 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74513bab-afae-46bc-98c3-5ebd59f242d2 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:52.797510 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74513bab-afae-46bc-98c3-5ebd59f242d2 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:52.799098 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 507/1014] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:03:52.804461 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4801a4-9d83-4037-8b34-dd51b6829797 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:52.804755 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4801a4-9d83-4037-8b34-dd51b6829797 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:52.805036 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4801a4-9d83-4037-8b34-dd51b6829797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:52.822103 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-be4801a4-9d83-4037-8b34-dd51b6829797 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:52.823301 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-be4801a4-9d83-4037-8b34-dd51b6829797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:52.902911 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 508/1015] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:52 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:03:52.928101 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74513bab-afae-46bc-98c3-5ebd59f242d2 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:53.058790 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:53.066108 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74513bab-afae-46bc-98c3-5ebd59f242d2 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:53.100789 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a3866-b206-42df-ab75-9a820cfe4200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:53.101457 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a3866-b206-42df-ab75-9a820cfe4200 None admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:53.101739 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a3866-b206-42df-ab75-9a820cfe4200 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:53.102012 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a3866-b206-42df-ab75-9a820cfe4200 None admin] PATH_INFO: `/v3/services` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:53.102744 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45a3866-b206-42df-ab75-9a820cfe4200 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:53.104096 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45a3866-b206-42df-ab75-9a820cfe4200 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:53.217834 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 508/1016] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Jun 3 13:03:52 2022] POST /identity/v3/services => generated 242 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:53.547436 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ed9a9-87ae-4657-a2cd-7499ed6ddd37 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:53.547935 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ed9a9-87ae-4657-a2cd-7499ed6ddd37 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:53.547935 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ed9a9-87ae-4657-a2cd-7499ed6ddd37 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:53.549448 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 509/1017] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:03:53.554480 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165c53b-1f38-4bdd-a248-d776aae73ec5 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:53.554771 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165c53b-1f38-4bdd-a248-d776aae73ec5 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:53.555046 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165c53b-1f38-4bdd-a248-d776aae73ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:53.571997 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-1165c53b-1f38-4bdd-a248-d776aae73ec5 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:53.573207 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-1165c53b-1f38-4bdd-a248-d776aae73ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:53.647716 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 509/1018] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:53 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:03:53.671857 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ed9a9-87ae-4657-a2cd-7499ed6ddd37 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:53.686534 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:53.778556 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ed9a9-87ae-4657-a2cd-7499ed6ddd37 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:53.814576 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a99cd-8d06-4c64-9672-a83afcb1fa84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:53.815280 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a99cd-8d06-4c64-9672-a83afcb1fa84 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:53.815557 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a99cd-8d06-4c64-9672-a83afcb1fa84 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:53.815827 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a99cd-8d06-4c64-9672-a83afcb1fa84 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:53.817021 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a99cd-8d06-4c64-9672-a83afcb1fa84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:53.818435 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a99cd-8d06-4c64-9672-a83afcb1fa84 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:53.820051 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 510/1019] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:53.826068 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165c53b-1f38-4bdd-a248-d776aae73ec5 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:53.911717 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:53.930881 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165c53b-1f38-4bdd-a248-d776aae73ec5 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:53.965731 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03a109-c3e8-492f-98a0-46775ba09a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:53.966390 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03a109-c3e8-492f-98a0-46775ba09a85 None admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:53.966785 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03a109-c3e8-492f-98a0-46775ba09a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:53.967194 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03a109-c3e8-492f-98a0-46775ba09a85 None admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:53.967955 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d03a109-c3e8-492f-98a0-46775ba09a85 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:53.969426 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d03a109-c3e8-492f-98a0-46775ba09a85 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:54.064178 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 510/1020] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Jun 3 13:03:53 2022] POST /identity/v3/projects => generated 311 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:03:54.973455 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ecbb8-a629-47f7-b133-a49917676714 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:54.974015 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ecbb8-a629-47f7-b133-a49917676714 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:54.974015 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ecbb8-a629-47f7-b133-a49917676714 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:54.975354 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 511/1021] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:03:54.980765 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060ab0c-03a1-4dd0-9125-146293fbaf4d None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:54.981525 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060ab0c-03a1-4dd0-9125-146293fbaf4d None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:54.981953 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060ab0c-03a1-4dd0-9125-146293fbaf4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:55.002698 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-9060ab0c-03a1-4dd0-9125-146293fbaf4d None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:55.003915 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-9060ab0c-03a1-4dd0-9125-146293fbaf4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:55.076209 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 511/1022] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:03:55.099994 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ecbb8-a629-47f7-b133-a49917676714 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:55.184987 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:55.206754 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ecbb8-a629-47f7-b133-a49917676714 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:55.244573 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639cfc9-682f-455a-90ad-db97d36c259a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:55.245295 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639cfc9-682f-455a-90ad-db97d36c259a None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:55.245576 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639cfc9-682f-455a-90ad-db97d36c259a None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:55.245856 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639cfc9-682f-455a-90ad-db97d36c259a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:55.256573 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639cfc9-682f-455a-90ad-db97d36c259a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:03:55.265318 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-6639cfc9-682f-455a-90ad-db97d36c259a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 13:03:55.265318 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:55.265318 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:55.265318 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:55.265318 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:55.265318 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:55.265318 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:55.265318 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:55.265318 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:55.265318 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:55.265318 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:55.265318 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:55.265318 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:03:55.265318 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:03:55.265318 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:03:55.265318 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:03:55.266251 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:03:55.266251 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:03:55.266251 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:03:55.266251 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:03:55.266251 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:55.266251 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:55.266251 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:55.266251 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:55.266251 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:55.266251 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:55.266251 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:55.266251 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:55.266251 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:55.266251 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:55.266251 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:55.266251 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:55.267107 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:55.267107 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:55.267107 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:55.267107 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:55.267107 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:03:55.267107 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:03:55.267107 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:03:55.267107 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:03:55.267107 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:03:55.267107 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:03:55.267107 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 13:03:55.267107 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:55.271421 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 512/1023] 10.222.0.61 () {56 vars in 1120 bytes} [Fri Jun 3 13:03:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:55.272809 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060ab0c-03a1-4dd0-9125-146293fbaf4d None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:55.335282 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:55.374970 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060ab0c-03a1-4dd0-9125-146293fbaf4d None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:55.408768 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cffaf07-c20c-490e-ac9c-22b6b78fca08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:55.409443 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cffaf07-c20c-490e-ac9c-22b6b78fca08 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:55.409729 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cffaf07-c20c-490e-ac9c-22b6b78fca08 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:55.410004 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cffaf07-c20c-490e-ac9c-22b6b78fca08 None admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:55.410746 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cffaf07-c20c-490e-ac9c-22b6b78fca08 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:55.411086 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cffaf07-c20c-490e-ac9c-22b6b78fca08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:55.412464 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cffaf07-c20c-490e-ac9c-22b6b78fca08 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:55.425934 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 512/1024] 10.222.0.61 () {56 vars in 1115 bytes} [Fri Jun 3 13:03:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:55.427300 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639cfc9-682f-455a-90ad-db97d36c259a None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:55.522757 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61d161-73c5-43a2-b2be-6108b1e7719f None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:55.522963 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61d161-73c5-43a2-b2be-6108b1e7719f None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:55.523227 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61d161-73c5-43a2-b2be-6108b1e7719f None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:55.524638 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 513/1025] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:03:55.529681 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765c0b4-7d9d-4fdd-a889-2ebc0bd701cd None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:55.529971 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765c0b4-7d9d-4fdd-a889-2ebc0bd701cd None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:55.530248 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765c0b4-7d9d-4fdd-a889-2ebc0bd701cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:55.534423 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639cfc9-682f-455a-90ad-db97d36c259a None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:55.548239 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-5765c0b4-7d9d-4fdd-a889-2ebc0bd701cd None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:55.549417 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-5765c0b4-7d9d-4fdd-a889-2ebc0bd701cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:55.576456 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df12dd2-c8a8-4a46-b291-612b965063fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:55.578133 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df12dd2-c8a8-4a46-b291-612b965063fb None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:55.578571 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df12dd2-c8a8-4a46-b291-612b965063fb None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:55.579199 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df12dd2-c8a8-4a46-b291-612b965063fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:55.591133 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:55.593987 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df12dd2-c8a8-4a46-b291-612b965063fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:55.596085 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df12dd2-c8a8-4a46-b291-612b965063fb None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:55.619256 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-5df12dd2-c8a8-4a46-b291-612b965063fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:55.619256 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:55.619256 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:55.619256 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:55.619256 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:55.619256 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:55.619256 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:55.619256 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:55.619256 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:55.619256 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:55.619256 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:55.619256 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:55.619256 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:03:55.619256 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:03:55.619256 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:03:55.620207 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:03:55.620207 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:55.620207 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:55.620207 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:55.620207 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:55.620207 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:55.620207 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:55.620207 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:55.620207 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:55.620207 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:55.620207 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:55.620207 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:55.620207 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:55.620207 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:55.620207 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:55.620207 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:55.620207 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:55.621133 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:03:55.621133 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:03:55.621133 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:55.621133 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:55.624487 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 514/1026] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 13:03:55.625659 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 513/1027] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:55.626693 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5765c0b4-7d9d-4fdd-a889-2ebc0bd701cd None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:55.643121 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df12dd2-c8a8-4a46-b291-612b965063fb None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:55.687718 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:55.733984 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5765c0b4-7d9d-4fdd-a889-2ebc0bd701cd None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:55.755098 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df12dd2-c8a8-4a46-b291-612b965063fb None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:55.772040 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceda94b-c7b6-455f-8575-730bb5aa2211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:55.772742 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceda94b-c7b6-455f-8575-730bb5aa2211 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:55.773130 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceda94b-c7b6-455f-8575-730bb5aa2211 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:55.773355 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceda94b-c7b6-455f-8575-730bb5aa2211 None admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:55.774072 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceda94b-c7b6-455f-8575-730bb5aa2211 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:55.774378 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceda94b-c7b6-455f-8575-730bb5aa2211 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:55.775954 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceda94b-c7b6-455f-8575-730bb5aa2211 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:55.789624 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 515/1028] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:55.795650 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ac13b-ecb7-4cd2-b847-54a88102066c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:55.796231 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceda94b-c7b6-455f-8575-730bb5aa2211 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:55.796485 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ac13b-ecb7-4cd2-b847-54a88102066c None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:55.796766 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ac13b-ecb7-4cd2-b847-54a88102066c None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:55.797097 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ac13b-ecb7-4cd2-b847-54a88102066c None admin] PATH_INFO: `/v3/services/image` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:55.797689 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ac13b-ecb7-4cd2-b847-54a88102066c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:55.799060 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ac13b-ecb7-4cd2-b847-54a88102066c None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:55.810957 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-db5ac13b-ecb7-4cd2-b847-54a88102066c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 13:03:55.810957 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:55.810957 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 13:03:55.810957 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 13:03:55.810957 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 13:03:55.810957 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 13:03:55.810957 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 13:03:55.810957 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:03:55.810957 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 13:03:55.810957 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:55.810957 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 13:03:55.810957 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:55.810957 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:55.810957 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:55.810957 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:55.810957 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:55.810957 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:55.811980 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:55.811980 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:55.811980 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:55.811980 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:55.811980 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:55.811980 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:55.811980 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 13:03:55.811980 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 13:03:55.811980 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 13:03:55.811980 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 13:03:55.811980 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:55.811980 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:55.811980 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:55.811980 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:55.811980 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:55.811980 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:55.817308 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:55.817308 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:55.817308 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:55.817308 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:55.817308 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:55.817308 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:55.817308 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:55.817308 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:55.817308 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:55.817308 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:55.817308 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 13:03:55.817308 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:03:55.817308 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 13:03:55.817308 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:55.817308 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 514/1029] 10.222.0.61 () {56 vars in 1105 bytes} [Fri Jun 3 13:03:55 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:03:55.818510 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ac13b-ecb7-4cd2-b847-54a88102066c None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:55.880885 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:55.915287 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceda94b-c7b6-455f-8575-730bb5aa2211 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:55.928574 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ac13b-ecb7-4cd2-b847-54a88102066c None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:55.935463 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:55.954420 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570f813-5a76-4abf-a0b4-37e9eb6722fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:55.955259 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570f813-5a76-4abf-a0b4-37e9eb6722fa None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:55.955570 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570f813-5a76-4abf-a0b4-37e9eb6722fa None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:55.955847 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570f813-5a76-4abf-a0b4-37e9eb6722fa None admin] PATH_INFO: `/v3/users/nova` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:55.963225 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9570f813-5a76-4abf-a0b4-37e9eb6722fa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:55.964165 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c04b6-e1f8-467b-99bb-d31a472ac703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:55.964720 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9570f813-5a76-4abf-a0b4-37e9eb6722fa None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:55.964827 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c04b6-e1f8-467b-99bb-d31a472ac703 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:55.965115 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c04b6-e1f8-467b-99bb-d31a472ac703 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:55.965374 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c04b6-e1f8-467b-99bb-d31a472ac703 None admin] PATH_INFO: `/v3/services` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:55.966079 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c04b6-e1f8-467b-99bb-d31a472ac703 None admin] RBAC: Adding query filter params (name=image) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:55.966409 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c04b6-e1f8-467b-99bb-d31a472ac703 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:55.968606 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c04b6-e1f8-467b-99bb-d31a472ac703 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:55.979019 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 515/1030] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:55.980042 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c04b6-e1f8-467b-99bb-d31a472ac703 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:55.980860 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-9570f813-5a76-4abf-a0b4-37e9eb6722fa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 13:03:55.980860 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:55.980860 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:55.980860 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:55.980860 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:55.980860 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:55.980860 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:55.980860 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:55.980860 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:55.980860 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:55.980860 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:55.980860 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:55.980860 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 13:03:55.980860 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 13:03:55.980860 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 13:03:55.980860 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 13:03:55.982234 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:55.982234 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:55.982234 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 13:03:55.982234 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:03:55.982234 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 13:03:55.982234 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:03:55.982234 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:55.982234 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:55.982234 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:55.982234 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:55.982234 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:55.982234 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:55.982234 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:55.982234 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:55.982234 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:55.982234 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:55.982234 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:55.982234 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:55.983731 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:55.983731 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:55.983731 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 13:03:55.983731 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 13:03:55.983731 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 13:03:55.983731 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 13:03:55.983731 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 13:03:55.983731 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 13:03:55.983731 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 13:03:55.983731 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:55.983731 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 516/1031] 10.222.0.61 () {56 vars in 1093 bytes} [Fri Jun 3 13:03:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:03:55.991165 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570f813-5a76-4abf-a0b4-37e9eb6722fa None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:56.097982 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c04b6-e1f8-467b-99bb-d31a472ac703 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:56.098526 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570f813-5a76-4abf-a0b4-37e9eb6722fa None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:56.119613 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:56.134586 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbbee5e-7a4e-4741-ba78-84289713109b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:56.134786 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5803fb3-2691-4945-98e7-d62787c53a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:56.135263 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbee5e-7a4e-4741-ba78-84289713109b None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:56.135375 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5803fb3-2691-4945-98e7-d62787c53a33 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:56.135546 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5803fb3-2691-4945-98e7-d62787c53a33 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:56.135649 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbee5e-7a4e-4741-ba78-84289713109b None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:56.135809 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbee5e-7a4e-4741-ba78-84289713109b None admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:56.135904 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5803fb3-2691-4945-98e7-d62787c53a33 None admin] PATH_INFO: `/v3/services` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:56.136564 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5803fb3-2691-4945-98e7-d62787c53a33 None admin] RBAC: Adding query filter params (type=image) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:56.136678 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbbee5e-7a4e-4741-ba78-84289713109b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:56.136874 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5803fb3-2691-4945-98e7-d62787c53a33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:56.136972 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbbee5e-7a4e-4741-ba78-84289713109b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:56.138239 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5803fb3-2691-4945-98e7-d62787c53a33 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:56.139008 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbbee5e-7a4e-4741-ba78-84289713109b None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:56.148459 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 516/1032] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:55 2022] GET /identity/v3/services?type=image => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:03:56.149816 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5803fb3-2691-4945-98e7-d62787c53a33 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:56.162434 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 517/1033] 10.222.0.61 () {56 vars in 1133 bytes} [Fri Jun 3 13:03:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:03:56.163511 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbbee5e-7a4e-4741-ba78-84289713109b None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:56.198218 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:56.262608 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5803fb3-2691-4945-98e7-d62787c53a33 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:56.271366 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbbee5e-7a4e-4741-ba78-84289713109b None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:56.300247 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d6fcb8-a3e2-4788-a97f-0127e0fc0c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:56.301041 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6fcb8-a3e2-4788-a97f-0127e0fc0c2b None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:56.301243 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6fcb8-a3e2-4788-a97f-0127e0fc0c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:56.301475 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6fcb8-a3e2-4788-a97f-0127e0fc0c2b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:56.302339 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d6fcb8-a3e2-4788-a97f-0127e0fc0c2b None admin] RBAC: Adding query filter params (interface=public, service_id=8243269a01774b37a9a600cafacef447, region_id=RegionOne) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:56.302609 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d6fcb8-a3e2-4788-a97f-0127e0fc0c2b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:56.304050 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d6fcb8-a3e2-4788-a97f-0127e0fc0c2b None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:56.309316 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa08d3-229f-4d16-af74-2d8611d9b8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:56.309965 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa08d3-229f-4d16-af74-2d8611d9b8e1 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:56.310246 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa08d3-229f-4d16-af74-2d8611d9b8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:56.311156 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa08d3-229f-4d16-af74-2d8611d9b8e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:56.315137 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 517/1034] 10.222.0.61 () {56 vars in 1251 bytes} [Fri Jun 3 13:03:56 2022] GET /identity/v3/endpoints?service_id=8243269a01774b37a9a600cafacef447&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:03:56.316899 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d6fcb8-a3e2-4788-a97f-0127e0fc0c2b None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:56.370405 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:56.385921 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa08d3-229f-4d16-af74-2d8611d9b8e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:56.389700 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa08d3-229f-4d16-af74-2d8611d9b8e1 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:56.421006 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:56.421170 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d6fcb8-a3e2-4788-a97f-0127e0fc0c2b None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:56.454009 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7142a-72ea-4ea3-98bd-90d5087a8c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:56.454674 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7142a-72ea-4ea3-98bd-90d5087a8c12 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:56.454960 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7142a-72ea-4ea3-98bd-90d5087a8c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:56.455238 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7142a-72ea-4ea3-98bd-90d5087a8c12 None admin] PATH_INFO: `/v3/services` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:56.455947 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7142a-72ea-4ea3-98bd-90d5087a8c12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:56.457309 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7142a-72ea-4ea3-98bd-90d5087a8c12 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:56.463813 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 518/1035] 10.222.0.61 () {56 vars in 1087 bytes} [Fri Jun 3 13:03:56 2022] GET /identity/v3/services => generated 1957 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:03:56.465064 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b281479-e25f-4791-90cc-631596332c5b None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:56.465355 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b281479-e25f-4791-90cc-631596332c5b None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:56.465636 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b281479-e25f-4791-90cc-631596332c5b None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:56.467479 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 519/1036] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:03:56.473824 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e5a2f-a73e-4c60-b88b-07c226610892 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:56.474138 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e5a2f-a73e-4c60-b88b-07c226610892 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:56.474419 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e5a2f-a73e-4c60-b88b-07c226610892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:56.493822 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-1d5e5a2f-a73e-4c60-b88b-07c226610892 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:56.495419 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-1d5e5a2f-a73e-4c60-b88b-07c226610892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:56.497158 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 518/1037] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:03:56 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 13:03:56.503840 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa08d3-229f-4d16-af74-2d8611d9b8e1 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:56.580179 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 520/1038] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:56 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 13:03:56.596748 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e5a2f-a73e-4c60-b88b-07c226610892 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:56.629545 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa08d3-229f-4d16-af74-2d8611d9b8e1 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:56.642456 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:56.671669 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34facbfe-5a10-4bed-8763-b5b0a587f81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:56.671910 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34facbfe-5a10-4bed-8763-b5b0a587f81a None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:56.672125 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34facbfe-5a10-4bed-8763-b5b0a587f81a None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:56.673126 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34facbfe-5a10-4bed-8763-b5b0a587f81a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:56.676223 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:56.684293 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34facbfe-5a10-4bed-8763-b5b0a587f81a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:56.687198 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34facbfe-5a10-4bed-8763-b5b0a587f81a None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:56.706933 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e5a2f-a73e-4c60-b88b-07c226610892 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:56.707914 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-34facbfe-5a10-4bed-8763-b5b0a587f81a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:56.707914 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:56.707914 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:56.707914 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:56.707914 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:56.707914 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:56.707914 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:56.707914 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:56.707914 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:56.707914 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:56.707914 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:56.707914 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:56.707914 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:03:56.707914 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:03:56.707914 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:03:56.708897 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:03:56.708897 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:56.708897 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:56.708897 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:56.708897 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:56.708897 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:56.708897 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:56.708897 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:56.708897 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:56.708897 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:56.708897 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:56.708897 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:56.708897 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:56.708897 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:56.708897 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:56.708897 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:56.708897 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:56.709808 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:03:56.709808 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:03:56.709808 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:03:56.709808 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:56.712269 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 519/1039] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:03:56.717916 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34facbfe-5a10-4bed-8763-b5b0a587f81a None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:56.752394 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09364039-d56c-4868-bea9-30c67c956cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:56.753192 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09364039-d56c-4868-bea9-30c67c956cb6 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:56.753470 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09364039-d56c-4868-bea9-30c67c956cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:56.753743 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09364039-d56c-4868-bea9-30c67c956cb6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:56.755640 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09364039-d56c-4868-bea9-30c67c956cb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:56.756345 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09364039-d56c-4868-bea9-30c67c956cb6 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:56.762689 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 521/1040] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:03:56.764722 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09364039-d56c-4868-bea9-30c67c956cb6 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:56.826222 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34facbfe-5a10-4bed-8763-b5b0a587f81a None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:56.864683 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbca94a-bc95-4628-98c4-9f395847162c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:56.865441 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbca94a-bc95-4628-98c4-9f395847162c None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:56.865721 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbca94a-bc95-4628-98c4-9f395847162c None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:56.865992 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbca94a-bc95-4628-98c4-9f395847162c None admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:56.866716 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbca94a-bc95-4628-98c4-9f395847162c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:56.867021 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbca94a-bc95-4628-98c4-9f395847162c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:56.868676 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbca94a-bc95-4628-98c4-9f395847162c None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:56.870940 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09364039-d56c-4868-bea9-30c67c956cb6 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:56.882085 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:56.882672 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 520/1041] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:03:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:03:56.887036 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbca94a-bc95-4628-98c4-9f395847162c None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:56.912590 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1982d63-cb76-42ad-9d9c-e112c1ad3eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:56.913260 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1982d63-cb76-42ad-9d9c-e112c1ad3eb5 None admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:56.913543 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1982d63-cb76-42ad-9d9c-e112c1ad3eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:56.913822 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1982d63-cb76-42ad-9d9c-e112c1ad3eb5 None admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:56.914519 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1982d63-cb76-42ad-9d9c-e112c1ad3eb5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:56.915965 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1982d63-cb76-42ad-9d9c-e112c1ad3eb5 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:56.939273 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:56.990918 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbca94a-bc95-4628-98c4-9f395847162c None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:57.016779 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 522/1042] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jun 3 13:03:56 2022] POST /identity/v3/users => generated 285 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:03:57.037489 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5879ad7-a0a8-4793-b012-d2e3775db50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:57.038341 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5879ad7-a0a8-4793-b012-d2e3775db50c None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:57.038630 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5879ad7-a0a8-4793-b012-d2e3775db50c None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:57.038908 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5879ad7-a0a8-4793-b012-d2e3775db50c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:57.048367 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5879ad7-a0a8-4793-b012-d2e3775db50c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:57.049893 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5879ad7-a0a8-4793-b012-d2e3775db50c None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:57.067264 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-c5879ad7-a0a8-4793-b012-d2e3775db50c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:03:57.067264 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:57.067264 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:57.067264 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:57.067264 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:57.067264 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:57.067264 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:57.067264 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:57.067264 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:57.067264 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:57.067264 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:57.067264 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:57.067264 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 13:03:57.067264 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 13:03:57.067264 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 13:03:57.068443 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 13:03:57.068443 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:57.068443 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:57.068443 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:57.068443 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:57.068443 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:57.068443 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:57.068443 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:57.068443 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:57.068443 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:57.068443 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:57.068443 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:57.068443 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:57.068443 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:57.068443 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:57.068443 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:57.068443 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:57.069358 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 13:03:57.069358 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 13:03:57.069358 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 13:03:57.069358 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 13:03:57.069358 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 13:03:57.069358 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 13:03:57.069358 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:03:57.069358 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:57.069358 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 521/1043] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:03:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:03:57.074529 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1982d63-cb76-42ad-9d9c-e112c1ad3eb5 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:57.186171 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1982d63-cb76-42ad-9d9c-e112c1ad3eb5 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:57.222107 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ceb2c9-2936-4a57-a783-1fca3782a57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:57.222776 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ceb2c9-2936-4a57-a783-1fca3782a57d None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:57.223057 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ceb2c9-2936-4a57-a783-1fca3782a57d None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:57.223584 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ceb2c9-2936-4a57-a783-1fca3782a57d None admin] PATH_INFO: `/v3/projects` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:57.224399 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ceb2c9-2936-4a57-a783-1fca3782a57d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:57.224707 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ceb2c9-2936-4a57-a783-1fca3782a57d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:57.226131 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ceb2c9-2936-4a57-a783-1fca3782a57d None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:57.241638 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 523/1044] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 13:03:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:57.246244 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5879ad7-a0a8-4793-b012-d2e3775db50c None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:57.354800 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5879ad7-a0a8-4793-b012-d2e3775db50c None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:57.363110 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:57.389217 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968354c-a7f5-4cd5-9696-98856dbfd8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:57.389871 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968354c-a7f5-4cd5-9696-98856dbfd8cb None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:57.390154 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968354c-a7f5-4cd5-9696-98856dbfd8cb None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:57.390430 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968354c-a7f5-4cd5-9696-98856dbfd8cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:57.391316 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8968354c-a7f5-4cd5-9696-98856dbfd8cb None admin] RBAC: Adding query filter params (role.id=597251d134b24da6a79c4005736005a4, scope.project.id=c8c0bf799c9f451b8167a646a5c82eda, user.id=066aaba3e9af4f85ab0cba89a3d32e34) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:57.391626 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8968354c-a7f5-4cd5-9696-98856dbfd8cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:57.393106 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8968354c-a7f5-4cd5-9696-98856dbfd8cb None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:57.400222 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 522/1045] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 13:03:57 2022] GET /identity/v3/role_assignments?user.id=066aaba3e9af4f85ab0cba89a3d32e34&scope.project.id=c8c0bf799c9f451b8167a646a5c82eda&role.id=597251d134b24da6a79c4005736005a4 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:58.772892 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424d97b-6f5d-4335-9ae3-e684db5fe7a2 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:58.773521 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424d97b-6f5d-4335-9ae3-e684db5fe7a2 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:58.773521 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424d97b-6f5d-4335-9ae3-e684db5fe7a2 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:58.774928 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 524/1046] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:03:58.780417 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec573ebf-5f20-45c6-8114-f48f6e777d67 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:58.780836 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec573ebf-5f20-45c6-8114-f48f6e777d67 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:58.781002 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec573ebf-5f20-45c6-8114-f48f6e777d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:58.797922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-ec573ebf-5f20-45c6-8114-f48f6e777d67 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:58.799098 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-ec573ebf-5f20-45c6-8114-f48f6e777d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:58.864768 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 523/1047] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:58 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:03:58.886541 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c424d97b-6f5d-4335-9ae3-e684db5fe7a2 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:58.914554 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:58.995253 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c424d97b-6f5d-4335-9ae3-e684db5fe7a2 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:59.034014 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21918e13-0310-42d1-81c8-90195fcdde31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:59.034720 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21918e13-0310-42d1-81c8-90195fcdde31 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:59.034999 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21918e13-0310-42d1-81c8-90195fcdde31 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:59.035272 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21918e13-0310-42d1-81c8-90195fcdde31 None admin] PATH_INFO: `/v3/services/image` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:59.035914 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21918e13-0310-42d1-81c8-90195fcdde31 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:59.037323 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21918e13-0310-42d1-81c8-90195fcdde31 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:59.049438 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-21918e13-0310-42d1-81c8-90195fcdde31 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 13:03:59.049438 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:59.049438 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 13:03:59.049438 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 13:03:59.049438 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 13:03:59.049438 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 13:03:59.049438 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 13:03:59.049438 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:03:59.049438 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 13:03:59.049438 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:59.049438 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 13:03:59.049438 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:59.049438 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:59.049438 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:59.049438 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:59.049438 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:59.049438 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:59.050540 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:59.050540 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:59.050540 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:59.050540 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:59.050540 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:59.050540 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:59.050540 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 13:03:59.050540 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 13:03:59.050540 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 13:03:59.050540 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 13:03:59.050540 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:59.050540 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:59.050540 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:59.050540 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:59.050540 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:59.050540 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:59.051528 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:59.051528 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:59.051528 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:59.051528 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:59.051528 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:59.051528 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:59.051528 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:59.051528 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:59.051528 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:59.051528 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:59.051528 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 13:03:59.051528 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:03:59.051528 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 13:03:59.051528 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:59.055665 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 525/1048] 10.222.0.61 () {56 vars in 1105 bytes} [Fri Jun 3 13:03:58 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:03:59.056544 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec573ebf-5f20-45c6-8114-f48f6e777d67 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:59.157527 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:59.161158 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec573ebf-5f20-45c6-8114-f48f6e777d67 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:59.193629 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb2dff-80d8-48a3-9fd0-91f67df9db46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:59.194291 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb2dff-80d8-48a3-9fd0-91f67df9db46 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:59.194570 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb2dff-80d8-48a3-9fd0-91f67df9db46 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:59.194842 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb2dff-80d8-48a3-9fd0-91f67df9db46 None admin] PATH_INFO: `/v3/services` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:59.195545 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeb2dff-80d8-48a3-9fd0-91f67df9db46 None admin] RBAC: Adding query filter params (name=image) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:59.195845 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeb2dff-80d8-48a3-9fd0-91f67df9db46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:59.197249 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeb2dff-80d8-48a3-9fd0-91f67df9db46 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:59.204479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 524/1049] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:59.208509 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21918e13-0310-42d1-81c8-90195fcdde31 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:59.302109 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:59.312033 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21918e13-0310-42d1-81c8-90195fcdde31 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:59.351813 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7dea4-8da2-4ce6-94ce-c3cbc77dcdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:59.352527 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7dea4-8da2-4ce6-94ce-c3cbc77dcdd5 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:59.352807 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7dea4-8da2-4ce6-94ce-c3cbc77dcdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:59.353079 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7dea4-8da2-4ce6-94ce-c3cbc77dcdd5 None admin] PATH_INFO: `/v3/services` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:59.353789 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd7dea4-8da2-4ce6-94ce-c3cbc77dcdd5 None admin] RBAC: Adding query filter params (type=image) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:59.354093 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd7dea4-8da2-4ce6-94ce-c3cbc77dcdd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:59.355464 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd7dea4-8da2-4ce6-94ce-c3cbc77dcdd5 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:59.367150 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 526/1050] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:03:59 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:03:59.368091 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb2dff-80d8-48a3-9fd0-91f67df9db46 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:59.436440 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e46c89-b361-4018-8041-ccf9e1cd976a None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:59.436864 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e46c89-b361-4018-8041-ccf9e1cd976a None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:59.437141 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e46c89-b361-4018-8041-ccf9e1cd976a None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:59.438637 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 527/1051] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:03:59.443460 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c27ad6-0260-4979-8352-617757bf93ba None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:59.443741 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c27ad6-0260-4979-8352-617757bf93ba None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:59.444014 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c27ad6-0260-4979-8352-617757bf93ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:59.460585 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-59c27ad6-0260-4979-8352-617757bf93ba None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:59.461786 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-59c27ad6-0260-4979-8352-617757bf93ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:59.469524 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb2dff-80d8-48a3-9fd0-91f67df9db46 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:59.506841 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833e7bf7-3083-46f2-a129-a526d7ef92b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:59.507491 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e7bf7-3083-46f2-a129-a526d7ef92b7 None admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:59.507768 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e7bf7-3083-46f2-a129-a526d7ef92b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:59.508039 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e7bf7-3083-46f2-a129-a526d7ef92b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:59.508818 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833e7bf7-3083-46f2-a129-a526d7ef92b7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:59.510183 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833e7bf7-3083-46f2-a129-a526d7ef92b7 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:59.531834 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 528/1052] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:59 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 13:03:59.555482 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c27ad6-0260-4979-8352-617757bf93ba None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:59.593477 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 525/1053] 10.222.0.61 () {60 vars in 1144 bytes} [Fri Jun 3 13:03:59 2022] POST /identity/v3/endpoints => generated 327 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:03:59.646739 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:59.665328 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c27ad6-0260-4979-8352-617757bf93ba None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:59.668062 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c125ca-7c06-4ce4-b9a9-2341d60f2c07 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:59.668407 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c125ca-7c06-4ce4-b9a9-2341d60f2c07 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:59.668692 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c125ca-7c06-4ce4-b9a9-2341d60f2c07 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:59.671039 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 526/1054] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:03:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 13:03:59.676900 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b02004-8f5f-4afb-a2ad-6e21093d7971 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:59.677217 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b02004-8f5f-4afb-a2ad-6e21093d7971 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:59.677496 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b02004-8f5f-4afb-a2ad-6e21093d7971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:59.695050 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-06b02004-8f5f-4afb-a2ad-6e21093d7971 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:03:59.696605 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-06b02004-8f5f-4afb-a2ad-6e21093d7971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:03:59.713054 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c365e-97f4-4b01-a8be-9d3ddef68b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:59.713308 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:59.713859 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c365e-97f4-4b01-a8be-9d3ddef68b5d None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:59.714140 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c365e-97f4-4b01-a8be-9d3ddef68b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:59.714411 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c365e-97f4-4b01-a8be-9d3ddef68b5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:59.726750 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c365e-97f4-4b01-a8be-9d3ddef68b5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:03:59.735203 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-945c365e-97f4-4b01-a8be-9d3ddef68b5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:03:59.735203 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:59.735203 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:59.735203 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:59.735203 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:59.735203 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:59.735203 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:59.735203 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:59.735203 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:59.735203 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:59.735203 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:59.735203 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:59.735203 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:03:59.735203 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:03:59.735203 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:03:59.735203 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:03:59.736273 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:03:59.736273 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:03:59.736273 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:03:59.736273 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:03:59.736273 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:59.736273 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:59.736273 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:59.736273 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:59.736273 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:59.736273 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:59.736273 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:59.736273 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:59.736273 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:59.736273 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:59.736273 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:59.736273 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:59.737338 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:59.737338 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:59.737338 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:59.737338 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:59.737338 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:03:59.737338 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:03:59.737338 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:03:59.737338 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:03:59.737338 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:03:59.737338 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:03:59.737338 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:03:59.737338 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:03:59.737338 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 529/1055] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 13:03:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:03:59.742775 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c365e-97f4-4b01-a8be-9d3ddef68b5d None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:59.778537 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 527/1056] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:03:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 13:03:59.802610 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b02004-8f5f-4afb-a2ad-6e21093d7971 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:59.856778 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c365e-97f4-4b01-a8be-9d3ddef68b5d None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:59.893916 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ae0ed-7a34-40ea-88df-553bbbf63d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:59.894587 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ae0ed-7a34-40ea-88df-553bbbf63d24 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:59.894873 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ae0ed-7a34-40ea-88df-553bbbf63d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:59.895149 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ae0ed-7a34-40ea-88df-553bbbf63d24 None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:59.895896 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73ae0ed-7a34-40ea-88df-553bbbf63d24 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:03:59.896227 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73ae0ed-7a34-40ea-88df-553bbbf63d24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:03:59.897599 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73ae0ed-7a34-40ea-88df-553bbbf63d24 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:03:59.907450 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 530/1057] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:03:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:03:59.913701 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ae0ed-7a34-40ea-88df-553bbbf63d24 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:03:59.913990 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b02004-8f5f-4afb-a2ad-6e21093d7971 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:03:59.917535 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:59.953931 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e196dd32-fab9-488e-982b-7564dd9fbb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:03:59.954739 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196dd32-fab9-488e-982b-7564dd9fbb5b None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:03:59.955017 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196dd32-fab9-488e-982b-7564dd9fbb5b None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:03:59.955284 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196dd32-fab9-488e-982b-7564dd9fbb5b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:03:59.966134 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e196dd32-fab9-488e-982b-7564dd9fbb5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:03:59.975554 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-e196dd32-fab9-488e-982b-7564dd9fbb5b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 13:03:59.975554 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:03:59.975554 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:03:59.975554 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:03:59.975554 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:03:59.975554 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:03:59.975554 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:03:59.975554 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:03:59.975554 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:03:59.975554 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:03:59.975554 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:03:59.975554 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:03:59.975554 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:03:59.975554 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:03:59.975554 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:03:59.975554 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:03:59.976593 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:03:59.976593 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:03:59.976593 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:03:59.976593 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:03:59.976593 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:03:59.976593 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:03:59.976593 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:03:59.976593 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:03:59.976593 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:03:59.976593 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:03:59.976593 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:03:59.976593 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:03:59.976593 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:03:59.976593 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:03:59.976593 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:03:59.976593 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:03:59.977473 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:03:59.977473 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:03:59.977473 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:03:59.977473 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:03:59.977473 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:03:59.977473 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:03:59.977473 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:03:59.977473 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:03:59.977473 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:03:59.977473 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:03:59.977473 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 13:03:59.977473 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:03:59.977473 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 528/1058] 10.222.0.61 () {56 vars in 1120 bytes} [Fri Jun 3 13:03:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:03:59.982674 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e196dd32-fab9-488e-982b-7564dd9fbb5b None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:00.003402 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:00.024461 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ae0ed-7a34-40ea-88df-553bbbf63d24 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:00.060636 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ba62c-aa22-4f17-b4f2-6c69dbb81455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:00.061501 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ba62c-aa22-4f17-b4f2-6c69dbb81455 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:00.061785 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ba62c-aa22-4f17-b4f2-6c69dbb81455 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:00.062053 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ba62c-aa22-4f17-b4f2-6c69dbb81455 None admin] PATH_INFO: `/v3/users/fea68ffa98b04eaba06f4d613b779ae3` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:00.078046 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ba62c-aa22-4f17-b4f2-6c69dbb81455 None admin] RBAC: Authorizing `identity:get_user(user_id=fea68ffa98b04eaba06f4d613b779ae3)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:00.079399 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ba62c-aa22-4f17-b4f2-6c69dbb81455 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:00.081280 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 531/1059] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 13:03:59 2022] GET /identity/v3/users/fea68ffa98b04eaba06f4d613b779ae3 => generated 285 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:04:00.086607 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ba62c-aa22-4f17-b4f2-6c69dbb81455 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:00.095134 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e196dd32-fab9-488e-982b-7564dd9fbb5b None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:00.136221 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae785a3-00aa-4533-b21f-f5c87085bfec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:00.136822 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae785a3-00aa-4533-b21f-f5c87085bfec None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:00.137113 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae785a3-00aa-4533-b21f-f5c87085bfec None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:00.137390 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae785a3-00aa-4533-b21f-f5c87085bfec None admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:00.138145 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae785a3-00aa-4533-b21f-f5c87085bfec None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:04:00.139108 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae785a3-00aa-4533-b21f-f5c87085bfec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:00.140806 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae785a3-00aa-4533-b21f-f5c87085bfec None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:00.151109 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:00.153831 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 529/1060] 10.222.0.61 () {56 vars in 1115 bytes} [Fri Jun 3 13:03:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:04:00.155329 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae785a3-00aa-4533-b21f-f5c87085bfec None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:00.195845 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ba62c-aa22-4f17-b4f2-6c69dbb81455 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:00.231117 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f94be9-0826-4309-85cd-dc427515bc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:00.231766 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f94be9-0826-4309-85cd-dc427515bc67 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:00.232071 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f94be9-0826-4309-85cd-dc427515bc67 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:00.232856 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f94be9-0826-4309-85cd-dc427515bc67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:00.233898 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:00.268072 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae785a3-00aa-4533-b21f-f5c87085bfec None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:00.303216 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb79f7-fb03-4748-8b14-6bcb54e5ccb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:00.304127 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb79f7-fb03-4748-8b14-6bcb54e5ccb3 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:00.304441 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb79f7-fb03-4748-8b14-6bcb54e5ccb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:00.304710 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb79f7-fb03-4748-8b14-6bcb54e5ccb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:00.304874 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f94be9-0826-4309-85cd-dc427515bc67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:00.306325 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f94be9-0826-4309-85cd-dc427515bc67 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:00.315999 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cb79f7-fb03-4748-8b14-6bcb54e5ccb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:00.317558 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cb79f7-fb03-4748-8b14-6bcb54e5ccb3 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:00.334982 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-18cb79f7-fb03-4748-8b14-6bcb54e5ccb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:04:00.334982 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:04:00.334982 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:04:00.334982 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:04:00.334982 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:04:00.334982 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:04:00.334982 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:04:00.334982 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:04:00.334982 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:04:00.334982 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:04:00.334982 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:04:00.334982 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:04:00.334982 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:04:00.334982 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:04:00.334982 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:04:00.335954 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:04:00.335954 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:04:00.335954 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:04:00.335954 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:04:00.335954 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:04:00.335954 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:04:00.335954 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:04:00.335954 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:04:00.335954 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:04:00.335954 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:04:00.335954 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:04:00.335954 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:04:00.335954 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:04:00.335954 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:04:00.335954 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:04:00.335954 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:04:00.335954 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:04:00.336886 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:04:00.336886 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:04:00.336886 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:04:00.336886 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:04:00.336886 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 530/1061] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:04:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:04:00.342156 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb79f7-fb03-4748-8b14-6bcb54e5ccb3 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:00.371720 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:00.414411 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 532/1062] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:04:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 03 13:04:00.420023 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f94be9-0826-4309-85cd-dc427515bc67 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:00.459838 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb79f7-fb03-4748-8b14-6bcb54e5ccb3 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:00.486414 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:00.498404 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb071dbe-45d5-46d9-9909-210bbdf0d1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:00.499432 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb071dbe-45d5-46d9-9909-210bbdf0d1cf None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:00.499726 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb071dbe-45d5-46d9-9909-210bbdf0d1cf None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:00.501342 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb071dbe-45d5-46d9-9909-210bbdf0d1cf None admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:00.501342 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb071dbe-45d5-46d9-9909-210bbdf0d1cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:04:00.501342 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb071dbe-45d5-46d9-9909-210bbdf0d1cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:00.503439 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb071dbe-45d5-46d9-9909-210bbdf0d1cf None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:00.522173 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 531/1063] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:04:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:04:00.523143 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb071dbe-45d5-46d9-9909-210bbdf0d1cf None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:00.526257 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f94be9-0826-4309-85cd-dc427515bc67 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:00.559807 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b44262-3b38-4189-9405-f41a7f63ef3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:00.561203 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b44262-3b38-4189-9405-f41a7f63ef3a None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:00.561484 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b44262-3b38-4189-9405-f41a7f63ef3a None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:00.561752 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b44262-3b38-4189-9405-f41a7f63ef3a None admin] PATH_INFO: `/v3/projects/2c14f94a01004e18888361fa1c56f526` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:00.562916 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b44262-3b38-4189-9405-f41a7f63ef3a None admin] RBAC: Authorizing `identity:get_project(project_id=2c14f94a01004e18888361fa1c56f526)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:00.564361 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b44262-3b38-4189-9405-f41a7f63ef3a None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:00.566042 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 533/1064] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:04:00 2022] GET /identity/v3/projects/2c14f94a01004e18888361fa1c56f526 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:04:00.571778 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b44262-3b38-4189-9405-f41a7f63ef3a None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:00.600112 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:00.632072 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb071dbe-45d5-46d9-9909-210bbdf0d1cf None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:00.672585 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9cf50a-d738-499a-ae76-0a8f0a3cc1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:00.674261 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9cf50a-d738-499a-ae76-0a8f0a3cc1c8 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:00.674748 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9cf50a-d738-499a-ae76-0a8f0a3cc1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:00.675220 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9cf50a-d738-499a-ae76-0a8f0a3cc1c8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:00.675846 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b44262-3b38-4189-9405-f41a7f63ef3a None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:00.684438 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9cf50a-d738-499a-ae76-0a8f0a3cc1c8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:00.687851 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9cf50a-d738-499a-ae76-0a8f0a3cc1c8 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:00.707595 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-4c9cf50a-d738-499a-ae76-0a8f0a3cc1c8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 13:04:00.707595 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:04:00.707595 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:04:00.707595 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:04:00.707595 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:04:00.707595 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:04:00.707595 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:04:00.707595 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:04:00.707595 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:04:00.707595 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:04:00.707595 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:04:00.707595 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:04:00.707595 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 13:04:00.707595 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 13:04:00.707595 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 13:04:00.707595 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 13:04:00.708679 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:04:00.708679 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:04:00.708679 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 13:04:00.708679 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:04:00.708679 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 13:04:00.708679 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:04:00.708679 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:04:00.708679 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:04:00.708679 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:04:00.708679 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:04:00.708679 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:04:00.708679 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:04:00.708679 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:04:00.708679 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:04:00.708679 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:04:00.708679 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:04:00.708679 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:04:00.708679 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:04:00.709700 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:04:00.709700 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:04:00.709700 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 13:04:00.709700 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 13:04:00.709700 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 13:04:00.709700 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 13:04:00.709700 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 13:04:00.709700 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 13:04:00.709700 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 13:04:00.709700 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:04:00.709700 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 532/1065] 10.222.0.61 () {56 vars in 1093 bytes} [Fri Jun 3 13:04:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:04:00.712485 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f4e89-1736-45f6-a7cf-9ec2e787ff70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:00.713132 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f4e89-1736-45f6-a7cf-9ec2e787ff70 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:00.713641 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f4e89-1736-45f6-a7cf-9ec2e787ff70 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:00.713936 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f4e89-1736-45f6-a7cf-9ec2e787ff70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:00.714417 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9cf50a-d738-499a-ae76-0a8f0a3cc1c8 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:00.714791 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f4e89-1736-45f6-a7cf-9ec2e787ff70 None admin] RBAC: Adding query filter params (role.id=bbd5f3e0c18e4992886fcfb4a3feb426, scope.project.id=2c14f94a01004e18888361fa1c56f526, user.id=fea68ffa98b04eaba06f4d613b779ae3) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:04:00.715055 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f4e89-1736-45f6-a7cf-9ec2e787ff70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:00.716589 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f4e89-1736-45f6-a7cf-9ec2e787ff70 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:00.722527 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 534/1066] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 13:04:00 2022] GET /identity/v3/role_assignments?user.id=fea68ffa98b04eaba06f4d613b779ae3&scope.project.id=2c14f94a01004e18888361fa1c56f526&role.id=bbd5f3e0c18e4992886fcfb4a3feb426 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:00.778055 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:00.839173 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9cf50a-d738-499a-ae76-0a8f0a3cc1c8 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:00.876580 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba88dd7-30a6-4a8d-819c-00fe38e7b1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:00.877262 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba88dd7-30a6-4a8d-819c-00fe38e7b1a4 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:00.877546 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba88dd7-30a6-4a8d-819c-00fe38e7b1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:00.877836 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba88dd7-30a6-4a8d-819c-00fe38e7b1a4 None admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:00.878656 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba88dd7-30a6-4a8d-819c-00fe38e7b1a4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:04:00.878965 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba88dd7-30a6-4a8d-819c-00fe38e7b1a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:00.880491 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba88dd7-30a6-4a8d-819c-00fe38e7b1a4 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:00.900725 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 533/1067] 10.222.0.61 () {56 vars in 1133 bytes} [Fri Jun 3 13:04:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:04:00.909082 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f4e89-1736-45f6-a7cf-9ec2e787ff70 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:01.004012 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:01.012492 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f4e89-1736-45f6-a7cf-9ec2e787ff70 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:01.048003 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c7ef0b-bd33-4dd5-a8fa-0973ff52a595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:01.048832 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7ef0b-bd33-4dd5-a8fa-0973ff52a595 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:01.049118 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7ef0b-bd33-4dd5-a8fa-0973ff52a595 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:01.049391 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7ef0b-bd33-4dd5-a8fa-0973ff52a595 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:01.059440 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c7ef0b-bd33-4dd5-a8fa-0973ff52a595 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:01.061099 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c7ef0b-bd33-4dd5-a8fa-0973ff52a595 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:01.078241 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-61c7ef0b-bd33-4dd5-a8fa-0973ff52a595 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:04:01.078241 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:04:01.078241 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:04:01.078241 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:04:01.078241 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:04:01.078241 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:04:01.078241 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:04:01.078241 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:04:01.078241 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:04:01.078241 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:04:01.078241 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:04:01.078241 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:04:01.078241 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:04:01.078241 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:04:01.078241 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:04:01.079132 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:04:01.079132 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:04:01.079132 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:04:01.079132 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:04:01.079132 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:04:01.079132 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:04:01.079132 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:04:01.079132 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:04:01.079132 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:04:01.079132 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:04:01.079132 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:04:01.079132 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:04:01.079132 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:04:01.079132 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:04:01.079132 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:04:01.079132 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:04:01.079132 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:04:01.080025 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:04:01.080025 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:04:01.080025 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:04:01.080025 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:04:01.080874 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 535/1068] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:04:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:04:01.085110 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba88dd7-30a6-4a8d-819c-00fe38e7b1a4 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:01.187976 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba88dd7-30a6-4a8d-819c-00fe38e7b1a4 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:01.189551 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:01.222182 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd225c1-770c-4d64-b169-9bce9d1bd6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:01.222837 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd225c1-770c-4d64-b169-9bce9d1bd6ad None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:01.223117 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd225c1-770c-4d64-b169-9bce9d1bd6ad None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:01.223640 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd225c1-770c-4d64-b169-9bce9d1bd6ad None admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:01.224375 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd225c1-770c-4d64-b169-9bce9d1bd6ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:04:01.224683 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd225c1-770c-4d64-b169-9bce9d1bd6ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:01.226052 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd225c1-770c-4d64-b169-9bce9d1bd6ad None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:01.239190 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 534/1069] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:04:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:01.244567 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c7ef0b-bd33-4dd5-a8fa-0973ff52a595 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:01.347163 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c7ef0b-bd33-4dd5-a8fa-0973ff52a595 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:01.381618 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9329c5-c5b6-4249-bc19-02038e090362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:01.382407 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9329c5-c5b6-4249-bc19-02038e090362 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:01.382746 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9329c5-c5b6-4249-bc19-02038e090362 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:01.383016 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9329c5-c5b6-4249-bc19-02038e090362 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:01.390588 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9329c5-c5b6-4249-bc19-02038e090362 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:01.391302 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9329c5-c5b6-4249-bc19-02038e090362 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:01.404857 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-5c9329c5-c5b6-4249-bc19-02038e090362 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:04:01.404857 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:04:01.404857 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:04:01.404857 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:04:01.404857 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:04:01.404857 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:04:01.404857 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:04:01.404857 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:04:01.404857 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:04:01.404857 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:04:01.404857 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:04:01.404857 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:04:01.404857 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 13:04:01.404857 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 13:04:01.404857 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 13:04:01.405801 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 13:04:01.405801 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:04:01.405801 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:04:01.405801 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:04:01.405801 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:04:01.405801 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:04:01.405801 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:04:01.405801 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:04:01.405801 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:04:01.405801 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:04:01.405801 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:04:01.405801 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:04:01.405801 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:04:01.405801 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:04:01.405801 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:04:01.405801 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:04:01.405801 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:04:01.406796 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 13:04:01.406796 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 13:04:01.406796 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 13:04:01.406796 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 13:04:01.406796 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 13:04:01.406796 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 13:04:01.406796 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:04:01.406796 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:04:01.408481 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 536/1070] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:04:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:04:01.411841 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd225c1-770c-4d64-b169-9bce9d1bd6ad None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:01.514068 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd225c1-770c-4d64-b169-9bce9d1bd6ad None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:01.547567 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5360f92-5294-4786-9f6d-675d50ca26b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:01.548247 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5360f92-5294-4786-9f6d-675d50ca26b0 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:01.548528 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5360f92-5294-4786-9f6d-675d50ca26b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:01.548799 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5360f92-5294-4786-9f6d-675d50ca26b0 None admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:01.549663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5360f92-5294-4786-9f6d-675d50ca26b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:04:01.549973 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5360f92-5294-4786-9f6d-675d50ca26b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:01.551403 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5360f92-5294-4786-9f6d-675d50ca26b0 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:01.569039 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 535/1071] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 13:04:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:01.570249 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9329c5-c5b6-4249-bc19-02038e090362 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:01.574743 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:01.676008 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9329c5-c5b6-4249-bc19-02038e090362 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:01.708833 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b538cba-a3e7-4188-abbf-7d8f13f2f66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:01.709712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b538cba-a3e7-4188-abbf-7d8f13f2f66d None admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:01.709990 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b538cba-a3e7-4188-abbf-7d8f13f2f66d None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:01.710255 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b538cba-a3e7-4188-abbf-7d8f13f2f66d None admin] PATH_INFO: `/v3/projects/c8c0bf799c9f451b8167a646a5c82eda/users/066aaba3e9af4f85ab0cba89a3d32e34/roles/597251d134b24da6a79c4005736005a4` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:01.712414 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b538cba-a3e7-4188-abbf-7d8f13f2f66d None admin] RBAC: Authorizing `identity:create_grant(project_id=c8c0bf799c9f451b8167a646a5c82eda, user_id=066aaba3e9af4f85ab0cba89a3d32e34, role_id=597251d134b24da6a79c4005736005a4)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:01.713822 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b538cba-a3e7-4188-abbf-7d8f13f2f66d None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:01.814441 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 537/1072] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jun 3 13:04:01 2022] PUT /identity/v3/projects/c8c0bf799c9f451b8167a646a5c82eda/users/066aaba3e9af4f85ab0cba89a3d32e34/roles/597251d134b24da6a79c4005736005a4 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:04:01.958873 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78861fc8-be2a-4fec-9bfe-72a45626b400 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:01.959389 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78861fc8-be2a-4fec-9bfe-72a45626b400 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:01.959389 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78861fc8-be2a-4fec-9bfe-72a45626b400 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:01.961004 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 536/1073] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:04:01.967294 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d945a6-45f4-4768-a787-0229f539103b None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:01.967799 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d945a6-45f4-4768-a787-0229f539103b None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:01.968229 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d945a6-45f4-4768-a787-0229f539103b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:01.989319 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-82d945a6-45f4-4768-a787-0229f539103b None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:01.989319 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-82d945a6-45f4-4768-a787-0229f539103b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:02.060600 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:02.069363 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 538/1074] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:04:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:04:02.092809 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78861fc8-be2a-4fec-9bfe-72a45626b400 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:02.120016 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:02.200693 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78861fc8-be2a-4fec-9bfe-72a45626b400 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:02.236075 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45d3ca-1f21-445d-b2aa-2d6f85dc6b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:02.236758 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45d3ca-1f21-445d-b2aa-2d6f85dc6b52 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:02.237045 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45d3ca-1f21-445d-b2aa-2d6f85dc6b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:02.237325 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45d3ca-1f21-445d-b2aa-2d6f85dc6b52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:02.306391 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45d3ca-1f21-445d-b2aa-2d6f85dc6b52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:02.307860 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45d3ca-1f21-445d-b2aa-2d6f85dc6b52 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:02.333227 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:02.417756 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 537/1075] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:04:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 13:04:02.419113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d945a6-45f4-4768-a787-0229f539103b None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:02.527274 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d945a6-45f4-4768-a787-0229f539103b None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:02.562854 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a69a7-b178-4844-b0b1-1351ff3cce1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:02.563651 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a69a7-b178-4844-b0b1-1351ff3cce1b None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:02.563936 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a69a7-b178-4844-b0b1-1351ff3cce1b None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:02.564242 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a69a7-b178-4844-b0b1-1351ff3cce1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:02.574419 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a69a7-b178-4844-b0b1-1351ff3cce1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:02.575921 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a69a7-b178-4844-b0b1-1351ff3cce1b None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:02.594879 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-455a69a7-b178-4844-b0b1-1351ff3cce1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:04:02.594879 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:04:02.594879 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:04:02.594879 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:04:02.594879 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:04:02.594879 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:04:02.594879 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:04:02.594879 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:04:02.594879 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:04:02.594879 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:04:02.594879 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:04:02.594879 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:04:02.594879 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:04:02.594879 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:04:02.594879 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:04:02.595824 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:04:02.595824 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:04:02.595824 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:04:02.595824 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:04:02.595824 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:04:02.595824 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:04:02.595824 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:04:02.595824 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:04:02.595824 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:04:02.595824 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:04:02.595824 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:04:02.595824 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:04:02.595824 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:04:02.595824 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:04:02.595824 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:04:02.595824 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:04:02.595824 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:04:02.596733 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:04:02.596733 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:04:02.596733 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:04:02.596733 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:04:02.596733 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 539/1076] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:04:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:04:02.603073 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45d3ca-1f21-445d-b2aa-2d6f85dc6b52 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:02.707111 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45d3ca-1f21-445d-b2aa-2d6f85dc6b52 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:02.730863 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:02.745949 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d2b852-721e-43d9-b5cb-350e7e7a57c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:02.749002 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2b852-721e-43d9-b5cb-350e7e7a57c9 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:02.749002 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2b852-721e-43d9-b5cb-350e7e7a57c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:02.749002 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2b852-721e-43d9-b5cb-350e7e7a57c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:02.749002 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d2b852-721e-43d9-b5cb-350e7e7a57c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:04:02.749002 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d2b852-721e-43d9-b5cb-350e7e7a57c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:02.749974 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d2b852-721e-43d9-b5cb-350e7e7a57c9 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:02.763577 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 538/1077] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:03.031219 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d7c15-9fdb-4d78-bf42-31651e996ee1 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:03.031755 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d7c15-9fdb-4d78-bf42-31651e996ee1 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:03.031755 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d7c15-9fdb-4d78-bf42-31651e996ee1 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:03.033335 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 540/1078] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:04:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:04:03.038679 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab67f73-ce78-440f-99f1-f896ece4be82 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:03.039131 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab67f73-ce78-440f-99f1-f896ece4be82 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:03.039317 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab67f73-ce78-440f-99f1-f896ece4be82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:03.056868 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-aab67f73-ce78-440f-99f1-f896ece4be82 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:03.058071 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-aab67f73-ce78-440f-99f1-f896ece4be82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:03.131966 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 539/1079] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:04:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:04:03.155657 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d7c15-9fdb-4d78-bf42-31651e996ee1 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:03.201622 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:03.255399 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d7c15-9fdb-4d78-bf42-31651e996ee1 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:03.288723 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a6e49-455d-46ef-94c9-96260d2f47ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:03.289511 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a6e49-455d-46ef-94c9-96260d2f47ee None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:03.289796 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a6e49-455d-46ef-94c9-96260d2f47ee None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:03.290071 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a6e49-455d-46ef-94c9-96260d2f47ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:03.300225 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a6e49-455d-46ef-94c9-96260d2f47ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:04:03.307811 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-b77a6e49-455d-46ef-94c9-96260d2f47ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:04:03.307811 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:04:03.307811 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:04:03.307811 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:04:03.307811 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:04:03.307811 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:04:03.307811 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:04:03.307811 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:04:03.307811 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:04:03.307811 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:04:03.307811 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:04:03.307811 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:04:03.307811 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:04:03.307811 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:04:03.307811 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:04:03.307811 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:04:03.308757 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:04:03.308757 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:04:03.308757 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:04:03.308757 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:04:03.308757 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:04:03.308757 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:04:03.308757 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:04:03.308757 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:04:03.308757 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:04:03.308757 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:04:03.308757 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:04:03.308757 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:04:03.308757 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:04:03.308757 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:04:03.308757 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:04:03.308757 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:04:03.310767 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:04:03.310767 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:04:03.310767 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:04:03.310767 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:04:03.310767 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:04:03.310767 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:04:03.310767 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:04:03.310767 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:04:03.310767 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:04:03.310767 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:04:03.310767 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:04:03.310767 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:04:03.310767 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 541/1080] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 13:04:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:04:03.315691 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab67f73-ce78-440f-99f1-f896ece4be82 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:03.410565 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab67f73-ce78-440f-99f1-f896ece4be82 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:03.423257 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:03.444233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9d349-f1a3-467d-b3d4-39aa14b1d036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:03.444894 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9d349-f1a3-467d-b3d4-39aa14b1d036 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:03.445171 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9d349-f1a3-467d-b3d4-39aa14b1d036 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:03.445440 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9d349-f1a3-467d-b3d4-39aa14b1d036 None admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:03.446175 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9d349-f1a3-467d-b3d4-39aa14b1d036 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:04:03.446477 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9d349-f1a3-467d-b3d4-39aa14b1d036 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:03.447831 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9d349-f1a3-467d-b3d4-39aa14b1d036 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:03.456745 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 540/1081] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:04:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:03.462572 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a6e49-455d-46ef-94c9-96260d2f47ee None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:03.559370 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a6e49-455d-46ef-94c9-96260d2f47ee None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:03.566708 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:03.593291 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656caac-e52e-4788-9604-eec8aa4f4785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:03.594218 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656caac-e52e-4788-9604-eec8aa4f4785 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:03.594494 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656caac-e52e-4788-9604-eec8aa4f4785 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:03.594767 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656caac-e52e-4788-9604-eec8aa4f4785 None admin] PATH_INFO: `/v3/users/fea68ffa98b04eaba06f4d613b779ae3` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:03.595926 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6656caac-e52e-4788-9604-eec8aa4f4785 None admin] RBAC: Authorizing `identity:get_user(user_id=fea68ffa98b04eaba06f4d613b779ae3)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:03.597471 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6656caac-e52e-4788-9604-eec8aa4f4785 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:03.599351 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 542/1082] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 13:04:03 2022] GET /identity/v3/users/fea68ffa98b04eaba06f4d613b779ae3 => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:04:03.605056 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9d349-f1a3-467d-b3d4-39aa14b1d036 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:03.704008 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9d349-f1a3-467d-b3d4-39aa14b1d036 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:03.737017 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0017f9c-b4f0-4634-9b3f-26ed80cdc06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:03.737873 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0017f9c-b4f0-4634-9b3f-26ed80cdc06e None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:03.738151 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0017f9c-b4f0-4634-9b3f-26ed80cdc06e None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:03.738421 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0017f9c-b4f0-4634-9b3f-26ed80cdc06e None admin] PATH_INFO: `/v3/projects/2c14f94a01004e18888361fa1c56f526` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:03.739581 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0017f9c-b4f0-4634-9b3f-26ed80cdc06e None admin] RBAC: Authorizing `identity:get_project(project_id=2c14f94a01004e18888361fa1c56f526)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:03.741052 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0017f9c-b4f0-4634-9b3f-26ed80cdc06e None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:03.742860 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 541/1083] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:04:03 2022] GET /identity/v3/projects/2c14f94a01004e18888361fa1c56f526 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:03.749299 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656caac-e52e-4788-9604-eec8aa4f4785 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:03.850817 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656caac-e52e-4788-9604-eec8aa4f4785 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:03.883957 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a4e4d-dbfb-425e-a97d-e11f557d6f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:03.884868 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a4e4d-dbfb-425e-a97d-e11f557d6f38 None admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:03.885143 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a4e4d-dbfb-425e-a97d-e11f557d6f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:03.885452 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a4e4d-dbfb-425e-a97d-e11f557d6f38 None admin] PATH_INFO: `/v3/projects/2c14f94a01004e18888361fa1c56f526/users/fea68ffa98b04eaba06f4d613b779ae3/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:03.887428 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a4e4d-dbfb-425e-a97d-e11f557d6f38 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c14f94a01004e18888361fa1c56f526, user_id=fea68ffa98b04eaba06f4d613b779ae3, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:03.888946 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a4e4d-dbfb-425e-a97d-e11f557d6f38 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:03.956448 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 543/1084] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jun 3 13:04:03 2022] PUT /identity/v3/projects/2c14f94a01004e18888361fa1c56f526/users/fea68ffa98b04eaba06f4d613b779ae3/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:04:04.124117 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0a4c0-0c16-4d49-a854-b5858e1cc1c6 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:04.124656 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0a4c0-0c16-4d49-a854-b5858e1cc1c6 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:04.124656 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0a4c0-0c16-4d49-a854-b5858e1cc1c6 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:04.126172 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 542/1085] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:04:04.131753 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12f1f5-5934-4058-83ec-5aabd14b299c None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:04.132306 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12f1f5-5934-4058-83ec-5aabd14b299c None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:04.132411 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12f1f5-5934-4058-83ec-5aabd14b299c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:04.149954 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-bd12f1f5-5934-4058-83ec-5aabd14b299c None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:04.151157 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-bd12f1f5-5934-4058-83ec-5aabd14b299c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:04.179180 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:04.218329 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 544/1086] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:04:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:04:04.242731 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c0a4c0-0c16-4d49-a854-b5858e1cc1c6 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:04.287773 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:04.344861 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c0a4c0-0c16-4d49-a854-b5858e1cc1c6 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:04.378922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf587e45-2b18-47ee-94d6-45d56d17e05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:04.379650 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf587e45-2b18-47ee-94d6-45d56d17e05c None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:04.380047 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf587e45-2b18-47ee-94d6-45d56d17e05c None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:04.380345 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf587e45-2b18-47ee-94d6-45d56d17e05c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:04.390752 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf587e45-2b18-47ee-94d6-45d56d17e05c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:04:04.398922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-bf587e45-2b18-47ee-94d6-45d56d17e05c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 13:04:04.398922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:04:04.398922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:04:04.398922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:04:04.398922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:04:04.398922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:04:04.398922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:04:04.398922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:04:04.398922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:04:04.398922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:04:04.398922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:04:04.398922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:04:04.398922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:04:04.398922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:04:04.398922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:04:04.398922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:04:04.399894 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:04:04.399894 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:04:04.399894 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:04:04.399894 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:04:04.399894 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:04:04.399894 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:04:04.399894 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:04:04.399894 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:04:04.399894 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:04:04.399894 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:04:04.399894 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:04:04.399894 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:04:04.399894 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:04:04.399894 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:04:04.399894 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:04:04.399894 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:04:04.401010 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:04:04.401010 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:04:04.401010 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:04:04.401010 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:04:04.401010 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:04:04.401010 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:04:04.401010 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:04:04.401010 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:04:04.401010 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:04:04.401010 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:04:04.401010 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 13:04:04.401010 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:04:04.401010 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 543/1087] 10.222.0.61 () {56 vars in 1120 bytes} [Fri Jun 3 13:04:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:04:04.406620 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12f1f5-5934-4058-83ec-5aabd14b299c None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:04.504111 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12f1f5-5934-4058-83ec-5aabd14b299c None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:04.537904 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8fb9f7-7084-42b2-ab60-cd3cbb9b49c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:04.538569 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8fb9f7-7084-42b2-ab60-cd3cbb9b49c9 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:04.538855 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8fb9f7-7084-42b2-ab60-cd3cbb9b49c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:04.539132 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8fb9f7-7084-42b2-ab60-cd3cbb9b49c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:04.539871 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8fb9f7-7084-42b2-ab60-cd3cbb9b49c9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:04:04.540204 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8fb9f7-7084-42b2-ab60-cd3cbb9b49c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:04.541578 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8fb9f7-7084-42b2-ab60-cd3cbb9b49c9 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:04.553899 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 545/1088] 10.222.0.61 () {56 vars in 1115 bytes} [Fri Jun 3 13:04:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:04.555095 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf587e45-2b18-47ee-94d6-45d56d17e05c None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:04.652753 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf587e45-2b18-47ee-94d6-45d56d17e05c None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:04.654840 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:04.686811 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e47b4a-2345-45fc-9a51-f3409f2388f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:04.687595 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e47b4a-2345-45fc-9a51-f3409f2388f4 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:04.687927 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e47b4a-2345-45fc-9a51-f3409f2388f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:04.688233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e47b4a-2345-45fc-9a51-f3409f2388f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:04.697861 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e47b4a-2345-45fc-9a51-f3409f2388f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:04.699313 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e47b4a-2345-45fc-9a51-f3409f2388f4 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:04.717067 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-03e47b4a-2345-45fc-9a51-f3409f2388f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:04:04.717067 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:04:04.717067 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:04:04.717067 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:04:04.717067 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:04:04.717067 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:04:04.717067 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:04:04.717067 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:04:04.717067 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:04:04.717067 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:04:04.717067 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:04:04.717067 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:04:04.717067 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:04:04.717067 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:04:04.717067 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:04:04.718088 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:04:04.718088 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:04:04.718088 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:04:04.718088 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:04:04.718088 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:04:04.718088 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:04:04.718088 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:04:04.718088 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:04:04.718088 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:04:04.718088 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:04:04.718088 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:04:04.718088 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:04:04.718088 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:04:04.718088 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:04:04.718088 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:04:04.718088 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:04:04.718088 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:04:04.718982 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:04:04.718982 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:04:04.718982 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:04:04.718982 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:04:04.718982 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 544/1089] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:04:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:04:04.724347 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8fb9f7-7084-42b2-ab60-cd3cbb9b49c9 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:04.752657 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:04.822561 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8fb9f7-7084-42b2-ab60-cd3cbb9b49c9 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:04.855307 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9dc1ce-7fd1-4488-8075-6a678e635714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:04.855951 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9dc1ce-7fd1-4488-8075-6a678e635714 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:04.856260 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9dc1ce-7fd1-4488-8075-6a678e635714 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:04.856533 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9dc1ce-7fd1-4488-8075-6a678e635714 None admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:04.857940 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9dc1ce-7fd1-4488-8075-6a678e635714 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:04:04.858238 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9dc1ce-7fd1-4488-8075-6a678e635714 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:04.859584 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9dc1ce-7fd1-4488-8075-6a678e635714 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:04.871157 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 546/1090] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:04:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:04.876950 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e47b4a-2345-45fc-9a51-f3409f2388f4 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:04.978821 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e47b4a-2345-45fc-9a51-f3409f2388f4 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:05.017584 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc9523d-0e9c-4dcf-b10e-402a83ae4e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:05.018369 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9523d-0e9c-4dcf-b10e-402a83ae4e20 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:05.018648 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9523d-0e9c-4dcf-b10e-402a83ae4e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:05.018920 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9523d-0e9c-4dcf-b10e-402a83ae4e20 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:05.025750 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc9523d-0e9c-4dcf-b10e-402a83ae4e20 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:05.027177 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc9523d-0e9c-4dcf-b10e-402a83ae4e20 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:05.041775 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-6bc9523d-0e9c-4dcf-b10e-402a83ae4e20 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 13:04:05.041775 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:04:05.041775 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:04:05.041775 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:04:05.041775 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:04:05.041775 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:04:05.041775 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:04:05.041775 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:04:05.041775 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:04:05.041775 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:04:05.041775 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:04:05.041775 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:04:05.041775 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 13:04:05.041775 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 13:04:05.041775 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 13:04:05.041775 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 13:04:05.042813 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:04:05.042813 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:04:05.042813 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 13:04:05.042813 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:04:05.042813 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 13:04:05.042813 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:04:05.042813 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:04:05.042813 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:04:05.042813 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:04:05.042813 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:04:05.042813 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:04:05.042813 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:04:05.042813 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:04:05.042813 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:04:05.042813 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:04:05.042813 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:04:05.042813 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:04:05.042813 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:04:05.044266 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:04:05.044266 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:04:05.044266 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 13:04:05.044266 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 13:04:05.044266 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 13:04:05.044266 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 13:04:05.044266 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 13:04:05.044266 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 13:04:05.044266 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 13:04:05.044266 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:04:05.044266 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 545/1091] 10.222.0.61 () {56 vars in 1093 bytes} [Fri Jun 3 13:04:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:04:05.049513 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9dc1ce-7fd1-4488-8075-6a678e635714 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:05.135079 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:05.150084 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9dc1ce-7fd1-4488-8075-6a678e635714 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:05.186179 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe373e-6c71-44b6-a237-2cab25f4bf1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:05.186839 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe373e-6c71-44b6-a237-2cab25f4bf1a None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:05.187149 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe373e-6c71-44b6-a237-2cab25f4bf1a None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:05.187423 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe373e-6c71-44b6-a237-2cab25f4bf1a None admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:05.188277 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe373e-6c71-44b6-a237-2cab25f4bf1a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:04:05.188583 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe373e-6c71-44b6-a237-2cab25f4bf1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:05.190007 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe373e-6c71-44b6-a237-2cab25f4bf1a None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:05.207235 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 547/1092] 10.222.0.61 () {56 vars in 1133 bytes} [Fri Jun 3 13:04:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:05.212961 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc9523d-0e9c-4dcf-b10e-402a83ae4e20 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:05.230097 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:05.315367 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc9523d-0e9c-4dcf-b10e-402a83ae4e20 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:05.348837 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e4833-68ca-4dd9-8e46-55208fd3851d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:05.349471 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e4833-68ca-4dd9-8e46-55208fd3851d None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:05.349755 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e4833-68ca-4dd9-8e46-55208fd3851d None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:05.350031 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e4833-68ca-4dd9-8e46-55208fd3851d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:05.416924 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e4833-68ca-4dd9-8e46-55208fd3851d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:05.418393 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e4833-68ca-4dd9-8e46-55208fd3851d None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:05.433250 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:05.518802 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 546/1093] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:04:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 13:04:05.524505 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe373e-6c71-44b6-a237-2cab25f4bf1a None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:05.623739 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe373e-6c71-44b6-a237-2cab25f4bf1a None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:05.657568 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5931ae-b1d6-4107-b86f-27e392738e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:05.658358 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5931ae-b1d6-4107-b86f-27e392738e51 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:05.658643 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5931ae-b1d6-4107-b86f-27e392738e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:05.658923 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5931ae-b1d6-4107-b86f-27e392738e51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:05.668769 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5931ae-b1d6-4107-b86f-27e392738e51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:05.670361 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5931ae-b1d6-4107-b86f-27e392738e51 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:05.672851 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:05.688453 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-9c5931ae-b1d6-4107-b86f-27e392738e51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:04:05.688453 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:04:05.688453 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:04:05.688453 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:04:05.688453 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:04:05.688453 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:04:05.688453 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:04:05.688453 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:04:05.688453 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:04:05.688453 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:04:05.688453 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:04:05.688453 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:04:05.688453 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:04:05.688453 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:04:05.688453 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:04:05.689995 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:04:05.689995 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:04:05.689995 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:04:05.689995 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:04:05.689995 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:04:05.689995 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:04:05.689995 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:04:05.689995 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:04:05.689995 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:04:05.689995 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:04:05.689995 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:04:05.689995 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:04:05.689995 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:04:05.689995 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:04:05.689995 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:04:05.689995 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:04:05.689995 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:04:05.690891 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:04:05.690891 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:04:05.690891 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:04:05.690891 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:04:05.690891 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 548/1094] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:04:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:04:05.695444 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e4833-68ca-4dd9-8e46-55208fd3851d None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:05.793664 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e4833-68ca-4dd9-8e46-55208fd3851d None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:05.806920 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:05.827060 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6662fb43-3fb9-4682-85ef-b94877ca3c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:05.827721 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6662fb43-3fb9-4682-85ef-b94877ca3c89 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:05.828006 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6662fb43-3fb9-4682-85ef-b94877ca3c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:05.828312 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6662fb43-3fb9-4682-85ef-b94877ca3c89 None admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:05.829034 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6662fb43-3fb9-4682-85ef-b94877ca3c89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:04:05.829338 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6662fb43-3fb9-4682-85ef-b94877ca3c89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:05.830717 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6662fb43-3fb9-4682-85ef-b94877ca3c89 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:05.844332 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 547/1095] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:04:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:05.848986 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5931ae-b1d6-4107-b86f-27e392738e51 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:05.952475 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5931ae-b1d6-4107-b86f-27e392738e51 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:05.987384 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8ec07-70ef-4496-960c-dee6cb9aad3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:05.988210 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8ec07-70ef-4496-960c-dee6cb9aad3f None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:05.988505 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8ec07-70ef-4496-960c-dee6cb9aad3f None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:05.988781 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8ec07-70ef-4496-960c-dee6cb9aad3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:05.995656 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad8ec07-70ef-4496-960c-dee6cb9aad3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:05.997158 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad8ec07-70ef-4496-960c-dee6cb9aad3f None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:06.012778 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-2ad8ec07-70ef-4496-960c-dee6cb9aad3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:04:06.012778 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:04:06.012778 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:04:06.012778 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:04:06.012778 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:04:06.012778 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:04:06.012778 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:04:06.012778 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:04:06.012778 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:04:06.012778 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:04:06.012778 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:04:06.012778 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:04:06.012778 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 13:04:06.012778 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 13:04:06.012778 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 13:04:06.014142 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 13:04:06.014142 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:04:06.014142 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:04:06.014142 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:04:06.014142 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:04:06.014142 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:04:06.014142 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:04:06.014142 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:04:06.014142 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:04:06.014142 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:04:06.014142 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:04:06.014142 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:04:06.014142 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:04:06.014142 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:04:06.014142 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:04:06.014142 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:04:06.014142 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:04:06.015034 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 13:04:06.015034 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 13:04:06.015034 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 13:04:06.015034 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 13:04:06.015034 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 13:04:06.015034 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 13:04:06.015034 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:04:06.015034 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:04:06.015034 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 549/1096] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:04:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:04:06.019942 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6662fb43-3fb9-4682-85ef-b94877ca3c89 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:06.117842 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6662fb43-3fb9-4682-85ef-b94877ca3c89 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:06.151167 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7523cd5-7176-4026-890e-27dcecde6993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:06.151815 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7523cd5-7176-4026-890e-27dcecde6993 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:06.152094 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7523cd5-7176-4026-890e-27dcecde6993 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:06.152395 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7523cd5-7176-4026-890e-27dcecde6993 None admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:06.153164 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7523cd5-7176-4026-890e-27dcecde6993 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:04:06.153471 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7523cd5-7176-4026-890e-27dcecde6993 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:06.155124 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7523cd5-7176-4026-890e-27dcecde6993 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:06.166456 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 548/1097] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 13:04:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:06.173632 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8ec07-70ef-4496-960c-dee6cb9aad3f None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:06.183557 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324af1d-5c9b-402b-a7fd-e5fc8e7f0625 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:06.183840 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324af1d-5c9b-402b-a7fd-e5fc8e7f0625 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:06.184114 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324af1d-5c9b-402b-a7fd-e5fc8e7f0625 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:06.186132 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 549/1098] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:04:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 13:04:06.191147 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f7b92-cbe6-4c1e-900e-7b5ce3539237 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:06.191430 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f7b92-cbe6-4c1e-900e-7b5ce3539237 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:06.191694 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f7b92-cbe6-4c1e-900e-7b5ce3539237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:06.207899 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-ad4f7b92-cbe6-4c1e-900e-7b5ce3539237 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:06.209126 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-ad4f7b92-cbe6-4c1e-900e-7b5ce3539237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:06.233038 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:06.235578 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:06.274386 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 550/1099] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:04:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 13:04:06.275868 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8ec07-70ef-4496-960c-dee6cb9aad3f None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:06.299191 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f7b92-cbe6-4c1e-900e-7b5ce3539237 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:06.310736 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ccc91-33eb-4a6b-9667-5fafb2ff9e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:06.311391 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ccc91-33eb-4a6b-9667-5fafb2ff9e40 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:06.311678 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ccc91-33eb-4a6b-9667-5fafb2ff9e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:06.311950 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ccc91-33eb-4a6b-9667-5fafb2ff9e40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:06.312949 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ccc91-33eb-4a6b-9667-5fafb2ff9e40 None admin] RBAC: Adding query filter params (role.id=597251d134b24da6a79c4005736005a4, scope.project.id=c8c0bf799c9f451b8167a646a5c82eda, user.id=066aaba3e9af4f85ab0cba89a3d32e34) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:04:06.313264 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ccc91-33eb-4a6b-9667-5fafb2ff9e40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:06.314692 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ccc91-33eb-4a6b-9667-5fafb2ff9e40 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:06.320442 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 550/1100] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 13:04:06 2022] GET /identity/v3/role_assignments?user.id=066aaba3e9af4f85ab0cba89a3d32e34&scope.project.id=c8c0bf799c9f451b8167a646a5c82eda&role.id=597251d134b24da6a79c4005736005a4 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:06.402511 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f7b92-cbe6-4c1e-900e-7b5ce3539237 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:06.439363 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b144da-5232-4573-8702-2df665db4d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:06.440194 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b144da-5232-4573-8702-2df665db4d6f None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:06.440625 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b144da-5232-4573-8702-2df665db4d6f None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:06.440912 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b144da-5232-4573-8702-2df665db4d6f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:06.451876 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b144da-5232-4573-8702-2df665db4d6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:04:06.459659 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-20b144da-5232-4573-8702-2df665db4d6f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:04:06.459659 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:04:06.459659 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:04:06.459659 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:04:06.459659 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:04:06.459659 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:04:06.459659 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:04:06.459659 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:04:06.459659 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:04:06.459659 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:04:06.459659 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:04:06.459659 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:04:06.459659 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:04:06.459659 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:04:06.459659 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:04:06.459659 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:04:06.460847 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:04:06.460847 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:04:06.460847 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:04:06.460847 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:04:06.460847 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:04:06.460847 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:04:06.460847 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:04:06.460847 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:04:06.460847 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:04:06.460847 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:04:06.460847 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:04:06.460847 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:04:06.460847 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:04:06.460847 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:04:06.460847 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:04:06.460847 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:04:06.461738 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:04:06.461738 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:04:06.461738 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:04:06.461738 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:04:06.461738 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:04:06.461738 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:04:06.461738 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:04:06.461738 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:04:06.461738 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:04:06.461738 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:04:06.461738 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:04:06.461738 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:04:06.461738 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 551/1101] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 13:04:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:04:06.467782 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ccc91-33eb-4a6b-9667-5fafb2ff9e40 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:06.571026 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ccc91-33eb-4a6b-9667-5fafb2ff9e40 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:06.590055 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:06.604317 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d3ea2-d8ff-47df-840d-3eccc6e70cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:06.604979 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d3ea2-d8ff-47df-840d-3eccc6e70cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:06.605256 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d3ea2-d8ff-47df-840d-3eccc6e70cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:06.605530 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d3ea2-d8ff-47df-840d-3eccc6e70cd3 None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:06.606260 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5d3ea2-d8ff-47df-840d-3eccc6e70cd3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:04:06.606563 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5d3ea2-d8ff-47df-840d-3eccc6e70cd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:06.608669 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5d3ea2-d8ff-47df-840d-3eccc6e70cd3 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:06.617426 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 551/1102] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:04:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:06.623399 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b144da-5232-4573-8702-2df665db4d6f None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:06.649989 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:06.726617 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b144da-5232-4573-8702-2df665db4d6f None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:06.760257 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67441b08-f319-4a0e-8e07-717a238b9c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:06.761130 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67441b08-f319-4a0e-8e07-717a238b9c50 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:06.761403 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67441b08-f319-4a0e-8e07-717a238b9c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:06.761729 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67441b08-f319-4a0e-8e07-717a238b9c50 None admin] PATH_INFO: `/v3/users/fea68ffa98b04eaba06f4d613b779ae3` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:06.762939 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67441b08-f319-4a0e-8e07-717a238b9c50 None admin] RBAC: Authorizing `identity:get_user(user_id=fea68ffa98b04eaba06f4d613b779ae3)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:06.764960 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67441b08-f319-4a0e-8e07-717a238b9c50 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:06.766621 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 552/1103] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 13:04:06 2022] GET /identity/v3/users/fea68ffa98b04eaba06f4d613b779ae3 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:06.772445 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d3ea2-d8ff-47df-840d-3eccc6e70cd3 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:06.877247 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d3ea2-d8ff-47df-840d-3eccc6e70cd3 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:06.912328 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7a7da-8afb-47f9-aa94-83c30e2265eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:06.912982 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7a7da-8afb-47f9-aa94-83c30e2265eb None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:06.913261 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7a7da-8afb-47f9-aa94-83c30e2265eb None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:06.913532 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7a7da-8afb-47f9-aa94-83c30e2265eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:06.963056 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:06.982114 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c7a7da-8afb-47f9-aa94-83c30e2265eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:06.983463 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c7a7da-8afb-47f9-aa94-83c30e2265eb None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:07.086932 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 552/1104] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:04:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 13:04:07.093123 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67441b08-f319-4a0e-8e07-717a238b9c50 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:07.198152 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:07.207149 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67441b08-f319-4a0e-8e07-717a238b9c50 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:07.240724 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2d1c3-25eb-4d23-b359-011a1938ad1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:07.241497 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2d1c3-25eb-4d23-b359-011a1938ad1d None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:07.241776 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2d1c3-25eb-4d23-b359-011a1938ad1d None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:07.242090 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2d1c3-25eb-4d23-b359-011a1938ad1d None admin] PATH_INFO: `/v3/projects/2c14f94a01004e18888361fa1c56f526` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:07.243619 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f2d1c3-25eb-4d23-b359-011a1938ad1d None admin] RBAC: Authorizing `identity:get_project(project_id=2c14f94a01004e18888361fa1c56f526)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:07.245257 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f2d1c3-25eb-4d23-b359-011a1938ad1d None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:07.247293 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 553/1105] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:04:07 2022] GET /identity/v3/projects/2c14f94a01004e18888361fa1c56f526 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:07.254235 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7a7da-8afb-47f9-aa94-83c30e2265eb None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:07.330899 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:07.348050 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7a7da-8afb-47f9-aa94-83c30e2265eb None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:07.382282 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16974bf-b679-4b92-8448-197e3ba4b339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:07.382922 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16974bf-b679-4b92-8448-197e3ba4b339 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:07.383200 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16974bf-b679-4b92-8448-197e3ba4b339 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:07.383471 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16974bf-b679-4b92-8448-197e3ba4b339 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:07.384306 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16974bf-b679-4b92-8448-197e3ba4b339 None admin] RBAC: Adding query filter params (role.id=bbd5f3e0c18e4992886fcfb4a3feb426, scope.project.id=2c14f94a01004e18888361fa1c56f526, user.id=fea68ffa98b04eaba06f4d613b779ae3) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:04:07.384612 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16974bf-b679-4b92-8448-197e3ba4b339 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:07.386020 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16974bf-b679-4b92-8448-197e3ba4b339 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:07.391716 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 553/1106] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 13:04:07 2022] GET /identity/v3/role_assignments?user.id=fea68ffa98b04eaba06f4d613b779ae3&scope.project.id=2c14f94a01004e18888361fa1c56f526&role.id=bbd5f3e0c18e4992886fcfb4a3feb426 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:09.629497 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ae2b6-2284-40b2-bc02-3b2b72666937 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:09.630052 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ae2b6-2284-40b2-bc02-3b2b72666937 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:09.630052 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ae2b6-2284-40b2-bc02-3b2b72666937 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:09.631416 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 554/1107] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:04:09.636546 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17a4a1-17d2-4735-ac15-3b8be7f28ac8 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:09.636976 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17a4a1-17d2-4735-ac15-3b8be7f28ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:09.637087 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17a4a1-17d2-4735-ac15-3b8be7f28ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:09.654407 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-fb17a4a1-17d2-4735-ac15-3b8be7f28ac8 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:09.655565 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-fb17a4a1-17d2-4735-ac15-3b8be7f28ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:09.718492 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 554/1108] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:04:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:04:09.743111 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ae2b6-2284-40b2-bc02-3b2b72666937 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:09.840698 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ae2b6-2284-40b2-bc02-3b2b72666937 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:09.874253 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cff2e8-2015-4e7f-a825-dd86e84648e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:09.875021 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cff2e8-2015-4e7f-a825-dd86e84648e8 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:09.877008 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cff2e8-2015-4e7f-a825-dd86e84648e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:09.877008 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cff2e8-2015-4e7f-a825-dd86e84648e8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:09.877008 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cff2e8-2015-4e7f-a825-dd86e84648e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:09.878125 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cff2e8-2015-4e7f-a825-dd86e84648e8 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:09.880040 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 555/1109] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:04:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:09.885685 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17a4a1-17d2-4735-ac15-3b8be7f28ac8 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:09.979434 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:10.002713 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17a4a1-17d2-4735-ac15-3b8be7f28ac8 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:10.037759 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae11a7c-d489-439a-8cb8-c5c2836be783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:10.038421 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae11a7c-d489-439a-8cb8-c5c2836be783 None admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:10.038699 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae11a7c-d489-439a-8cb8-c5c2836be783 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:10.038971 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae11a7c-d489-439a-8cb8-c5c2836be783 None admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:10.039670 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae11a7c-d489-439a-8cb8-c5c2836be783 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:10.041143 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae11a7c-d489-439a-8cb8-c5c2836be783 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:10.173136 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 555/1110] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jun 3 13:04:09 2022] POST /identity/v3/users => generated 286 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:04:12.545042 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938cdb9-c9a0-48a7-bec8-9ef635755ccc None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:12.545583 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938cdb9-c9a0-48a7-bec8-9ef635755ccc None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:12.545583 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938cdb9-c9a0-48a7-bec8-9ef635755ccc None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:12.546963 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 556/1111] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:04:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:04:12.553043 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788c110-9dc9-4159-b776-df4ccdd031af None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:12.553582 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788c110-9dc9-4159-b776-df4ccdd031af None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:12.554007 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788c110-9dc9-4159-b776-df4ccdd031af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:12.573271 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-c788c110-9dc9-4159-b776-df4ccdd031af None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:12.574488 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-c788c110-9dc9-4159-b776-df4ccdd031af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:12.657898 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 556/1112] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:04:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:04:12.681760 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a938cdb9-c9a0-48a7-bec8-9ef635755ccc None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:12.709708 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:12.782315 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a938cdb9-c9a0-48a7-bec8-9ef635755ccc None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:12.816254 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d93dd-aed7-4323-8f4c-6b3be15f3741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:12.817030 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d93dd-aed7-4323-8f4c-6b3be15f3741 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:12.817312 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d93dd-aed7-4323-8f4c-6b3be15f3741 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:12.817587 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d93dd-aed7-4323-8f4c-6b3be15f3741 None admin] PATH_INFO: `/v3/roles/7476baf91a50401596c34535d2c79a4f` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:12.819038 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d93dd-aed7-4323-8f4c-6b3be15f3741 None admin] RBAC: Authorizing `identity:get_role(role_id=7476baf91a50401596c34535d2c79a4f)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:12.820438 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d93dd-aed7-4323-8f4c-6b3be15f3741 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:12.821794 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 557/1113] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 13:04:12 2022] GET /identity/v3/roles/7476baf91a50401596c34535d2c79a4f => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:12.827654 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788c110-9dc9-4159-b776-df4ccdd031af None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:12.886616 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:12.923580 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788c110-9dc9-4159-b776-df4ccdd031af None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:12.957073 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a45c2-eac8-482a-954c-d945a84e24ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:12.957939 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a45c2-eac8-482a-954c-d945a84e24ba None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:12.958215 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a45c2-eac8-482a-954c-d945a84e24ba None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:12.958481 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a45c2-eac8-482a-954c-d945a84e24ba None admin] PATH_INFO: `/v3/users/44a74d79cee94d419e009be914deb3fc` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:12.971174 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145a45c2-eac8-482a-954c-d945a84e24ba None admin] RBAC: Authorizing `identity:get_user(user_id=44a74d79cee94d419e009be914deb3fc)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:12.972633 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145a45c2-eac8-482a-954c-d945a84e24ba None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:12.974572 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 557/1114] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 13:04:12 2022] GET /identity/v3/users/44a74d79cee94d419e009be914deb3fc => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:12.980372 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d93dd-aed7-4323-8f4c-6b3be15f3741 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:13.073030 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:13.078686 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d93dd-aed7-4323-8f4c-6b3be15f3741 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:13.111603 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af0e52-9fc6-41d6-9ea3-08ae779d9775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:13.112276 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af0e52-9fc6-41d6-9ea3-08ae779d9775 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:13.112561 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af0e52-9fc6-41d6-9ea3-08ae779d9775 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:13.112838 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af0e52-9fc6-41d6-9ea3-08ae779d9775 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:13.177855 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af0e52-9fc6-41d6-9ea3-08ae779d9775 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:13.179318 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af0e52-9fc6-41d6-9ea3-08ae779d9775 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:13.271868 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:13.278064 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 558/1115] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:04:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 13:04:13.290286 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a45c2-eac8-482a-954c-d945a84e24ba None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:13.387111 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a45c2-eac8-482a-954c-d945a84e24ba None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:13.407311 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:13.420538 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e853266b-3603-4b23-a0c9-1cea907f16c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:13.424239 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853266b-3603-4b23-a0c9-1cea907f16c5 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:13.424239 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853266b-3603-4b23-a0c9-1cea907f16c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:13.424239 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853266b-3603-4b23-a0c9-1cea907f16c5 None admin] PATH_INFO: `/v3/projects/2c14f94a01004e18888361fa1c56f526` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:13.424239 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e853266b-3603-4b23-a0c9-1cea907f16c5 None admin] RBAC: Authorizing `identity:get_project(project_id=2c14f94a01004e18888361fa1c56f526)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:13.424594 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e853266b-3603-4b23-a0c9-1cea907f16c5 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:13.426214 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 558/1116] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:04:13 2022] GET /identity/v3/projects/2c14f94a01004e18888361fa1c56f526 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:13.432349 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af0e52-9fc6-41d6-9ea3-08ae779d9775 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:13.661051 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af0e52-9fc6-41d6-9ea3-08ae779d9775 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:13.693922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd75d047-c482-4f27-84d8-1e09483980b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:13.694552 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75d047-c482-4f27-84d8-1e09483980b7 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:13.694830 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75d047-c482-4f27-84d8-1e09483980b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:13.695101 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75d047-c482-4f27-84d8-1e09483980b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:13.695912 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd75d047-c482-4f27-84d8-1e09483980b7 None admin] RBAC: Adding query filter params (role.id=7476baf91a50401596c34535d2c79a4f, scope.project.id=2c14f94a01004e18888361fa1c56f526, user.id=44a74d79cee94d419e009be914deb3fc) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:04:13.696245 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd75d047-c482-4f27-84d8-1e09483980b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:13.697668 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd75d047-c482-4f27-84d8-1e09483980b7 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:13.702926 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 559/1117] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 13:04:13 2022] GET /identity/v3/role_assignments?user.id=44a74d79cee94d419e009be914deb3fc&scope.project.id=2c14f94a01004e18888361fa1c56f526&role.id=7476baf91a50401596c34535d2c79a4f => generated 259 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:15.901175 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77c99c-17a7-4c34-b1ca-2fff8689d5e8 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:15.901709 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77c99c-17a7-4c34-b1ca-2fff8689d5e8 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:15.901709 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77c99c-17a7-4c34-b1ca-2fff8689d5e8 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:15.903117 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 559/1118] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:04:15.908241 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebdb8c-5f04-4727-afe7-baecc0746097 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:15.908635 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebdb8c-5f04-4727-afe7-baecc0746097 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:15.908788 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebdb8c-5f04-4727-afe7-baecc0746097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:15.925610 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-86ebdb8c-5f04-4727-afe7-baecc0746097 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:15.926769 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-86ebdb8c-5f04-4727-afe7-baecc0746097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:15.980015 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:15.991434 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 560/1119] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:04:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:04:16.014678 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77c99c-17a7-4c34-b1ca-2fff8689d5e8 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:16.113740 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77c99c-17a7-4c34-b1ca-2fff8689d5e8 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:16.145364 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721815f-8d0e-4ab9-a6cb-23ccd20d4611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:16.146197 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721815f-8d0e-4ab9-a6cb-23ccd20d4611 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:16.146475 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721815f-8d0e-4ab9-a6cb-23ccd20d4611 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:16.146745 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721815f-8d0e-4ab9-a6cb-23ccd20d4611 None admin] PATH_INFO: `/v3/roles/7476baf91a50401596c34535d2c79a4f` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:16.148207 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1721815f-8d0e-4ab9-a6cb-23ccd20d4611 None admin] RBAC: Authorizing `identity:get_role(role_id=7476baf91a50401596c34535d2c79a4f)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:16.149555 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1721815f-8d0e-4ab9-a6cb-23ccd20d4611 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:16.150896 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 560/1120] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 13:04:16 2022] GET /identity/v3/roles/7476baf91a50401596c34535d2c79a4f => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:16.157499 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebdb8c-5f04-4727-afe7-baecc0746097 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:16.252734 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebdb8c-5f04-4727-afe7-baecc0746097 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:16.287346 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f770b13-3039-4acd-a071-1cb7d6340ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:16.288229 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f770b13-3039-4acd-a071-1cb7d6340ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:16.290325 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f770b13-3039-4acd-a071-1cb7d6340ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:16.290623 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f770b13-3039-4acd-a071-1cb7d6340ed7 None admin] PATH_INFO: `/v3/users/44a74d79cee94d419e009be914deb3fc` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:16.291818 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f770b13-3039-4acd-a071-1cb7d6340ed7 None admin] RBAC: Authorizing `identity:get_user(user_id=44a74d79cee94d419e009be914deb3fc)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:16.296340 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f770b13-3039-4acd-a071-1cb7d6340ed7 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:16.297708 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 561/1121] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 13:04:16 2022] GET /identity/v3/users/44a74d79cee94d419e009be914deb3fc => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:16.303420 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721815f-8d0e-4ab9-a6cb-23ccd20d4611 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:16.358606 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:16.400605 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721815f-8d0e-4ab9-a6cb-23ccd20d4611 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:16.433831 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1d733-1f1b-439b-8f1a-4b1476f99116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:16.434609 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1d733-1f1b-439b-8f1a-4b1476f99116 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:16.434925 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1d733-1f1b-439b-8f1a-4b1476f99116 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:16.435255 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1d733-1f1b-439b-8f1a-4b1476f99116 None admin] PATH_INFO: `/v3/projects/2c14f94a01004e18888361fa1c56f526` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:16.436443 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc1d733-1f1b-439b-8f1a-4b1476f99116 None admin] RBAC: Authorizing `identity:get_project(project_id=2c14f94a01004e18888361fa1c56f526)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:16.437842 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc1d733-1f1b-439b-8f1a-4b1476f99116 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:16.439504 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 561/1122] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:04:16 2022] GET /identity/v3/projects/2c14f94a01004e18888361fa1c56f526 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:16.445328 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f770b13-3039-4acd-a071-1cb7d6340ed7 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:16.502660 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:16.542692 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f770b13-3039-4acd-a071-1cb7d6340ed7 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:16.577518 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438a22f3-31de-4085-951b-4d26ace7c2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:16.578379 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a22f3-31de-4085-951b-4d26ace7c2a4 None admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:16.578658 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a22f3-31de-4085-951b-4d26ace7c2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:16.578932 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a22f3-31de-4085-951b-4d26ace7c2a4 None admin] PATH_INFO: `/v3/projects/2c14f94a01004e18888361fa1c56f526/users/44a74d79cee94d419e009be914deb3fc/roles/7476baf91a50401596c34535d2c79a4f` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:16.581114 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438a22f3-31de-4085-951b-4d26ace7c2a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c14f94a01004e18888361fa1c56f526, user_id=44a74d79cee94d419e009be914deb3fc, role_id=7476baf91a50401596c34535d2c79a4f)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:16.582543 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438a22f3-31de-4085-951b-4d26ace7c2a4 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:16.670192 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 562/1123] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jun 3 13:04:16 2022] PUT /identity/v3/projects/2c14f94a01004e18888361fa1c56f526/users/44a74d79cee94d419e009be914deb3fc/roles/7476baf91a50401596c34535d2c79a4f => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:04:18.924133 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6246a-ec51-4084-9b76-3f4937c6fc62 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:18.924712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6246a-ec51-4084-9b76-3f4937c6fc62 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:18.924712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6246a-ec51-4084-9b76-3f4937c6fc62 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:18.926079 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 562/1124] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:04:18.931319 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328c677-cfcb-4cfc-b81e-5bf8c5b11d51 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:18.931751 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328c677-cfcb-4cfc-b81e-5bf8c5b11d51 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:18.931936 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328c677-cfcb-4cfc-b81e-5bf8c5b11d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:18.949109 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-b328c677-cfcb-4cfc-b81e-5bf8c5b11d51 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:18.950291 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-b328c677-cfcb-4cfc-b81e-5bf8c5b11d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:19.016647 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 563/1125] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:04:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:04:19.040166 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6246a-ec51-4084-9b76-3f4937c6fc62 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:19.137519 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6246a-ec51-4084-9b76-3f4937c6fc62 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:19.160064 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:19.170545 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f184a71-0ad9-4625-9e51-b2ea1eabf5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:19.171382 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f184a71-0ad9-4625-9e51-b2ea1eabf5f1 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:19.171658 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f184a71-0ad9-4625-9e51-b2ea1eabf5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:19.171929 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f184a71-0ad9-4625-9e51-b2ea1eabf5f1 None admin] PATH_INFO: `/v3/roles/7476baf91a50401596c34535d2c79a4f` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:19.173403 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f184a71-0ad9-4625-9e51-b2ea1eabf5f1 None admin] RBAC: Authorizing `identity:get_role(role_id=7476baf91a50401596c34535d2c79a4f)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:19.177666 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f184a71-0ad9-4625-9e51-b2ea1eabf5f1 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:19.177666 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 563/1126] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 13:04:19 2022] GET /identity/v3/roles/7476baf91a50401596c34535d2c79a4f => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:19.181715 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328c677-cfcb-4cfc-b81e-5bf8c5b11d51 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:19.228379 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:19.277704 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328c677-cfcb-4cfc-b81e-5bf8c5b11d51 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:19.311897 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734613e7-7619-46ed-a0f8-8723ef240360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:19.312775 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734613e7-7619-46ed-a0f8-8723ef240360 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:19.313057 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734613e7-7619-46ed-a0f8-8723ef240360 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:19.313330 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734613e7-7619-46ed-a0f8-8723ef240360 None admin] PATH_INFO: `/v3/users/44a74d79cee94d419e009be914deb3fc` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:19.314495 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734613e7-7619-46ed-a0f8-8723ef240360 None admin] RBAC: Authorizing `identity:get_user(user_id=44a74d79cee94d419e009be914deb3fc)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:19.315917 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734613e7-7619-46ed-a0f8-8723ef240360 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:19.317615 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 564/1127] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 13:04:19 2022] GET /identity/v3/users/44a74d79cee94d419e009be914deb3fc => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:19.323397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f184a71-0ad9-4625-9e51-b2ea1eabf5f1 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:19.420706 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f184a71-0ad9-4625-9e51-b2ea1eabf5f1 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:19.453290 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f1269-6030-4373-9dd4-da73a5027e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:19.453862 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f1269-6030-4373-9dd4-da73a5027e8f None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:19.454146 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f1269-6030-4373-9dd4-da73a5027e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:19.454418 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f1269-6030-4373-9dd4-da73a5027e8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:19.510129 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:19.518828 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f1269-6030-4373-9dd4-da73a5027e8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:19.520278 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f1269-6030-4373-9dd4-da73a5027e8f None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:19.614262 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 564/1128] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:04:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 13:04:19.620391 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734613e7-7619-46ed-a0f8-8723ef240360 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:19.715603 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734613e7-7619-46ed-a0f8-8723ef240360 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:19.731557 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:19.749354 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc47c9-5403-4866-95ea-5e1d835b0fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:19.761691 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc47c9-5403-4866-95ea-5e1d835b0fff None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:19.761691 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc47c9-5403-4866-95ea-5e1d835b0fff None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:19.761691 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc47c9-5403-4866-95ea-5e1d835b0fff None admin] PATH_INFO: `/v3/projects/2c14f94a01004e18888361fa1c56f526` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:19.761691 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc47c9-5403-4866-95ea-5e1d835b0fff None admin] RBAC: Authorizing `identity:get_project(project_id=2c14f94a01004e18888361fa1c56f526)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:19.761691 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc47c9-5403-4866-95ea-5e1d835b0fff None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:19.761691 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 565/1129] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:04:19 2022] GET /identity/v3/projects/2c14f94a01004e18888361fa1c56f526 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:19.762239 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f1269-6030-4373-9dd4-da73a5027e8f None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:19.849407 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:19.858358 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f1269-6030-4373-9dd4-da73a5027e8f None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:19.890883 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb4c57-4ad5-4db3-a730-4bc6b014f5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:19.891521 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb4c57-4ad5-4db3-a730-4bc6b014f5ad None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:19.891802 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb4c57-4ad5-4db3-a730-4bc6b014f5ad None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:19.892070 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb4c57-4ad5-4db3-a730-4bc6b014f5ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:19.892914 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb4c57-4ad5-4db3-a730-4bc6b014f5ad None admin] RBAC: Adding query filter params (role.id=7476baf91a50401596c34535d2c79a4f, scope.project.id=2c14f94a01004e18888361fa1c56f526, user.id=44a74d79cee94d419e009be914deb3fc) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:04:19.893229 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb4c57-4ad5-4db3-a730-4bc6b014f5ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:19.894659 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb4c57-4ad5-4db3-a730-4bc6b014f5ad None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:19.900612 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 565/1130] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 13:04:19 2022] GET /identity/v3/role_assignments?user.id=44a74d79cee94d419e009be914deb3fc&scope.project.id=2c14f94a01004e18888361fa1c56f526&role.id=7476baf91a50401596c34535d2c79a4f => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:22.134303 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be68a2-2f19-4504-bb3d-51419e4a82ad None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:22.134828 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be68a2-2f19-4504-bb3d-51419e4a82ad None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:22.134828 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be68a2-2f19-4504-bb3d-51419e4a82ad None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:22.136230 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 566/1131] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:04:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:04:22.142276 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5f849-5270-4cee-858b-cf3fc907e5c7 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:22.142692 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5f849-5270-4cee-858b-cf3fc907e5c7 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:22.142913 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5f849-5270-4cee-858b-cf3fc907e5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:22.159002 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-79c5f849-5270-4cee-858b-cf3fc907e5c7 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:22.160169 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-79c5f849-5270-4cee-858b-cf3fc907e5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:22.224220 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 566/1132] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:04:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:04:22.247086 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be68a2-2f19-4504-bb3d-51419e4a82ad None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:22.347326 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be68a2-2f19-4504-bb3d-51419e4a82ad None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:22.380103 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb1491f-ec93-4ea5-bb53-60f2d33a3a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:22.380903 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1491f-ec93-4ea5-bb53-60f2d33a3a85 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:22.381185 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1491f-ec93-4ea5-bb53-60f2d33a3a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:22.381460 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1491f-ec93-4ea5-bb53-60f2d33a3a85 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:22.382610 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb1491f-ec93-4ea5-bb53-60f2d33a3a85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:22.384031 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb1491f-ec93-4ea5-bb53-60f2d33a3a85 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:22.385644 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 567/1133] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:04:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:22.391843 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5f849-5270-4cee-858b-cf3fc907e5c7 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:22.474114 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:22.488593 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5f849-5270-4cee-858b-cf3fc907e5c7 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:22.520845 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a313e-0dcb-4a86-b222-45c3f576a7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:22.521488 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a313e-0dcb-4a86-b222-45c3f576a7cf None admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:22.521768 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a313e-0dcb-4a86-b222-45c3f576a7cf None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:22.522041 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a313e-0dcb-4a86-b222-45c3f576a7cf None admin] PATH_INFO: `/v3/projects` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:22.522724 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a313e-0dcb-4a86-b222-45c3f576a7cf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:22.524134 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a313e-0dcb-4a86-b222-45c3f576a7cf None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:22.650265 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 567/1134] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Jun 3 13:04:22 2022] POST /identity/v3/projects => generated 311 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:04:24.957598 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89873afb-74d6-47a8-af4a-b22474f9822d None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:24.958134 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89873afb-74d6-47a8-af4a-b22474f9822d None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:24.958134 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89873afb-74d6-47a8-af4a-b22474f9822d None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:24.959499 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 568/1135] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:04:24.964821 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb8121-ba4b-4fd0-a3b7-9b9f368de0f4 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:24.965219 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb8121-ba4b-4fd0-a3b7-9b9f368de0f4 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:24.965385 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb8121-ba4b-4fd0-a3b7-9b9f368de0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:24.982881 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-4deb8121-ba4b-4fd0-a3b7-9b9f368de0f4 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:24.984051 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-4deb8121-ba4b-4fd0-a3b7-9b9f368de0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:25.049489 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 568/1136] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:04:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:04:25.074554 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89873afb-74d6-47a8-af4a-b22474f9822d None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:25.127633 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:25.173821 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89873afb-74d6-47a8-af4a-b22474f9822d None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:25.206246 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e58663-54ec-440e-9e40-5758930551ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:25.207019 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e58663-54ec-440e-9e40-5758930551ce None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:25.207298 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e58663-54ec-440e-9e40-5758930551ce None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:25.207569 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e58663-54ec-440e-9e40-5758930551ce None admin] PATH_INFO: `/v3/domains/default` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:25.208786 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e58663-54ec-440e-9e40-5758930551ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:25.210201 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e58663-54ec-440e-9e40-5758930551ce None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:25.211775 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 569/1137] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:04:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:25.217538 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb8121-ba4b-4fd0-a3b7-9b9f368de0f4 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:25.281079 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:25.312646 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb8121-ba4b-4fd0-a3b7-9b9f368de0f4 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:25.354355 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9c02a-7b2f-4c74-8829-23e96f6dc131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:25.355018 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9c02a-7b2f-4c74-8829-23e96f6dc131 None admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:25.355304 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9c02a-7b2f-4c74-8829-23e96f6dc131 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:25.355581 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9c02a-7b2f-4c74-8829-23e96f6dc131 None admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:25.356322 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d9c02a-7b2f-4c74-8829-23e96f6dc131 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:25.358399 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d9c02a-7b2f-4c74-8829-23e96f6dc131 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:25.449488 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 569/1138] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jun 3 13:04:25 2022] POST /identity/v3/users => generated 286 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:04:27.715757 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23773b19-8080-493c-93b7-6e7b52da0009 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:27.717039 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23773b19-8080-493c-93b7-6e7b52da0009 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:27.717039 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23773b19-8080-493c-93b7-6e7b52da0009 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:27.718216 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 570/1139] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:04:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:04:27.723448 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ff6a1-da8b-4cb7-b6d0-652d80123673 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:27.724135 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ff6a1-da8b-4cb7-b6d0-652d80123673 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:27.724295 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ff6a1-da8b-4cb7-b6d0-652d80123673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:27.741072 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-3b8ff6a1-da8b-4cb7-b6d0-652d80123673 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:27.742235 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-3b8ff6a1-da8b-4cb7-b6d0-652d80123673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:27.805580 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 570/1140] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:04:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:04:27.829095 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23773b19-8080-493c-93b7-6e7b52da0009 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:27.928827 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23773b19-8080-493c-93b7-6e7b52da0009 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:27.948253 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:27.961754 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd6009-1e70-4af3-a4fb-678d800717f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:27.962534 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd6009-1e70-4af3-a4fb-678d800717f0 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:27.962814 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd6009-1e70-4af3-a4fb-678d800717f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:27.963087 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd6009-1e70-4af3-a4fb-678d800717f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:27.972920 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd6009-1e70-4af3-a4fb-678d800717f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:04:27.981112 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-12cd6009-1e70-4af3-a4fb-678d800717f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:04:27.981112 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:04:27.981112 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:04:27.981112 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:04:27.981112 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:04:27.981112 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:04:27.981112 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:04:27.981112 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:04:27.981112 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:04:27.981112 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:04:27.981112 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:04:27.981112 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:04:27.981112 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:04:27.981112 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:04:27.981112 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:04:27.981112 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:04:27.982877 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:04:27.982877 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:04:27.982877 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:04:27.982877 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:04:27.982877 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:04:27.982877 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:04:27.982877 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:04:27.982877 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:04:27.982877 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:04:27.982877 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:04:27.982877 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:04:27.982877 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:04:27.982877 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:04:27.982877 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:04:27.982877 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:04:27.982877 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:04:27.983737 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:04:27.983737 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:04:27.983737 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:04:27.983737 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:04:27.983737 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:04:27.983737 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:04:27.983737 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:04:27.983737 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:04:27.983737 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:04:27.983737 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:04:27.983737 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:04:27.983737 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:04:27.983737 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 571/1141] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 13:04:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:04:27.988813 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ff6a1-da8b-4cb7-b6d0-652d80123673 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:28.043405 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:28.086891 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ff6a1-da8b-4cb7-b6d0-652d80123673 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:28.123121 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706ab79-86c5-499c-93d8-3854990d12e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:28.123786 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706ab79-86c5-499c-93d8-3854990d12e8 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:28.124069 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706ab79-86c5-499c-93d8-3854990d12e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:28.124376 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706ab79-86c5-499c-93d8-3854990d12e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:28.125118 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4706ab79-86c5-499c-93d8-3854990d12e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:04:28.125423 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4706ab79-86c5-499c-93d8-3854990d12e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:28.126798 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4706ab79-86c5-499c-93d8-3854990d12e8 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:28.134605 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 571/1142] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:04:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:28.140567 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd6009-1e70-4af3-a4fb-678d800717f0 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:28.238095 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd6009-1e70-4af3-a4fb-678d800717f0 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:28.269299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d4b04-4033-457e-882e-d1b3d98f22f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:28.270136 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d4b04-4033-457e-882e-d1b3d98f22f0 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:28.270418 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d4b04-4033-457e-882e-d1b3d98f22f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:28.270691 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d4b04-4033-457e-882e-d1b3d98f22f0 None admin] PATH_INFO: `/v3/users/16b805318e0a4ce6b60d6711a34d9533` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:28.283705 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2d4b04-4033-457e-882e-d1b3d98f22f0 None admin] RBAC: Authorizing `identity:get_user(user_id=16b805318e0a4ce6b60d6711a34d9533)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:28.285162 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2d4b04-4033-457e-882e-d1b3d98f22f0 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:28.286767 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 572/1143] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 13:04:28 2022] GET /identity/v3/users/16b805318e0a4ce6b60d6711a34d9533 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:28.292445 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706ab79-86c5-499c-93d8-3854990d12e8 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:28.392367 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706ab79-86c5-499c-93d8-3854990d12e8 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:28.408687 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:28.425610 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f502f-bd9d-4cd6-bc80-7cc38d3a744e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:28.426252 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f502f-bd9d-4cd6-bc80-7cc38d3a744e None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:28.426536 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f502f-bd9d-4cd6-bc80-7cc38d3a744e None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:28.426812 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f502f-bd9d-4cd6-bc80-7cc38d3a744e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:28.493892 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398f502f-bd9d-4cd6-bc80-7cc38d3a744e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:28.495285 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398f502f-bd9d-4cd6-bc80-7cc38d3a744e None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:28.592223 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 572/1144] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:04:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 13:04:28.598056 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d4b04-4033-457e-882e-d1b3d98f22f0 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:28.636202 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:28.694379 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d4b04-4033-457e-882e-d1b3d98f22f0 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:28.728424 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13874a1a-8231-48f4-ac33-6e30c003344d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:28.729295 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13874a1a-8231-48f4-ac33-6e30c003344d None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:28.729579 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13874a1a-8231-48f4-ac33-6e30c003344d None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:28.729854 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13874a1a-8231-48f4-ac33-6e30c003344d None admin] PATH_INFO: `/v3/projects/e35dbcf39a16419dbaa04da91a9cb387` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:28.731064 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13874a1a-8231-48f4-ac33-6e30c003344d None admin] RBAC: Authorizing `identity:get_project(project_id=e35dbcf39a16419dbaa04da91a9cb387)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:28.732819 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13874a1a-8231-48f4-ac33-6e30c003344d None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:28.734546 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 573/1145] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:04:28 2022] GET /identity/v3/projects/e35dbcf39a16419dbaa04da91a9cb387 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:28.740909 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f502f-bd9d-4cd6-bc80-7cc38d3a744e None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:28.758722 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:28.838214 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f502f-bd9d-4cd6-bc80-7cc38d3a744e None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:28.870547 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a312edb3-e0a3-4feb-8a32-c831e24a1d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:28.871186 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312edb3-e0a3-4feb-8a32-c831e24a1d0d None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:28.871469 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312edb3-e0a3-4feb-8a32-c831e24a1d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:28.871743 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312edb3-e0a3-4feb-8a32-c831e24a1d0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:28.873508 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a312edb3-e0a3-4feb-8a32-c831e24a1d0d None admin] RBAC: Adding query filter params (role.id=bbd5f3e0c18e4992886fcfb4a3feb426, scope.project.id=e35dbcf39a16419dbaa04da91a9cb387, user.id=16b805318e0a4ce6b60d6711a34d9533) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:04:28.873821 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a312edb3-e0a3-4feb-8a32-c831e24a1d0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:28.875250 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a312edb3-e0a3-4feb-8a32-c831e24a1d0d None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:28.880540 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 573/1146] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 13:04:28 2022] GET /identity/v3/role_assignments?user.id=16b805318e0a4ce6b60d6711a34d9533&scope.project.id=e35dbcf39a16419dbaa04da91a9cb387&role.id=bbd5f3e0c18e4992886fcfb4a3feb426 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:31.085569 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c807ea0-d82c-462b-a3ea-951c51fd6809 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:31.086125 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c807ea0-d82c-462b-a3ea-951c51fd6809 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:31.086125 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c807ea0-d82c-462b-a3ea-951c51fd6809 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:31.087446 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 574/1147] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:04:31.092869 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48599c8e-f6e6-4b2c-a6ae-2da973bb2099 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:31.093271 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48599c8e-f6e6-4b2c-a6ae-2da973bb2099 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:31.093424 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48599c8e-f6e6-4b2c-a6ae-2da973bb2099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:31.110017 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-48599c8e-f6e6-4b2c-a6ae-2da973bb2099 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:31.111184 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-48599c8e-f6e6-4b2c-a6ae-2da973bb2099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:31.174996 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 574/1148] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:04:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:04:31.197789 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c807ea0-d82c-462b-a3ea-951c51fd6809 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:31.296180 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c807ea0-d82c-462b-a3ea-951c51fd6809 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:31.303258 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:31.329709 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ed9ff-8668-439b-801f-875c03050142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:31.330479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ed9ff-8668-439b-801f-875c03050142 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:31.330763 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ed9ff-8668-439b-801f-875c03050142 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:31.331035 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ed9ff-8668-439b-801f-875c03050142 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:31.341380 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ed9ff-8668-439b-801f-875c03050142 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:04:31.349361 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-428ed9ff-8668-439b-801f-875c03050142 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:04:31.349361 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:04:31.349361 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:04:31.349361 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:04:31.349361 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:04:31.349361 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:04:31.349361 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:04:31.349361 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:04:31.349361 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:04:31.349361 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:04:31.349361 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:04:31.349361 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:04:31.349361 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:04:31.349361 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:04:31.349361 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:04:31.349361 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:04:31.350360 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:04:31.350360 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:04:31.350360 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:04:31.350360 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:04:31.350360 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:04:31.350360 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:04:31.350360 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:04:31.350360 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:04:31.350360 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:04:31.350360 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:04:31.350360 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:04:31.350360 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:04:31.350360 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:04:31.350360 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:04:31.350360 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:04:31.350360 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:04:31.351420 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:04:31.351420 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:04:31.351420 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:04:31.351420 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:04:31.351420 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:04:31.351420 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:04:31.351420 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:04:31.351420 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:04:31.351420 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:04:31.351420 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:04:31.351420 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:04:31.351420 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:04:31.351420 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 575/1149] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 13:04:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:04:31.356988 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48599c8e-f6e6-4b2c-a6ae-2da973bb2099 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:31.368164 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:31.453988 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48599c8e-f6e6-4b2c-a6ae-2da973bb2099 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:31.486686 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac7c6c-b2b6-4253-88ce-7685b56eb1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:31.487326 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac7c6c-b2b6-4253-88ce-7685b56eb1bd None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:31.487605 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac7c6c-b2b6-4253-88ce-7685b56eb1bd None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:31.487876 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac7c6c-b2b6-4253-88ce-7685b56eb1bd None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:31.488763 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbac7c6c-b2b6-4253-88ce-7685b56eb1bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:04:31.489064 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbac7c6c-b2b6-4253-88ce-7685b56eb1bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:31.490406 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbac7c6c-b2b6-4253-88ce-7685b56eb1bd None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:31.498856 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 575/1150] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:04:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:31.504758 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ed9ff-8668-439b-801f-875c03050142 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:31.599160 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ed9ff-8668-439b-801f-875c03050142 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:31.631864 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d710d8cb-63cd-4690-821a-bd39b8842ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:31.632733 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d710d8cb-63cd-4690-821a-bd39b8842ebd None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:31.633015 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d710d8cb-63cd-4690-821a-bd39b8842ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:31.633288 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d710d8cb-63cd-4690-821a-bd39b8842ebd None admin] PATH_INFO: `/v3/users/16b805318e0a4ce6b60d6711a34d9533` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:31.634434 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d710d8cb-63cd-4690-821a-bd39b8842ebd None admin] RBAC: Authorizing `identity:get_user(user_id=16b805318e0a4ce6b60d6711a34d9533)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:31.635848 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d710d8cb-63cd-4690-821a-bd39b8842ebd None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:31.637471 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 576/1151] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 13:04:31 2022] GET /identity/v3/users/16b805318e0a4ce6b60d6711a34d9533 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:31.643375 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac7c6c-b2b6-4253-88ce-7685b56eb1bd None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:31.711409 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:31.745637 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac7c6c-b2b6-4253-88ce-7685b56eb1bd None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:31.779193 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c0c0a7-7b20-4199-b287-95dcc91922b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:31.780045 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0c0a7-7b20-4199-b287-95dcc91922b5 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:31.780352 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0c0a7-7b20-4199-b287-95dcc91922b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:31.780627 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0c0a7-7b20-4199-b287-95dcc91922b5 None admin] PATH_INFO: `/v3/projects/e35dbcf39a16419dbaa04da91a9cb387` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:31.781786 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c0c0a7-7b20-4199-b287-95dcc91922b5 None admin] RBAC: Authorizing `identity:get_project(project_id=e35dbcf39a16419dbaa04da91a9cb387)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:31.783202 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c0c0a7-7b20-4199-b287-95dcc91922b5 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:31.784909 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 576/1152] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:04:31 2022] GET /identity/v3/projects/e35dbcf39a16419dbaa04da91a9cb387 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:31.790915 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d710d8cb-63cd-4690-821a-bd39b8842ebd None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:31.824489 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:31.887517 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d710d8cb-63cd-4690-821a-bd39b8842ebd None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:31.919806 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f912acd1-6fc3-459f-92fb-eec6ae2c62c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:31.920717 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912acd1-6fc3-459f-92fb-eec6ae2c62c0 None admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:31.920961 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912acd1-6fc3-459f-92fb-eec6ae2c62c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:31.921224 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912acd1-6fc3-459f-92fb-eec6ae2c62c0 None admin] PATH_INFO: `/v3/projects/e35dbcf39a16419dbaa04da91a9cb387/users/16b805318e0a4ce6b60d6711a34d9533/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:31.923124 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f912acd1-6fc3-459f-92fb-eec6ae2c62c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=e35dbcf39a16419dbaa04da91a9cb387, user_id=16b805318e0a4ce6b60d6711a34d9533, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:31.924582 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f912acd1-6fc3-459f-92fb-eec6ae2c62c0 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:32.037884 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 577/1153] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jun 3 13:04:31 2022] PUT /identity/v3/projects/e35dbcf39a16419dbaa04da91a9cb387/users/16b805318e0a4ce6b60d6711a34d9533/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:04:34.228019 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c3c45-2659-4c07-9b00-9d46f265a0ed None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:34.228608 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c3c45-2659-4c07-9b00-9d46f265a0ed None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:34.228718 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c3c45-2659-4c07-9b00-9d46f265a0ed None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:34.230053 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 577/1154] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:04:34.235937 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e4dda-6be9-4035-9470-0b33004582de None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:34.236413 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e4dda-6be9-4035-9470-0b33004582de None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:34.236515 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e4dda-6be9-4035-9470-0b33004582de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:34.252999 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-803e4dda-6be9-4035-9470-0b33004582de None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:34.254108 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-803e4dda-6be9-4035-9470-0b33004582de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:34.318307 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 578/1155] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:04:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:04:34.342124 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c3c45-2659-4c07-9b00-9d46f265a0ed None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:34.441816 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c3c45-2659-4c07-9b00-9d46f265a0ed None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:34.474705 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c120a-d313-45a1-b9ab-5a34c08f7ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:34.475478 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c120a-d313-45a1-b9ab-5a34c08f7ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:34.475757 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c120a-d313-45a1-b9ab-5a34c08f7ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:34.476030 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c120a-d313-45a1-b9ab-5a34c08f7ec7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:34.483288 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:34.486571 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8c120a-d313-45a1-b9ab-5a34c08f7ec7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:04:34.494066 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-ce8c120a-d313-45a1-b9ab-5a34c08f7ec7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:04:34.494066 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:04:34.494066 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:04:34.494066 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:04:34.494066 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:04:34.494066 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:04:34.494066 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:04:34.494066 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:04:34.494066 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:04:34.494066 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:04:34.494066 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:04:34.494066 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:04:34.494066 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:04:34.494066 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:04:34.494066 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:04:34.494066 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:04:34.495160 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:04:34.495160 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:04:34.495160 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:04:34.495160 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:04:34.495160 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:04:34.495160 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:04:34.495160 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:04:34.495160 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:04:34.495160 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:04:34.495160 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:04:34.495160 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:04:34.495160 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:04:34.495160 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:04:34.495160 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:04:34.495160 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:04:34.495160 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:04:34.503130 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:04:34.503130 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:04:34.503130 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:04:34.503130 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:04:34.503130 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:04:34.503130 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:04:34.503130 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:04:34.503130 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:04:34.503130 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:04:34.503130 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:04:34.503130 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:04:34.503130 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:04:34.503130 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 578/1156] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 13:04:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:04:34.504035 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e4dda-6be9-4035-9470-0b33004582de None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:34.526172 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:34.597823 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e4dda-6be9-4035-9470-0b33004582de None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:34.629600 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d9a71-c216-4f04-83b2-8775dfecafd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:34.630245 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d9a71-c216-4f04-83b2-8775dfecafd1 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:34.630522 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d9a71-c216-4f04-83b2-8775dfecafd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:34.630794 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d9a71-c216-4f04-83b2-8775dfecafd1 None admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:34.631526 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d9a71-c216-4f04-83b2-8775dfecafd1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:04:34.631824 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d9a71-c216-4f04-83b2-8775dfecafd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:34.633205 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d9a71-c216-4f04-83b2-8775dfecafd1 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:34.641446 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 579/1157] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:04:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:34.647219 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c120a-d313-45a1-b9ab-5a34c08f7ec7 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:34.742577 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c120a-d313-45a1-b9ab-5a34c08f7ec7 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:34.775709 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f4999-0e36-46aa-bfa0-acf3de52ed20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:34.776535 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f4999-0e36-46aa-bfa0-acf3de52ed20 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:34.776818 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f4999-0e36-46aa-bfa0-acf3de52ed20 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:34.777090 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f4999-0e36-46aa-bfa0-acf3de52ed20 None admin] PATH_INFO: `/v3/users/16b805318e0a4ce6b60d6711a34d9533` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:34.778295 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f4999-0e36-46aa-bfa0-acf3de52ed20 None admin] RBAC: Authorizing `identity:get_user(user_id=16b805318e0a4ce6b60d6711a34d9533)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:34.779784 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f4999-0e36-46aa-bfa0-acf3de52ed20 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:34.781406 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 579/1158] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 13:04:34 2022] GET /identity/v3/users/16b805318e0a4ce6b60d6711a34d9533 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:34.787075 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d9a71-c216-4f04-83b2-8775dfecafd1 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:34.867989 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:34.882808 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d9a71-c216-4f04-83b2-8775dfecafd1 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:34.915594 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19da3d9-1e98-4822-90b8-58396dc9399a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:34.916243 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19da3d9-1e98-4822-90b8-58396dc9399a None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:34.916525 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19da3d9-1e98-4822-90b8-58396dc9399a None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:34.916793 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19da3d9-1e98-4822-90b8-58396dc9399a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:34.982262 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19da3d9-1e98-4822-90b8-58396dc9399a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:34.983778 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19da3d9-1e98-4822-90b8-58396dc9399a None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:35.064591 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:35.079167 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 580/1159] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:04:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 13:04:35.085016 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f4999-0e36-46aa-bfa0-acf3de52ed20 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:35.149609 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:35.180838 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f4999-0e36-46aa-bfa0-acf3de52ed20 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:35.213538 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f1e7c-5b75-4d51-885e-c22f07d481b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:35.214387 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f1e7c-5b75-4d51-885e-c22f07d481b0 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:35.214665 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f1e7c-5b75-4d51-885e-c22f07d481b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:35.214934 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f1e7c-5b75-4d51-885e-c22f07d481b0 None admin] PATH_INFO: `/v3/projects/e35dbcf39a16419dbaa04da91a9cb387` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:35.216724 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f1e7c-5b75-4d51-885e-c22f07d481b0 None admin] RBAC: Authorizing `identity:get_project(project_id=e35dbcf39a16419dbaa04da91a9cb387)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:35.218151 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f1e7c-5b75-4d51-885e-c22f07d481b0 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:35.219818 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 580/1160] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:04:35 2022] GET /identity/v3/projects/e35dbcf39a16419dbaa04da91a9cb387 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:35.226116 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19da3d9-1e98-4822-90b8-58396dc9399a None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:35.319931 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19da3d9-1e98-4822-90b8-58396dc9399a None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:35.353160 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d4272-7038-4768-9c98-b447adb7e5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:35.353794 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d4272-7038-4768-9c98-b447adb7e5c7 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:35.354075 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d4272-7038-4768-9c98-b447adb7e5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:35.354349 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d4272-7038-4768-9c98-b447adb7e5c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:35.355161 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d4272-7038-4768-9c98-b447adb7e5c7 None admin] RBAC: Adding query filter params (role.id=bbd5f3e0c18e4992886fcfb4a3feb426, scope.project.id=e35dbcf39a16419dbaa04da91a9cb387, user.id=16b805318e0a4ce6b60d6711a34d9533) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:04:35.355469 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d4272-7038-4768-9c98-b447adb7e5c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:35.356999 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d4272-7038-4768-9c98-b447adb7e5c7 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:35.362594 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 581/1161] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 13:04:35 2022] GET /identity/v3/role_assignments?user.id=16b805318e0a4ce6b60d6711a34d9533&scope.project.id=e35dbcf39a16419dbaa04da91a9cb387&role.id=bbd5f3e0c18e4992886fcfb4a3feb426 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:37.655114 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583b06c-b255-4ba2-b6dd-05fbca5d56fc None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:37.655687 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583b06c-b255-4ba2-b6dd-05fbca5d56fc None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:37.655687 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583b06c-b255-4ba2-b6dd-05fbca5d56fc None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:37.657094 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 581/1162] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:04:37.662750 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2332ca-964b-46aa-b25b-2df2de60d663 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:37.663209 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2332ca-964b-46aa-b25b-2df2de60d663 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:37.663300 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2332ca-964b-46aa-b25b-2df2de60d663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:37.680324 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-aa2332ca-964b-46aa-b25b-2df2de60d663 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:37.681494 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-aa2332ca-964b-46aa-b25b-2df2de60d663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:37.726052 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:37.745916 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 582/1163] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:04:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:04:37.768699 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c583b06c-b255-4ba2-b6dd-05fbca5d56fc None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:37.866718 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c583b06c-b255-4ba2-b6dd-05fbca5d56fc None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:37.898609 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b37990-a127-4595-b7ef-c52266b2042f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:37.899240 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b37990-a127-4595-b7ef-c52266b2042f None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:37.899522 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b37990-a127-4595-b7ef-c52266b2042f None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:37.899797 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b37990-a127-4595-b7ef-c52266b2042f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:37.903094 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:37.964557 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b37990-a127-4595-b7ef-c52266b2042f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:37.966529 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b37990-a127-4595-b7ef-c52266b2042f None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:38.078045 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 582/1164] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:04:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 13:04:38.084282 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2332ca-964b-46aa-b25b-2df2de60d663 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:38.182071 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2332ca-964b-46aa-b25b-2df2de60d663 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:38.214506 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178422c-ba55-4afa-810c-f6c91b7a6a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:38.215342 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178422c-ba55-4afa-810c-f6c91b7a6a0e None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:38.215567 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178422c-ba55-4afa-810c-f6c91b7a6a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:38.216420 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178422c-ba55-4afa-810c-f6c91b7a6a0e None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:38.222854 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178422c-ba55-4afa-810c-f6c91b7a6a0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:38.224592 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178422c-ba55-4afa-810c-f6c91b7a6a0e None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:38.238229 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-a178422c-ba55-4afa-810c-f6c91b7a6a0e None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 03 13:04:38.238229 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:04:38.238229 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 03 13:04:38.238229 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 03 13:04:38.238229 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 13:04:38.238229 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 13:04:38.238229 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 13:04:38.238229 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 13:04:38.238229 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 03 13:04:38.238229 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:04:38.238229 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 13:04:38.238229 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:04:38.238229 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:04:38.238229 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:04:38.238229 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:04:38.238229 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:04:38.238229 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:04:38.239463 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:04:38.239463 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:04:38.239463 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:04:38.239463 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:04:38.239463 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:04:38.239463 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:04:38.239463 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:04:38.239463 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:04:38.239463 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:04:38.239463 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:04:38.239463 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:04:38.239463 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:04:38.239463 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:04:38.239463 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:04:38.239463 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:04:38.239463 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:04:38.240955 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:04:38.240955 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:04:38.240955 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:04:38.240955 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:04:38.240955 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:04:38.240955 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:04:38.240955 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:04:38.240955 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:04:38.240955 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:04:38.240955 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:04:38.240955 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 03 13:04:38.240955 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:04:38.240955 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 03 13:04:38.240955 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:04:38.240955 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 583/1165] 10.222.0.61 () {56 vars in 1117 bytes} [Fri Jun 3 13:04:38 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:04:38.245745 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b37990-a127-4595-b7ef-c52266b2042f None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:38.280393 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:38.345404 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b37990-a127-4595-b7ef-c52266b2042f None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:38.378650 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d3ef6-a383-4b28-b744-7ec52fd00d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:38.379311 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d3ef6-a383-4b28-b744-7ec52fd00d61 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:38.379592 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d3ef6-a383-4b28-b744-7ec52fd00d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:38.379866 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d3ef6-a383-4b28-b744-7ec52fd00d61 None admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:38.380616 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d3ef6-a383-4b28-b744-7ec52fd00d61 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:04:38.380920 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d3ef6-a383-4b28-b744-7ec52fd00d61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:38.382268 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d3ef6-a383-4b28-b744-7ec52fd00d61 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:38.390010 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 583/1166] 10.222.0.61 () {56 vars in 1115 bytes} [Fri Jun 3 13:04:38 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:40.605607 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75a149-3808-4f0d-90b5-18f3d3ade643 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:40.606171 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75a149-3808-4f0d-90b5-18f3d3ade643 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:40.606171 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75a149-3808-4f0d-90b5-18f3d3ade643 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:40.608030 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 584/1167] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:04:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:04:40.613244 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3e489-67e8-4758-a338-8fe3dc15a9d1 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:40.613652 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3e489-67e8-4758-a338-8fe3dc15a9d1 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:40.613800 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3e489-67e8-4758-a338-8fe3dc15a9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:40.630571 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-4bb3e489-67e8-4758-a338-8fe3dc15a9d1 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:40.631730 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-4bb3e489-67e8-4758-a338-8fe3dc15a9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:40.694652 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 584/1168] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:04:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:04:40.716836 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75a149-3808-4f0d-90b5-18f3d3ade643 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:40.758798 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:40.816422 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75a149-3808-4f0d-90b5-18f3d3ade643 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:40.849298 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce7555-825f-40db-8413-45a15c09e303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:40.849945 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce7555-825f-40db-8413-45a15c09e303 None admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:40.850232 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce7555-825f-40db-8413-45a15c09e303 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:40.850512 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce7555-825f-40db-8413-45a15c09e303 None admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:40.851252 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce7555-825f-40db-8413-45a15c09e303 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:40.852667 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce7555-825f-40db-8413-45a15c09e303 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:40.947260 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 585/1169] 10.222.0.61 () {60 vars in 1138 bytes} [Fri Jun 3 13:04:40 2022] POST /identity/v3/domains => generated 267 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:04:43.192576 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0790f-d700-43b9-8d75-4c2bf080eace None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:43.193102 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0790f-d700-43b9-8d75-4c2bf080eace None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:43.193102 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0790f-d700-43b9-8d75-4c2bf080eace None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:43.194502 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 585/1170] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:04:43.199654 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c1cc2-1bcf-4801-825e-ce7438713858 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:43.200200 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c1cc2-1bcf-4801-825e-ce7438713858 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:43.200492 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c1cc2-1bcf-4801-825e-ce7438713858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:43.217233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-830c1cc2-1bcf-4801-825e-ce7438713858 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:43.218427 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-830c1cc2-1bcf-4801-825e-ce7438713858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:43.285558 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 586/1171] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:04:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:04:43.308658 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d0790f-d700-43b9-8d75-4c2bf080eace None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:43.339150 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:43.407975 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d0790f-d700-43b9-8d75-4c2bf080eace None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:43.441271 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504bfdd-21c8-4a5b-8e63-262560a7511b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:43.442121 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504bfdd-21c8-4a5b-8e63-262560a7511b None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:43.442401 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504bfdd-21c8-4a5b-8e63-262560a7511b None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:43.442670 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504bfdd-21c8-4a5b-8e63-262560a7511b None admin] PATH_INFO: `/v3/domains/58975bfe601544299c95acf9e6911ff0` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:43.453013 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e504bfdd-21c8-4a5b-8e63-262560a7511b None admin] RBAC: Authorizing `identity:get_domain(domain_id=58975bfe601544299c95acf9e6911ff0)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:43.454446 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e504bfdd-21c8-4a5b-8e63-262560a7511b None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:43.456052 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 586/1172] 10.222.0.61 () {56 vars in 1183 bytes} [Fri Jun 3 13:04:43 2022] GET /identity/v3/domains/58975bfe601544299c95acf9e6911ff0 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:43.461922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c1cc2-1bcf-4801-825e-ce7438713858 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:43.491283 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:43.560177 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c1cc2-1bcf-4801-825e-ce7438713858 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:43.595022 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee80cc-da3e-44d3-a1b3-c30271bc5819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:43.595668 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee80cc-da3e-44d3-a1b3-c30271bc5819 None admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:43.595941 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee80cc-da3e-44d3-a1b3-c30271bc5819 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:43.596236 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee80cc-da3e-44d3-a1b3-c30271bc5819 None admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:43.596925 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee80cc-da3e-44d3-a1b3-c30271bc5819 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:43.598355 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee80cc-da3e-44d3-a1b3-c30271bc5819 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:43.676541 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 587/1173] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Jun 3 13:04:43 2022] POST /identity/v3/projects => generated 361 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:04:45.963992 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63512227-b9cb-46d5-bde3-22ee4a6ccb63 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:45.964598 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63512227-b9cb-46d5-bde3-22ee4a6ccb63 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:45.964598 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63512227-b9cb-46d5-bde3-22ee4a6ccb63 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:45.965957 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 587/1174] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:04:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:04:45.971108 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ace65-3d6e-4738-9eed-d271d684a908 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:45.971500 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ace65-3d6e-4738-9eed-d271d684a908 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:45.971657 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ace65-3d6e-4738-9eed-d271d684a908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:45.988716 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-f59ace65-3d6e-4738-9eed-d271d684a908 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:45.989884 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-f59ace65-3d6e-4738-9eed-d271d684a908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:46.054761 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 588/1175] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:04:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:04:46.079107 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63512227-b9cb-46d5-bde3-22ee4a6ccb63 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:46.167967 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:46.178550 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63512227-b9cb-46d5-bde3-22ee4a6ccb63 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:46.211070 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0483f63-d8f8-40d3-8e38-f43bae2aa245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:46.211919 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0483f63-d8f8-40d3-8e38-f43bae2aa245 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:46.212223 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0483f63-d8f8-40d3-8e38-f43bae2aa245 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:46.212493 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0483f63-d8f8-40d3-8e38-f43bae2aa245 None admin] PATH_INFO: `/v3/domains/58975bfe601544299c95acf9e6911ff0` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:46.213641 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0483f63-d8f8-40d3-8e38-f43bae2aa245 None admin] RBAC: Authorizing `identity:get_domain(domain_id=58975bfe601544299c95acf9e6911ff0)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:46.215087 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0483f63-d8f8-40d3-8e38-f43bae2aa245 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:46.217182 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 588/1176] 10.222.0.61 () {56 vars in 1183 bytes} [Fri Jun 3 13:04:46 2022] GET /identity/v3/domains/58975bfe601544299c95acf9e6911ff0 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:46.222817 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ace65-3d6e-4738-9eed-d271d684a908 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:46.237276 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:46.319142 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ace65-3d6e-4738-9eed-d271d684a908 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:46.351968 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e494ded-fa49-4c69-82c4-a94022775dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:46.352636 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e494ded-fa49-4c69-82c4-a94022775dda None admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:46.352918 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e494ded-fa49-4c69-82c4-a94022775dda None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:46.353190 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e494ded-fa49-4c69-82c4-a94022775dda None admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:46.353878 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e494ded-fa49-4c69-82c4-a94022775dda None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:46.355297 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e494ded-fa49-4c69-82c4-a94022775dda None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:46.436874 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 589/1177] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jun 3 13:04:46 2022] POST /identity/v3/users => generated 311 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:04:48.698404 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e4e80-7f95-4a24-9fbe-d8d0109dff42 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:48.698979 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e4e80-7f95-4a24-9fbe-d8d0109dff42 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:48.698979 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e4e80-7f95-4a24-9fbe-d8d0109dff42 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:48.701377 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 589/1178] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:04:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:04:48.706527 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85981daa-787a-42e0-a7f9-16d41ede5f82 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:48.706960 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85981daa-787a-42e0-a7f9-16d41ede5f82 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:48.707092 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85981daa-787a-42e0-a7f9-16d41ede5f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:48.724384 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-85981daa-787a-42e0-a7f9-16d41ede5f82 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:48.725564 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-85981daa-787a-42e0-a7f9-16d41ede5f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:48.784770 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:48.790048 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 590/1179] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:04:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:04:48.813292 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e4e80-7f95-4a24-9fbe-d8d0109dff42 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:48.915457 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e4e80-7f95-4a24-9fbe-d8d0109dff42 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:48.948222 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0635f55-7d95-497f-bbec-3d7dfae7d44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:48.949056 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0635f55-7d95-497f-bbec-3d7dfae7d44e None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:48.949285 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0635f55-7d95-497f-bbec-3d7dfae7d44e None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:48.949557 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0635f55-7d95-497f-bbec-3d7dfae7d44e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:48.960197 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0635f55-7d95-497f-bbec-3d7dfae7d44e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:04:48.968364 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-a0635f55-7d95-497f-bbec-3d7dfae7d44e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:04:48.968364 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:04:48.968364 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:04:48.968364 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:04:48.968364 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:04:48.968364 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:04:48.968364 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:04:48.968364 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:04:48.968364 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:04:48.968364 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:04:48.968364 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:04:48.968364 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:04:48.968364 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:04:48.968364 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:04:48.968364 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:04:48.968364 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:04:48.969516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:04:48.969516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:04:48.969516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:04:48.969516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:04:48.969516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:04:48.969516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:04:48.969516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:04:48.969516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:04:48.969516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:04:48.969516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:04:48.969516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:04:48.969516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:04:48.969516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:04:48.969516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:04:48.969516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:04:48.969516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:04:48.970430 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:04:48.970430 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:04:48.970430 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:04:48.970430 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:04:48.970430 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:04:48.970430 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:04:48.970430 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:04:48.970430 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:04:48.970430 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:04:48.970430 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:04:48.970430 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:04:48.970430 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:04:48.970430 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 590/1180] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 13:04:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:04:48.975794 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85981daa-787a-42e0-a7f9-16d41ede5f82 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:49.070655 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85981daa-787a-42e0-a7f9-16d41ede5f82 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:49.103838 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f0b2a-8cbb-40bb-9150-0beac08367da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:49.104520 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f0b2a-8cbb-40bb-9150-0beac08367da None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:49.104807 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f0b2a-8cbb-40bb-9150-0beac08367da None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:49.105082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f0b2a-8cbb-40bb-9150-0beac08367da None admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:49.105812 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f0b2a-8cbb-40bb-9150-0beac08367da None admin] RBAC: Adding query filter params (name=admin) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:04:49.106326 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f0b2a-8cbb-40bb-9150-0beac08367da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:49.107703 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f0b2a-8cbb-40bb-9150-0beac08367da None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:49.115500 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 591/1181] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:04:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:49.121260 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0635f55-7d95-497f-bbec-3d7dfae7d44e None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:49.141253 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:49.219467 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0635f55-7d95-497f-bbec-3d7dfae7d44e None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:49.251656 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3fe462-1580-48c8-9b3c-560219d3e015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:49.252534 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fe462-1580-48c8-9b3c-560219d3e015 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:49.252817 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fe462-1580-48c8-9b3c-560219d3e015 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:49.253091 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fe462-1580-48c8-9b3c-560219d3e015 None admin] PATH_INFO: `/v3/users/090ee83796194c95abffa22aeede9328` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:49.266192 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3fe462-1580-48c8-9b3c-560219d3e015 None admin] RBAC: Authorizing `identity:get_user(user_id=090ee83796194c95abffa22aeede9328)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:49.267623 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3fe462-1580-48c8-9b3c-560219d3e015 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:49.269284 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 591/1182] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 13:04:49 2022] GET /identity/v3/users/090ee83796194c95abffa22aeede9328 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:49.274954 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f0b2a-8cbb-40bb-9150-0beac08367da None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:49.332383 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:49.371016 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f0b2a-8cbb-40bb-9150-0beac08367da None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:49.403352 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72876357-17ff-4b3f-8e42-82b7d01dce2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:49.403977 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72876357-17ff-4b3f-8e42-82b7d01dce2e None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:49.404288 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72876357-17ff-4b3f-8e42-82b7d01dce2e None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:49.404564 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72876357-17ff-4b3f-8e42-82b7d01dce2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:49.469022 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72876357-17ff-4b3f-8e42-82b7d01dce2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:49.470508 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72876357-17ff-4b3f-8e42-82b7d01dce2e None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:49.524789 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:49.563881 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 592/1183] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:04:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 13:04:49.570153 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3fe462-1580-48c8-9b3c-560219d3e015 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:49.645238 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:49.666763 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3fe462-1580-48c8-9b3c-560219d3e015 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:49.698861 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0e89e-cf1c-47be-8a4b-30473b49fad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:49.699706 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0e89e-cf1c-47be-8a4b-30473b49fad0 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:49.700556 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0e89e-cf1c-47be-8a4b-30473b49fad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:49.700829 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0e89e-cf1c-47be-8a4b-30473b49fad0 None admin] PATH_INFO: `/v3/projects/dd43a47eafc642b8b9e63e29d92f8a8e` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:49.701980 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b0e89e-cf1c-47be-8a4b-30473b49fad0 None admin] RBAC: Authorizing `identity:get_project(project_id=dd43a47eafc642b8b9e63e29d92f8a8e)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:49.703381 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b0e89e-cf1c-47be-8a4b-30473b49fad0 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:49.705070 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 592/1184] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:04:49 2022] GET /identity/v3/projects/dd43a47eafc642b8b9e63e29d92f8a8e => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:49.711118 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72876357-17ff-4b3f-8e42-82b7d01dce2e None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:49.806794 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72876357-17ff-4b3f-8e42-82b7d01dce2e None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:49.839825 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a747116-4b4c-45cd-a9ae-82bb94d5325f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:49.841011 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a747116-4b4c-45cd-a9ae-82bb94d5325f None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:49.841298 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a747116-4b4c-45cd-a9ae-82bb94d5325f None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:49.841656 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a747116-4b4c-45cd-a9ae-82bb94d5325f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:49.842478 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a747116-4b4c-45cd-a9ae-82bb94d5325f None admin] RBAC: Adding query filter params (role.id=bbd5f3e0c18e4992886fcfb4a3feb426, scope.project.id=dd43a47eafc642b8b9e63e29d92f8a8e, user.id=090ee83796194c95abffa22aeede9328) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:04:49.842788 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a747116-4b4c-45cd-a9ae-82bb94d5325f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:49.844237 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a747116-4b4c-45cd-a9ae-82bb94d5325f None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:49.849789 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 593/1185] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 13:04:49 2022] GET /identity/v3/role_assignments?user.id=090ee83796194c95abffa22aeede9328&scope.project.id=dd43a47eafc642b8b9e63e29d92f8a8e&role.id=bbd5f3e0c18e4992886fcfb4a3feb426 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:52.051169 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f4119-d1df-405c-b993-04691f4d373c None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:52.051664 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f4119-d1df-405c-b993-04691f4d373c None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:52.051756 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f4119-d1df-405c-b993-04691f4d373c None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:52.053128 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 593/1186] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:04:52.058298 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83c47c-bc8f-436f-8724-27275f323bed None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:52.058726 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83c47c-bc8f-436f-8724-27275f323bed None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:52.058847 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83c47c-bc8f-436f-8724-27275f323bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:52.076555 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-de83c47c-bc8f-436f-8724-27275f323bed None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:52.077716 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-de83c47c-bc8f-436f-8724-27275f323bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:52.094417 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:52.142716 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 594/1187] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:04:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:04:52.164937 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f4119-d1df-405c-b993-04691f4d373c None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:52.263540 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f4119-d1df-405c-b993-04691f4d373c None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:52.296058 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae430c0a-4b5e-413e-a77f-5fc1bb43e0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:52.296863 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae430c0a-4b5e-413e-a77f-5fc1bb43e0b4 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:52.297132 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae430c0a-4b5e-413e-a77f-5fc1bb43e0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:52.297401 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae430c0a-4b5e-413e-a77f-5fc1bb43e0b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:52.307178 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae430c0a-4b5e-413e-a77f-5fc1bb43e0b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:04:52.315389 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-ae430c0a-4b5e-413e-a77f-5fc1bb43e0b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:04:52.315389 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:04:52.315389 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:04:52.315389 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:04:52.315389 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:04:52.315389 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:04:52.315389 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:04:52.315389 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:04:52.315389 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:04:52.315389 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:04:52.315389 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:04:52.315389 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:04:52.315389 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:04:52.315389 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:04:52.315389 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:04:52.315389 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:04:52.316518 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:04:52.316518 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:04:52.316518 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:04:52.316518 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:04:52.316518 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:04:52.316518 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:04:52.316518 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:04:52.316518 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:04:52.316518 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:04:52.316518 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:04:52.316518 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:04:52.316518 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:04:52.316518 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:04:52.316518 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:04:52.316518 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:04:52.316518 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:04:52.317565 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:04:52.317565 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:04:52.317565 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:04:52.317565 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:04:52.317565 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:04:52.317565 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:04:52.317565 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:04:52.317565 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:04:52.317565 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:04:52.317565 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:04:52.317565 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:04:52.317565 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:04:52.317565 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 594/1188] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 13:04:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:04:52.322604 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83c47c-bc8f-436f-8724-27275f323bed None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:52.420671 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83c47c-bc8f-436f-8724-27275f323bed None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:52.453815 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930f16e-09c3-4add-9ae5-9ef75a07d46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:52.454468 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930f16e-09c3-4add-9ae5-9ef75a07d46d None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:52.454753 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930f16e-09c3-4add-9ae5-9ef75a07d46d None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:52.455034 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930f16e-09c3-4add-9ae5-9ef75a07d46d None admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:52.455774 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c930f16e-09c3-4add-9ae5-9ef75a07d46d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:04:52.456082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c930f16e-09c3-4add-9ae5-9ef75a07d46d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:52.457472 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c930f16e-09c3-4add-9ae5-9ef75a07d46d None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:52.465255 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 595/1189] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:04:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:52.471084 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae430c0a-4b5e-413e-a77f-5fc1bb43e0b4 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:52.475066 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:52.569067 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae430c0a-4b5e-413e-a77f-5fc1bb43e0b4 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:52.600658 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83255672-8fbe-41fa-8b0e-ac0e73cfa298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:52.601511 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83255672-8fbe-41fa-8b0e-ac0e73cfa298 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:52.601790 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83255672-8fbe-41fa-8b0e-ac0e73cfa298 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:52.602057 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83255672-8fbe-41fa-8b0e-ac0e73cfa298 None admin] PATH_INFO: `/v3/users/090ee83796194c95abffa22aeede9328` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:52.603217 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83255672-8fbe-41fa-8b0e-ac0e73cfa298 None admin] RBAC: Authorizing `identity:get_user(user_id=090ee83796194c95abffa22aeede9328)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:52.604654 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83255672-8fbe-41fa-8b0e-ac0e73cfa298 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:52.606745 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 595/1190] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 13:04:52 2022] GET /identity/v3/users/090ee83796194c95abffa22aeede9328 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:52.612458 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930f16e-09c3-4add-9ae5-9ef75a07d46d None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:52.631003 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:52.710094 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930f16e-09c3-4add-9ae5-9ef75a07d46d None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:52.743177 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487bc9cb-0b14-434e-808d-f145951df91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:52.744015 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487bc9cb-0b14-434e-808d-f145951df91d None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:52.744326 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487bc9cb-0b14-434e-808d-f145951df91d None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:52.744602 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487bc9cb-0b14-434e-808d-f145951df91d None admin] PATH_INFO: `/v3/projects/dd43a47eafc642b8b9e63e29d92f8a8e` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:52.745770 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487bc9cb-0b14-434e-808d-f145951df91d None admin] RBAC: Authorizing `identity:get_project(project_id=dd43a47eafc642b8b9e63e29d92f8a8e)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:52.747919 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487bc9cb-0b14-434e-808d-f145951df91d None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:52.749620 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 596/1191] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:04:52 2022] GET /identity/v3/projects/dd43a47eafc642b8b9e63e29d92f8a8e => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:52.755540 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83255672-8fbe-41fa-8b0e-ac0e73cfa298 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:52.824408 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:52.852616 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83255672-8fbe-41fa-8b0e-ac0e73cfa298 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:52.885167 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2014b9-ce54-4bed-b84a-b2f1d9e1aa9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:52.886036 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2014b9-ce54-4bed-b84a-b2f1d9e1aa9a None admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:52.886317 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2014b9-ce54-4bed-b84a-b2f1d9e1aa9a None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:52.886593 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2014b9-ce54-4bed-b84a-b2f1d9e1aa9a None admin] PATH_INFO: `/v3/projects/dd43a47eafc642b8b9e63e29d92f8a8e/users/090ee83796194c95abffa22aeede9328/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:52.888687 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2014b9-ce54-4bed-b84a-b2f1d9e1aa9a None admin] RBAC: Authorizing `identity:create_grant(project_id=dd43a47eafc642b8b9e63e29d92f8a8e, user_id=090ee83796194c95abffa22aeede9328, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:52.890096 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2014b9-ce54-4bed-b84a-b2f1d9e1aa9a None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:52.960674 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 596/1192] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jun 3 13:04:52 2022] PUT /identity/v3/projects/dd43a47eafc642b8b9e63e29d92f8a8e/users/090ee83796194c95abffa22aeede9328/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:04:55.177868 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910f36b-dbda-4734-a860-128a447c0f48 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:55.178401 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910f36b-dbda-4734-a860-128a447c0f48 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:55.178401 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910f36b-dbda-4734-a860-128a447c0f48 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:55.179763 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 597/1193] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:04:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:04:55.185119 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c20345-16f7-4e41-ba8a-bbac4fd34ca8 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:55.185531 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c20345-16f7-4e41-ba8a-bbac4fd34ca8 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:55.185672 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c20345-16f7-4e41-ba8a-bbac4fd34ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:55.202699 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-b5c20345-16f7-4e41-ba8a-bbac4fd34ca8 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:04:55.203890 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-b5c20345-16f7-4e41-ba8a-bbac4fd34ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:04:55.269030 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 597/1194] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:04:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:04:55.292539 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910f36b-dbda-4734-a860-128a447c0f48 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:55.378188 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:55.394359 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910f36b-dbda-4734-a860-128a447c0f48 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:55.426688 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ad6ed-8771-4b36-9616-34dfc733cdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:55.427457 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ad6ed-8771-4b36-9616-34dfc733cdf3 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:55.427733 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ad6ed-8771-4b36-9616-34dfc733cdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:55.428000 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ad6ed-8771-4b36-9616-34dfc733cdf3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:55.438336 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ad6ed-8771-4b36-9616-34dfc733cdf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:04:55.445784 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-e00ad6ed-8771-4b36-9616-34dfc733cdf3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:04:55.445784 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:04:55.445784 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:04:55.445784 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:04:55.445784 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:04:55.445784 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:04:55.445784 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:04:55.445784 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:04:55.445784 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:04:55.445784 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:04:55.445784 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:04:55.445784 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:04:55.445784 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:04:55.445784 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:04:55.445784 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:04:55.445784 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:04:55.446708 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:04:55.446708 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:04:55.446708 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:04:55.446708 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:04:55.446708 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:04:55.446708 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:04:55.446708 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:04:55.446708 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:04:55.446708 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:04:55.446708 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:04:55.446708 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:04:55.446708 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:04:55.446708 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:04:55.446708 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:04:55.446708 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:04:55.446708 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:04:55.447747 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:04:55.447747 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:04:55.447747 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:04:55.447747 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:04:55.447747 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:04:55.447747 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:04:55.447747 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:04:55.447747 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:04:55.447747 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:04:55.447747 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:04:55.447747 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:04:55.447747 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:04:55.447747 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 598/1195] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 13:04:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:04:55.453306 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c20345-16f7-4e41-ba8a-bbac4fd34ca8 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:55.513164 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:55.550681 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c20345-16f7-4e41-ba8a-bbac4fd34ca8 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:55.584325 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f430c-78a0-4da9-b13b-5601192a3de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:55.584990 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f430c-78a0-4da9-b13b-5601192a3de8 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:55.585274 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f430c-78a0-4da9-b13b-5601192a3de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:55.585548 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f430c-78a0-4da9-b13b-5601192a3de8 None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:55.586283 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f430c-78a0-4da9-b13b-5601192a3de8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:04:55.586588 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f430c-78a0-4da9-b13b-5601192a3de8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:55.587943 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f430c-78a0-4da9-b13b-5601192a3de8 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:55.596163 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 598/1196] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:04:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:55.602117 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ad6ed-8771-4b36-9616-34dfc733cdf3 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:55.698793 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ad6ed-8771-4b36-9616-34dfc733cdf3 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:55.730273 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea96637-ee2e-46c0-a73b-fe4b87dca50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:55.731651 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea96637-ee2e-46c0-a73b-fe4b87dca50b None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:55.731921 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea96637-ee2e-46c0-a73b-fe4b87dca50b None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:55.732215 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea96637-ee2e-46c0-a73b-fe4b87dca50b None admin] PATH_INFO: `/v3/users/090ee83796194c95abffa22aeede9328` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:55.733371 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea96637-ee2e-46c0-a73b-fe4b87dca50b None admin] RBAC: Authorizing `identity:get_user(user_id=090ee83796194c95abffa22aeede9328)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:55.734791 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea96637-ee2e-46c0-a73b-fe4b87dca50b None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:55.736395 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 599/1197] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jun 3 13:04:55 2022] GET /identity/v3/users/090ee83796194c95abffa22aeede9328 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:55.742028 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f430c-78a0-4da9-b13b-5601192a3de8 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:55.838049 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f430c-78a0-4da9-b13b-5601192a3de8 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:55.860784 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:55.870956 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4608ff-abc1-4e44-8231-fd79a56051b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:55.871611 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4608ff-abc1-4e44-8231-fd79a56051b7 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:55.874232 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4608ff-abc1-4e44-8231-fd79a56051b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:55.874232 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4608ff-abc1-4e44-8231-fd79a56051b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:55.937257 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4608ff-abc1-4e44-8231-fd79a56051b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:55.938680 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4608ff-abc1-4e44-8231-fd79a56051b7 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:56.036207 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 599/1198] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:04:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 13:04:56.042064 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea96637-ee2e-46c0-a73b-fe4b87dca50b None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:56.057559 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:56.141607 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea96637-ee2e-46c0-a73b-fe4b87dca50b None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:56.174871 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bac401-fe47-4e4c-9306-fa4e5806c0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:56.175729 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bac401-fe47-4e4c-9306-fa4e5806c0a5 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:56.176012 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bac401-fe47-4e4c-9306-fa4e5806c0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:56.176339 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bac401-fe47-4e4c-9306-fa4e5806c0a5 None admin] PATH_INFO: `/v3/projects/dd43a47eafc642b8b9e63e29d92f8a8e` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:56.177508 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bac401-fe47-4e4c-9306-fa4e5806c0a5 None admin] RBAC: Authorizing `identity:get_project(project_id=dd43a47eafc642b8b9e63e29d92f8a8e)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:56.178973 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bac401-fe47-4e4c-9306-fa4e5806c0a5 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:56.180707 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 600/1199] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jun 3 13:04:56 2022] GET /identity/v3/projects/dd43a47eafc642b8b9e63e29d92f8a8e => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:04:56.186850 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4608ff-abc1-4e44-8231-fd79a56051b7 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:04:56.211091 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:56.283353 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4608ff-abc1-4e44-8231-fd79a56051b7 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:04:56.319222 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226dc67-0f41-4f28-9cc6-6c785c24954a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:04:56.319862 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226dc67-0f41-4f28-9cc6-6c785c24954a None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:04:56.320174 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226dc67-0f41-4f28-9cc6-6c785c24954a None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:04:56.320455 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226dc67-0f41-4f28-9cc6-6c785c24954a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:04:56.321268 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8226dc67-0f41-4f28-9cc6-6c785c24954a None admin] RBAC: Adding query filter params (role.id=bbd5f3e0c18e4992886fcfb4a3feb426, scope.project.id=dd43a47eafc642b8b9e63e29d92f8a8e, user.id=090ee83796194c95abffa22aeede9328) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:04:56.321576 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8226dc67-0f41-4f28-9cc6-6c785c24954a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:04:56.322999 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8226dc67-0f41-4f28-9cc6-6c785c24954a None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:04:56.330020 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 600/1200] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 13:04:56 2022] GET /identity/v3/role_assignments?user.id=090ee83796194c95abffa22aeede9328&scope.project.id=dd43a47eafc642b8b9e63e29d92f8a8e&role.id=bbd5f3e0c18e4992886fcfb4a3feb426 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:05:06.170745 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=60 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:05:06.327021 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=56 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:15.769722 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ed795-f111-4d10-91c6-25fa76e915cd None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:15.770313 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ed795-f111-4d10-91c6-25fa76e915cd None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:15.770313 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ed795-f111-4d10-91c6-25fa76e915cd None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:15.771616 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 601/1201] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:06:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:06:15.776787 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982457c-e96f-44ad-81c5-6386e00cb658 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:15.777216 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982457c-e96f-44ad-81c5-6386e00cb658 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:15.777320 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982457c-e96f-44ad-81c5-6386e00cb658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:15.793732 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-3982457c-e96f-44ad-81c5-6386e00cb658 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:06:15.795426 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-3982457c-e96f-44ad-81c5-6386e00cb658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:06:15.859868 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 601/1202] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:06:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:06:15.884515 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ed795-f111-4d10-91c6-25fa76e915cd None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:15.985444 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ed795-f111-4d10-91c6-25fa76e915cd None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:16.020038 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527e278-15a3-4279-be48-80c91db91e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:16.020805 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527e278-15a3-4279-be48-80c91db91e94 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:16.021091 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527e278-15a3-4279-be48-80c91db91e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:16.021366 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527e278-15a3-4279-be48-80c91db91e94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:16.031353 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4527e278-15a3-4279-be48-80c91db91e94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:16.035540 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4527e278-15a3-4279-be48-80c91db91e94 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:16.049739 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-4527e278-15a3-4279-be48-80c91db91e94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:06:16.049739 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:06:16.049739 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:06:16.049739 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:06:16.049739 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:06:16.049739 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:06:16.049739 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:06:16.049739 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:06:16.049739 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:06:16.049739 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:06:16.049739 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:06:16.049739 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:06:16.049739 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:06:16.049739 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:06:16.049739 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:06:16.050881 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:06:16.050881 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:06:16.050881 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:06:16.050881 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:06:16.050881 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:06:16.050881 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:06:16.050881 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:06:16.050881 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:06:16.050881 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:06:16.050881 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:06:16.050881 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:06:16.050881 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:06:16.050881 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:06:16.050881 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:06:16.050881 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:06:16.050881 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:06:16.050881 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:06:16.051983 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:06:16.051983 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:06:16.051983 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:06:16.051983 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:06:16.051983 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 602/1203] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:06:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:06:16.056952 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3982457c-e96f-44ad-81c5-6386e00cb658 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:16.154332 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3982457c-e96f-44ad-81c5-6386e00cb658 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:16.182188 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:16.188680 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f273ca0-32c8-4c41-8f45-fa003331fe1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:16.189336 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f273ca0-32c8-4c41-8f45-fa003331fe1f None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:16.189616 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f273ca0-32c8-4c41-8f45-fa003331fe1f None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:16.189891 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f273ca0-32c8-4c41-8f45-fa003331fe1f None admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:16.190593 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f273ca0-32c8-4c41-8f45-fa003331fe1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:06:16.190893 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f273ca0-32c8-4c41-8f45-fa003331fe1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:16.192284 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f273ca0-32c8-4c41-8f45-fa003331fe1f None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:16.203689 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 602/1204] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:06:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:06:16.209395 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527e278-15a3-4279-be48-80c91db91e94 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:16.261793 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:16.307922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527e278-15a3-4279-be48-80c91db91e94 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:16.340697 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23684d2-c354-46ec-8348-f59687bcf28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:16.341460 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23684d2-c354-46ec-8348-f59687bcf28b None admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:16.341741 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23684d2-c354-46ec-8348-f59687bcf28b None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:16.342015 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23684d2-c354-46ec-8348-f59687bcf28b None admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:16.342716 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23684d2-c354-46ec-8348-f59687bcf28b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:16.344138 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23684d2-c354-46ec-8348-f59687bcf28b None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:16.440177 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 603/1205] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jun 3 13:06:16 2022] POST /identity/v3/users => generated 251 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:06:18.689063 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400535d2-1071-4508-afb0-01ee4690f1e0 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:18.689682 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400535d2-1071-4508-afb0-01ee4690f1e0 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:18.689682 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400535d2-1071-4508-afb0-01ee4690f1e0 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:18.691016 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 603/1206] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:06:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:06:18.696374 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01defd-365d-41c1-8f59-ed0a87b9aafa None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:18.701394 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01defd-365d-41c1-8f59-ed0a87b9aafa None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:18.701394 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01defd-365d-41c1-8f59-ed0a87b9aafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:18.714707 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-3f01defd-365d-41c1-8f59-ed0a87b9aafa None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:06:18.724655 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-3f01defd-365d-41c1-8f59-ed0a87b9aafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:06:18.782187 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 604/1207] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:06:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:06:18.806361 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400535d2-1071-4508-afb0-01ee4690f1e0 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:18.907525 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400535d2-1071-4508-afb0-01ee4690f1e0 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:18.941803 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0145f-25de-4bae-8965-5a04f36be81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:18.942533 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0145f-25de-4bae-8965-5a04f36be81d None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:18.942817 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0145f-25de-4bae-8965-5a04f36be81d None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:18.943096 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0145f-25de-4bae-8965-5a04f36be81d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:18.953736 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e0145f-25de-4bae-8965-5a04f36be81d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:06:18.961525 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-06e0145f-25de-4bae-8965-5a04f36be81d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 13:06:18.961525 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:06:18.961525 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:06:18.961525 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:06:18.961525 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:06:18.961525 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:06:18.961525 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:06:18.961525 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:06:18.961525 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:06:18.961525 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:06:18.961525 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:06:18.961525 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:06:18.961525 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:06:18.961525 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:06:18.961525 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:06:18.961525 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:06:18.962683 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:06:18.962683 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:06:18.962683 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:06:18.962683 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:06:18.962683 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:06:18.962683 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:06:18.962683 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:06:18.962683 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:06:18.962683 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:06:18.962683 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:06:18.962683 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:06:18.962683 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:06:18.962683 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:06:18.962683 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:06:18.962683 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:06:18.962683 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:06:18.963737 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:06:18.963737 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:06:18.963737 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:06:18.963737 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:06:18.963737 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:06:18.963737 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:06:18.963737 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:06:18.963737 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:06:18.963737 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:06:18.963737 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:06:18.963737 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 13:06:18.963737 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:06:18.963737 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 604/1208] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jun 3 13:06:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:06:18.969807 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01defd-365d-41c1-8f59-ed0a87b9aafa None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:19.011792 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:19.079823 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01defd-365d-41c1-8f59-ed0a87b9aafa None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:19.117355 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af18b190-5795-4806-9262-94e2e86536fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:19.118017 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18b190-5795-4806-9262-94e2e86536fc None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:19.118297 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18b190-5795-4806-9262-94e2e86536fc None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:19.118570 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18b190-5795-4806-9262-94e2e86536fc None admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:19.119306 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af18b190-5795-4806-9262-94e2e86536fc None admin] RBAC: Adding query filter params (name=service) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:06:19.119609 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af18b190-5795-4806-9262-94e2e86536fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:19.121002 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af18b190-5795-4806-9262-94e2e86536fc None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:19.129086 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 605/1209] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jun 3 13:06:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:06:19.134959 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0145f-25de-4bae-8965-5a04f36be81d None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:19.187151 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:19.235265 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0145f-25de-4bae-8965-5a04f36be81d None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:19.267081 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8bb71-6460-4d29-9331-c3a923215eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:19.267849 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8bb71-6460-4d29-9331-c3a923215eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:19.268126 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8bb71-6460-4d29-9331-c3a923215eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:19.268426 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8bb71-6460-4d29-9331-c3a923215eb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:19.277954 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a8bb71-6460-4d29-9331-c3a923215eb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:19.280015 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a8bb71-6460-4d29-9331-c3a923215eb2 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:19.297468 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-09a8bb71-6460-4d29-9331-c3a923215eb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:06:19.297468 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:06:19.297468 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:06:19.297468 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:06:19.297468 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:06:19.297468 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:06:19.297468 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:06:19.297468 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:06:19.297468 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:06:19.297468 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:06:19.297468 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:06:19.297468 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:06:19.297468 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:06:19.297468 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:06:19.297468 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:06:19.298480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:06:19.298480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:06:19.298480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:06:19.298480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:06:19.298480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:06:19.298480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:06:19.298480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:06:19.298480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:06:19.298480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:06:19.298480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:06:19.298480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:06:19.298480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:06:19.298480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:06:19.298480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:06:19.298480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:06:19.298480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:06:19.298480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:06:19.299391 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:06:19.299391 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:06:19.299391 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:06:19.299391 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:06:19.301078 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 605/1210] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:06:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:06:19.304572 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af18b190-5795-4806-9262-94e2e86536fc None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:19.402627 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:19.406305 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af18b190-5795-4806-9262-94e2e86536fc None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:19.438685 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eba3b8-3301-4736-94e7-dc81162a4f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:19.439335 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eba3b8-3301-4736-94e7-dc81162a4f1e None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:19.439619 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eba3b8-3301-4736-94e7-dc81162a4f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:19.439895 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eba3b8-3301-4736-94e7-dc81162a4f1e None admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:19.440757 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eba3b8-3301-4736-94e7-dc81162a4f1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:06:19.441059 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eba3b8-3301-4736-94e7-dc81162a4f1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:19.442428 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eba3b8-3301-4736-94e7-dc81162a4f1e None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:19.453780 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 606/1211] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:06:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:06:19.459626 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8bb71-6460-4d29-9331-c3a923215eb2 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:19.559543 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8bb71-6460-4d29-9331-c3a923215eb2 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:19.561138 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:19.594129 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f719d3-d2f0-4940-a44e-9961d930d7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:19.594919 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f719d3-d2f0-4940-a44e-9961d930d7d0 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:19.595198 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f719d3-d2f0-4940-a44e-9961d930d7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:19.595468 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f719d3-d2f0-4940-a44e-9961d930d7d0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:19.602592 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f719d3-d2f0-4940-a44e-9961d930d7d0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:19.608874 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f719d3-d2f0-4940-a44e-9961d930d7d0 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:19.618488 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-f0f719d3-d2f0-4940-a44e-9961d930d7d0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 03 13:06:19.618488 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:06:19.618488 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:06:19.618488 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:06:19.618488 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:06:19.618488 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:06:19.618488 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:06:19.618488 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:06:19.618488 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:06:19.618488 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:06:19.618488 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:06:19.618488 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:06:19.618488 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 13:06:19.618488 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 13:06:19.618488 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 13:06:19.618488 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 13:06:19.619604 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:06:19.619604 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:06:19.619604 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 13:06:19.619604 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:06:19.619604 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 13:06:19.619604 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:06:19.619604 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:06:19.619604 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:06:19.619604 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:06:19.619604 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:06:19.619604 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:06:19.619604 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:06:19.619604 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:06:19.619604 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:06:19.619604 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:06:19.619604 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:06:19.619604 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:06:19.619604 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:06:19.620962 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:06:19.620962 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:06:19.620962 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 13:06:19.620962 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 13:06:19.620962 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 13:06:19.620962 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 13:06:19.620962 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 13:06:19.620962 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 13:06:19.620962 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 03 13:06:19.620962 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:06:19.620962 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 606/1212] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:06:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:06:19.625734 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eba3b8-3301-4736-94e7-dc81162a4f1e None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:19.727538 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eba3b8-3301-4736-94e7-dc81162a4f1e None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:19.760778 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d047cf95-3b72-448e-9c30-20ec370c64f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:19.761499 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047cf95-3b72-448e-9c30-20ec370c64f8 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:19.761778 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047cf95-3b72-448e-9c30-20ec370c64f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:19.762051 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047cf95-3b72-448e-9c30-20ec370c64f8 None admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:19.763445 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d047cf95-3b72-448e-9c30-20ec370c64f8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:06:19.763780 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d047cf95-3b72-448e-9c30-20ec370c64f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:19.765410 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d047cf95-3b72-448e-9c30-20ec370c64f8 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:19.782549 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 607/1213] 10.222.0.61 () {56 vars in 1143 bytes} [Fri Jun 3 13:06:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:06:19.788498 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f719d3-d2f0-4940-a44e-9961d930d7d0 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:19.885285 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f719d3-d2f0-4940-a44e-9961d930d7d0 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:19.918434 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a62859-71c1-4615-92d8-a4ffb8457c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:19.919120 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a62859-71c1-4615-92d8-a4ffb8457c0a None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:19.919500 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a62859-71c1-4615-92d8-a4ffb8457c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:19.919778 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a62859-71c1-4615-92d8-a4ffb8457c0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:19.948695 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:19.984818 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a62859-71c1-4615-92d8-a4ffb8457c0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:19.986269 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a62859-71c1-4615-92d8-a4ffb8457c0a None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:20.082165 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 607/1214] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:06:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 13:06:20.088064 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d047cf95-3b72-448e-9c30-20ec370c64f8 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:20.107931 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:20.186968 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d047cf95-3b72-448e-9c30-20ec370c64f8 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:20.220763 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c495d-fd74-4f23-afb8-26f022b962d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:20.221718 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c495d-fd74-4f23-afb8-26f022b962d8 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:20.221997 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c495d-fd74-4f23-afb8-26f022b962d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:20.222267 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c495d-fd74-4f23-afb8-26f022b962d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:20.238632 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c495d-fd74-4f23-afb8-26f022b962d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:20.240292 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c495d-fd74-4f23-afb8-26f022b962d8 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:20.258624 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-d67c495d-fd74-4f23-afb8-26f022b962d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:06:20.258624 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:06:20.258624 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:06:20.258624 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:06:20.258624 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:06:20.258624 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:06:20.258624 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:06:20.258624 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:06:20.258624 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:06:20.258624 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:06:20.258624 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:06:20.258624 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:06:20.258624 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:06:20.258624 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:06:20.258624 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:06:20.259712 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:06:20.259712 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:06:20.259712 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:06:20.259712 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:06:20.259712 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:06:20.259712 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:06:20.259712 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:06:20.259712 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:06:20.259712 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:06:20.259712 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:06:20.259712 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:06:20.259712 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:06:20.259712 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:06:20.259712 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:06:20.259712 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:06:20.259712 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:06:20.259712 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:06:20.260796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:06:20.260796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:06:20.260796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:06:20.260796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:06:20.260796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 608/1215] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:06:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:06:20.265853 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a62859-71c1-4615-92d8-a4ffb8457c0a None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:20.326563 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:20.363342 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a62859-71c1-4615-92d8-a4ffb8457c0a None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:20.395544 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aded85-a37d-4dc9-9029-c0188d3e797f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:20.396494 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aded85-a37d-4dc9-9029-c0188d3e797f None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:20.396957 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aded85-a37d-4dc9-9029-c0188d3e797f None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:20.397697 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aded85-a37d-4dc9-9029-c0188d3e797f None admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:20.398456 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aded85-a37d-4dc9-9029-c0188d3e797f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:06:20.398794 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aded85-a37d-4dc9-9029-c0188d3e797f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:20.400251 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aded85-a37d-4dc9-9029-c0188d3e797f None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:20.412594 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 608/1216] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:06:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:06:20.418284 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c495d-fd74-4f23-afb8-26f022b962d8 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:20.488446 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:20.517730 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c495d-fd74-4f23-afb8-26f022b962d8 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:20.551570 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5299b-f889-4a3d-a303-b7060bd9add5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:20.552383 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5299b-f889-4a3d-a303-b7060bd9add5 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:20.552673 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5299b-f889-4a3d-a303-b7060bd9add5 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:20.552950 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5299b-f889-4a3d-a303-b7060bd9add5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:20.559408 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c5299b-f889-4a3d-a303-b7060bd9add5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:20.561185 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c5299b-f889-4a3d-a303-b7060bd9add5 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:20.576082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-10c5299b-f889-4a3d-a303-b7060bd9add5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:06:20.576082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:06:20.576082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:06:20.576082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:06:20.576082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:06:20.576082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:06:20.576082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:06:20.576082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:06:20.576082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:06:20.576082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:06:20.576082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:06:20.576082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:06:20.576082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 13:06:20.576082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 13:06:20.576082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 13:06:20.578998 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 13:06:20.578998 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:06:20.578998 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:06:20.578998 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:06:20.578998 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:06:20.578998 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:06:20.578998 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:06:20.578998 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:06:20.578998 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:06:20.578998 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:06:20.578998 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:06:20.578998 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:06:20.578998 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:06:20.578998 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:06:20.578998 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:06:20.578998 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:06:20.578998 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:06:20.580089 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 13:06:20.580089 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 13:06:20.580089 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 13:06:20.580089 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 13:06:20.580089 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 13:06:20.580089 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 13:06:20.580089 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:06:20.580089 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:06:20.580089 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 609/1217] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:06:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:06:20.583151 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aded85-a37d-4dc9-9029-c0188d3e797f None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:20.683599 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aded85-a37d-4dc9-9029-c0188d3e797f None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:20.705014 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:20.716757 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b7b95b-ae0f-44e2-b528-85e1c122cd86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:20.717409 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7b95b-ae0f-44e2-b528-85e1c122cd86 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:20.717691 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7b95b-ae0f-44e2-b528-85e1c122cd86 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:20.717960 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7b95b-ae0f-44e2-b528-85e1c122cd86 None admin] PATH_INFO: `/v3/projects` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:20.718725 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b7b95b-ae0f-44e2-b528-85e1c122cd86 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:06:20.719028 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b7b95b-ae0f-44e2-b528-85e1c122cd86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:20.720461 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b7b95b-ae0f-44e2-b528-85e1c122cd86 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:20.733042 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 609/1218] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 13:06:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:06:20.744308 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5299b-f889-4a3d-a303-b7060bd9add5 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:20.837134 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5299b-f889-4a3d-a303-b7060bd9add5 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:20.865716 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:20.871246 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e948a-d88a-460d-967b-e4ff281a5eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:20.871896 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e948a-d88a-460d-967b-e4ff281a5eb3 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:20.874375 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e948a-d88a-460d-967b-e4ff281a5eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:20.874375 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e948a-d88a-460d-967b-e4ff281a5eb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:20.874375 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07e948a-d88a-460d-967b-e4ff281a5eb3 None admin] RBAC: Adding query filter params (role.id=eb985092d5f14e92a783e26568bf457b, scope.project.id=c8c0bf799c9f451b8167a646a5c82eda, user.id=a5c4ad16c9454b74ae8445b115cf0af4) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:06:20.874375 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07e948a-d88a-460d-967b-e4ff281a5eb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:20.875162 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07e948a-d88a-460d-967b-e4ff281a5eb3 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:20.880453 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 610/1219] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 13:06:20 2022] GET /identity/v3/role_assignments?user.id=a5c4ad16c9454b74ae8445b115cf0af4&scope.project.id=c8c0bf799c9f451b8167a646a5c82eda&role.id=eb985092d5f14e92a783e26568bf457b => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:06:23.142924 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfdfced-d139-458e-a2bc-2854b4f2b22e None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:23.143456 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfdfced-d139-458e-a2bc-2854b4f2b22e None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:23.143456 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfdfced-d139-458e-a2bc-2854b4f2b22e None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:23.145037 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 610/1220] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:06:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:06:23.150184 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87e0dd-99e1-4433-943d-35279b9f1f1f None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:23.150585 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87e0dd-99e1-4433-943d-35279b9f1f1f None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:23.150746 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87e0dd-99e1-4433-943d-35279b9f1f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:23.168220 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-bb87e0dd-99e1-4433-943d-35279b9f1f1f None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:06:23.174708 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-bb87e0dd-99e1-4433-943d-35279b9f1f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:06:23.235085 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 611/1221] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:06:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:06:23.257727 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfdfced-d139-458e-a2bc-2854b4f2b22e None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:23.358036 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfdfced-d139-458e-a2bc-2854b4f2b22e None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:23.391362 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c32c7d-6bae-41dd-80c1-97aa2cb96d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:23.392167 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c32c7d-6bae-41dd-80c1-97aa2cb96d17 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:23.392584 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c32c7d-6bae-41dd-80c1-97aa2cb96d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:23.392853 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c32c7d-6bae-41dd-80c1-97aa2cb96d17 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:23.402654 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c32c7d-6bae-41dd-80c1-97aa2cb96d17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:06:23.410397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-a0c32c7d-6bae-41dd-80c1-97aa2cb96d17 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 13:06:23.410397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:06:23.410397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:06:23.410397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:06:23.410397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:06:23.410397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:06:23.410397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:06:23.410397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:06:23.410397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:06:23.410397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:06:23.410397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:06:23.410397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:06:23.410397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:06:23.410397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:06:23.410397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:06:23.410397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:06:23.411537 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:06:23.411537 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:06:23.411537 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:06:23.411537 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:06:23.411537 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:06:23.411537 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:06:23.411537 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:06:23.411537 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:06:23.411537 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:06:23.411537 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:06:23.411537 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:06:23.411537 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:06:23.411537 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:06:23.411537 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:06:23.411537 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:06:23.411537 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:06:23.412482 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:06:23.412482 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:06:23.412482 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:06:23.412482 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:06:23.412482 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:06:23.412482 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:06:23.412482 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:06:23.412482 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:06:23.412482 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:06:23.412482 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:06:23.412482 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 13:06:23.412482 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:06:23.412482 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 611/1222] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jun 3 13:06:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:06:23.417575 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb87e0dd-99e1-4433-943d-35279b9f1f1f None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:23.515767 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb87e0dd-99e1-4433-943d-35279b9f1f1f None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:23.538569 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:23.549950 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be23fbb-0b4c-40c8-ab03-5ec9e1e7c726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:23.550613 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be23fbb-0b4c-40c8-ab03-5ec9e1e7c726 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:23.550892 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be23fbb-0b4c-40c8-ab03-5ec9e1e7c726 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:23.551165 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be23fbb-0b4c-40c8-ab03-5ec9e1e7c726 None admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:23.551901 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be23fbb-0b4c-40c8-ab03-5ec9e1e7c726 None admin] RBAC: Adding query filter params (name=service) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:06:23.552236 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be23fbb-0b4c-40c8-ab03-5ec9e1e7c726 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:23.553630 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be23fbb-0b4c-40c8-ab03-5ec9e1e7c726 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:23.561694 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 612/1223] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jun 3 13:06:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:06:23.567460 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c32c7d-6bae-41dd-80c1-97aa2cb96d17 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:23.612468 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:23.665667 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c32c7d-6bae-41dd-80c1-97aa2cb96d17 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:23.698736 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa72037-1d35-4bdf-9ff5-79b91ad48d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:23.699521 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa72037-1d35-4bdf-9ff5-79b91ad48d98 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:23.699801 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa72037-1d35-4bdf-9ff5-79b91ad48d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:23.700073 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa72037-1d35-4bdf-9ff5-79b91ad48d98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:23.710271 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa72037-1d35-4bdf-9ff5-79b91ad48d98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:23.711710 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa72037-1d35-4bdf-9ff5-79b91ad48d98 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:23.728993 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-caa72037-1d35-4bdf-9ff5-79b91ad48d98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:06:23.728993 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:06:23.728993 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:06:23.728993 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:06:23.728993 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:06:23.728993 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:06:23.728993 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:06:23.728993 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:06:23.728993 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:06:23.728993 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:06:23.728993 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:06:23.728993 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:06:23.728993 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:06:23.728993 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:06:23.728993 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:06:23.729947 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:06:23.729947 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:06:23.729947 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:06:23.729947 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:06:23.729947 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:06:23.729947 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:06:23.729947 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:06:23.729947 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:06:23.729947 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:06:23.729947 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:06:23.729947 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:06:23.729947 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:06:23.729947 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:06:23.729947 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:06:23.729947 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:06:23.729947 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:06:23.729947 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:06:23.731140 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:06:23.731140 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:06:23.731140 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:06:23.731140 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:06:23.731140 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 612/1224] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:06:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:06:23.737605 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be23fbb-0b4c-40c8-ab03-5ec9e1e7c726 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:23.836072 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be23fbb-0b4c-40c8-ab03-5ec9e1e7c726 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:23.869038 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041410c-147b-4765-883b-bd1c15d0b0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:23.869691 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041410c-147b-4765-883b-bd1c15d0b0b1 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:23.869974 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041410c-147b-4765-883b-bd1c15d0b0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:23.870251 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041410c-147b-4765-883b-bd1c15d0b0b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:23.870965 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6041410c-147b-4765-883b-bd1c15d0b0b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:06:23.871274 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6041410c-147b-4765-883b-bd1c15d0b0b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:23.873118 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6041410c-147b-4765-883b-bd1c15d0b0b1 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:23.885649 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 613/1225] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:06:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:06:23.892103 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa72037-1d35-4bdf-9ff5-79b91ad48d98 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:23.986017 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:23.992575 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa72037-1d35-4bdf-9ff5-79b91ad48d98 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:24.025827 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e0d47-db15-42a2-bf76-161f0f1d209c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:24.026630 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e0d47-db15-42a2-bf76-161f0f1d209c None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:24.026897 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e0d47-db15-42a2-bf76-161f0f1d209c None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:24.027163 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e0d47-db15-42a2-bf76-161f0f1d209c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:24.035132 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85e0d47-db15-42a2-bf76-161f0f1d209c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:24.036619 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85e0d47-db15-42a2-bf76-161f0f1d209c None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:24.050638 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-e85e0d47-db15-42a2-bf76-161f0f1d209c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 03 13:06:24.050638 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:06:24.050638 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:06:24.050638 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:06:24.050638 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:06:24.050638 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:06:24.050638 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:06:24.050638 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:06:24.050638 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:06:24.050638 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:06:24.050638 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:06:24.050638 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:06:24.050638 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 13:06:24.050638 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 13:06:24.050638 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 13:06:24.050638 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 13:06:24.051862 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:06:24.051862 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:06:24.051862 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 13:06:24.051862 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:06:24.051862 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 13:06:24.051862 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:06:24.051862 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:06:24.051862 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:06:24.051862 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:06:24.051862 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:06:24.051862 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:06:24.051862 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:06:24.051862 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:06:24.051862 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:06:24.051862 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:06:24.051862 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:06:24.051862 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:06:24.051862 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:06:24.053360 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:06:24.053360 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:06:24.053360 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 13:06:24.053360 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 13:06:24.053360 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 13:06:24.053360 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 13:06:24.053360 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 13:06:24.053360 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 13:06:24.053360 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 03 13:06:24.053360 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:06:24.053360 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 613/1226] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:06:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:06:24.057588 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041410c-147b-4765-883b-bd1c15d0b0b1 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:24.104423 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:24.157363 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041410c-147b-4765-883b-bd1c15d0b0b1 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:24.189910 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a07624-b1d3-4c96-9caa-fea2302fb6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:24.190568 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a07624-b1d3-4c96-9caa-fea2302fb6af None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:24.190851 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a07624-b1d3-4c96-9caa-fea2302fb6af None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:24.191126 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a07624-b1d3-4c96-9caa-fea2302fb6af None admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:24.191943 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a07624-b1d3-4c96-9caa-fea2302fb6af None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:06:24.192280 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a07624-b1d3-4c96-9caa-fea2302fb6af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:24.193712 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a07624-b1d3-4c96-9caa-fea2302fb6af None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:24.210928 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 614/1227] 10.222.0.61 () {56 vars in 1143 bytes} [Fri Jun 3 13:06:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:06:24.216762 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e0d47-db15-42a2-bf76-161f0f1d209c None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:24.316387 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e0d47-db15-42a2-bf76-161f0f1d209c None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:24.350050 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63cb910-ae3c-417e-9cc8-6014f31f1d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:24.351195 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63cb910-ae3c-417e-9cc8-6014f31f1d46 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:24.351481 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63cb910-ae3c-417e-9cc8-6014f31f1d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:24.351753 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63cb910-ae3c-417e-9cc8-6014f31f1d46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:24.368066 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63cb910-ae3c-417e-9cc8-6014f31f1d46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:24.368066 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63cb910-ae3c-417e-9cc8-6014f31f1d46 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:24.384076 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-d63cb910-ae3c-417e-9cc8-6014f31f1d46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:06:24.384076 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:06:24.384076 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:06:24.384076 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:06:24.384076 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:06:24.384076 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:06:24.384076 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:06:24.384076 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:06:24.384076 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:06:24.384076 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:06:24.384076 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:06:24.384076 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:06:24.384076 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:06:24.384076 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:06:24.384076 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:06:24.385163 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:06:24.385163 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:06:24.385163 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:06:24.385163 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:06:24.385163 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:06:24.385163 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:06:24.385163 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:06:24.385163 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:06:24.385163 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:06:24.385163 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:06:24.385163 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:06:24.385163 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:06:24.385163 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:06:24.385163 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:06:24.385163 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:06:24.385163 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:06:24.385163 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:06:24.386326 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:06:24.386326 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:06:24.386326 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:06:24.386326 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:06:24.386326 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 614/1228] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:06:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:06:24.392022 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a07624-b1d3-4c96-9caa-fea2302fb6af None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:24.490829 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a07624-b1d3-4c96-9caa-fea2302fb6af None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:24.493116 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:24.524607 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1bb8e-f628-4bf5-b31b-4a0ebe4133c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:24.525262 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1bb8e-f628-4bf5-b31b-4a0ebe4133c6 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:24.525548 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1bb8e-f628-4bf5-b31b-4a0ebe4133c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:24.525827 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1bb8e-f628-4bf5-b31b-4a0ebe4133c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:24.526543 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb1bb8e-f628-4bf5-b31b-4a0ebe4133c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:06:24.526851 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb1bb8e-f628-4bf5-b31b-4a0ebe4133c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:24.528249 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb1bb8e-f628-4bf5-b31b-4a0ebe4133c6 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:24.540190 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 615/1229] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:06:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:06:24.546761 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63cb910-ae3c-417e-9cc8-6014f31f1d46 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:24.555804 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:24.647350 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63cb910-ae3c-417e-9cc8-6014f31f1d46 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:24.680047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d005aef-a4f5-4c07-ba54-f4921f6a9539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:24.680852 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d005aef-a4f5-4c07-ba54-f4921f6a9539 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:24.681133 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d005aef-a4f5-4c07-ba54-f4921f6a9539 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:24.681400 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d005aef-a4f5-4c07-ba54-f4921f6a9539 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:24.687968 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d005aef-a4f5-4c07-ba54-f4921f6a9539 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:24.689476 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d005aef-a4f5-4c07-ba54-f4921f6a9539 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:24.703778 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-8d005aef-a4f5-4c07-ba54-f4921f6a9539 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:06:24.703778 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:06:24.703778 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:06:24.703778 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:06:24.703778 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:06:24.703778 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:06:24.703778 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:06:24.703778 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:06:24.703778 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:06:24.703778 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:06:24.703778 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:06:24.703778 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:06:24.703778 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 13:06:24.703778 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 13:06:24.703778 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 13:06:24.708043 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 13:06:24.708043 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:06:24.708043 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:06:24.708043 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:06:24.708043 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:06:24.708043 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:06:24.708043 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:06:24.708043 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:06:24.708043 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:06:24.708043 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:06:24.708043 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:06:24.708043 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:06:24.708043 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:06:24.708043 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:06:24.708043 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:06:24.708043 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:06:24.708043 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:06:24.709181 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 13:06:24.709181 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 13:06:24.709181 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 13:06:24.709181 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 13:06:24.709181 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 13:06:24.709181 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 13:06:24.709181 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:06:24.709181 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:06:24.709181 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 615/1230] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:06:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:06:24.710926 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1bb8e-f628-4bf5-b31b-4a0ebe4133c6 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:24.811441 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1bb8e-f628-4bf5-b31b-4a0ebe4133c6 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:24.844527 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f470b98-fe0d-4fdd-964b-9952d51134d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:24.845193 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f470b98-fe0d-4fdd-964b-9952d51134d2 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:24.845474 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f470b98-fe0d-4fdd-964b-9952d51134d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:24.845758 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f470b98-fe0d-4fdd-964b-9952d51134d2 None admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:24.846533 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f470b98-fe0d-4fdd-964b-9952d51134d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:06:24.846900 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f470b98-fe0d-4fdd-964b-9952d51134d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:24.848356 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f470b98-fe0d-4fdd-964b-9952d51134d2 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:24.861017 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 616/1231] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 13:06:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:06:24.867181 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d005aef-a4f5-4c07-ba54-f4921f6a9539 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:24.933087 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:24.966568 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d005aef-a4f5-4c07-ba54-f4921f6a9539 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:25.001345 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e18d1-a376-478c-a789-8bba3a4091c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:25.002134 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e18d1-a376-478c-a789-8bba3a4091c3 None admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:25.002413 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e18d1-a376-478c-a789-8bba3a4091c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:25.002685 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e18d1-a376-478c-a789-8bba3a4091c3 None admin] PATH_INFO: `/v3/projects/c8c0bf799c9f451b8167a646a5c82eda/users/a5c4ad16c9454b74ae8445b115cf0af4/roles/eb985092d5f14e92a783e26568bf457b` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:25.016807 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4e18d1-a376-478c-a789-8bba3a4091c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8c0bf799c9f451b8167a646a5c82eda, user_id=a5c4ad16c9454b74ae8445b115cf0af4, role_id=eb985092d5f14e92a783e26568bf457b)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:25.018250 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4e18d1-a376-478c-a789-8bba3a4091c3 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:25.099458 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 616/1232] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jun 3 13:06:24 2022] PUT /identity/v3/projects/c8c0bf799c9f451b8167a646a5c82eda/users/a5c4ad16c9454b74ae8445b115cf0af4/roles/eb985092d5f14e92a783e26568bf457b => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:06:27.315665 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acde04e-5e85-4913-88bb-f98cca8b7e80 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:27.316227 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acde04e-5e85-4913-88bb-f98cca8b7e80 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:27.316227 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acde04e-5e85-4913-88bb-f98cca8b7e80 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:27.317540 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 617/1233] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:06:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:06:27.322810 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec0fa7-1483-445b-be18-cba2e8537254 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:27.323225 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec0fa7-1483-445b-be18-cba2e8537254 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:27.323356 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec0fa7-1483-445b-be18-cba2e8537254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:27.339230 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-b6ec0fa7-1483-445b-be18-cba2e8537254 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:06:27.340466 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-b6ec0fa7-1483-445b-be18-cba2e8537254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:06:27.404854 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 617/1234] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:06:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:06:27.428451 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acde04e-5e85-4913-88bb-f98cca8b7e80 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:27.453257 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:27.528008 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acde04e-5e85-4913-88bb-f98cca8b7e80 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:27.561492 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ff017-695f-48c6-8e50-016e38b95c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:27.562273 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ff017-695f-48c6-8e50-016e38b95c2e None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:27.562553 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ff017-695f-48c6-8e50-016e38b95c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:27.562823 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ff017-695f-48c6-8e50-016e38b95c2e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:27.572602 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059ff017-695f-48c6-8e50-016e38b95c2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:06:27.581233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-059ff017-695f-48c6-8e50-016e38b95c2e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 13:06:27.581233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:06:27.581233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:06:27.581233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:06:27.581233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:06:27.581233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:06:27.581233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:06:27.581233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:06:27.581233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:06:27.581233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:06:27.581233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:06:27.581233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:06:27.581233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:06:27.581233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:06:27.581233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:06:27.581233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:06:27.582356 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:06:27.582356 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:06:27.582356 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:06:27.582356 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:06:27.582356 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:06:27.582356 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:06:27.582356 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:06:27.582356 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:06:27.582356 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:06:27.582356 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:06:27.582356 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:06:27.582356 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:06:27.582356 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:06:27.582356 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:06:27.582356 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:06:27.582356 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:06:27.583309 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:06:27.583309 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:06:27.583309 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:06:27.583309 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:06:27.583309 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:06:27.583309 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:06:27.583309 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:06:27.583309 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:06:27.583309 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:06:27.583309 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:06:27.583309 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 13:06:27.583309 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:06:27.583309 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 618/1235] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jun 3 13:06:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:06:27.588496 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec0fa7-1483-445b-be18-cba2e8537254 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:27.636451 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:27.687717 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec0fa7-1483-445b-be18-cba2e8537254 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:27.720153 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3206e425-90d2-4f88-ab9a-f4df1ba80be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:27.720834 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206e425-90d2-4f88-ab9a-f4df1ba80be3 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:27.721118 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206e425-90d2-4f88-ab9a-f4df1ba80be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:27.721394 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206e425-90d2-4f88-ab9a-f4df1ba80be3 None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:27.722129 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3206e425-90d2-4f88-ab9a-f4df1ba80be3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:06:27.722438 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3206e425-90d2-4f88-ab9a-f4df1ba80be3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:27.723793 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3206e425-90d2-4f88-ab9a-f4df1ba80be3 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:27.732857 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 618/1236] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jun 3 13:06:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:06:27.738689 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ff017-695f-48c6-8e50-016e38b95c2e None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:27.823340 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:27.838329 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ff017-695f-48c6-8e50-016e38b95c2e None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:27.872001 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29289ba-480f-4157-b327-2aae5004066d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:27.873400 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29289ba-480f-4157-b327-2aae5004066d None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:27.873681 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29289ba-480f-4157-b327-2aae5004066d None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:27.873952 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29289ba-480f-4157-b327-2aae5004066d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:27.883792 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29289ba-480f-4157-b327-2aae5004066d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:27.885275 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29289ba-480f-4157-b327-2aae5004066d None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:27.903015 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-e29289ba-480f-4157-b327-2aae5004066d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:06:27.903015 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:06:27.903015 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:06:27.903015 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:06:27.903015 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:06:27.903015 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:06:27.903015 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:06:27.903015 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:06:27.903015 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:06:27.903015 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:06:27.903015 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:06:27.903015 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:06:27.903015 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:06:27.903015 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:06:27.903015 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:06:27.904260 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:06:27.904260 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:06:27.904260 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:06:27.904260 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:06:27.904260 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:06:27.904260 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:06:27.904260 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:06:27.904260 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:06:27.904260 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:06:27.904260 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:06:27.904260 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:06:27.904260 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:06:27.904260 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:06:27.904260 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:06:27.904260 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:06:27.904260 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:06:27.904260 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:06:27.905404 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:06:27.905404 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:06:27.905404 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:06:27.905404 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:06:27.905404 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 619/1237] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:06:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 13:06:27.910147 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3206e425-90d2-4f88-ab9a-f4df1ba80be3 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:28.008862 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3206e425-90d2-4f88-ab9a-f4df1ba80be3 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:28.018392 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:28.045122 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a722f-ba7d-4402-b6c1-8c5c11999d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:28.045778 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a722f-ba7d-4402-b6c1-8c5c11999d6c None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:28.046060 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a722f-ba7d-4402-b6c1-8c5c11999d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:28.046333 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a722f-ba7d-4402-b6c1-8c5c11999d6c None admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:28.047054 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a722f-ba7d-4402-b6c1-8c5c11999d6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:06:28.047345 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a722f-ba7d-4402-b6c1-8c5c11999d6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:28.048754 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a722f-ba7d-4402-b6c1-8c5c11999d6c None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:28.059967 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 619/1238] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:06:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:06:28.065573 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29289ba-480f-4157-b327-2aae5004066d None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:28.165036 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29289ba-480f-4157-b327-2aae5004066d None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:28.198758 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8965d3b-8227-407a-905c-ebbdb3852b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:28.199722 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8965d3b-8227-407a-905c-ebbdb3852b21 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:28.200004 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8965d3b-8227-407a-905c-ebbdb3852b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:28.200440 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8965d3b-8227-407a-905c-ebbdb3852b21 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:28.203197 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:28.207657 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8965d3b-8227-407a-905c-ebbdb3852b21 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:28.209145 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8965d3b-8227-407a-905c-ebbdb3852b21 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:28.223893 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-a8965d3b-8227-407a-905c-ebbdb3852b21 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 03 13:06:28.223893 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:06:28.223893 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:06:28.223893 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:06:28.223893 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:06:28.223893 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:06:28.223893 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:06:28.223893 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:06:28.223893 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:06:28.223893 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:06:28.223893 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:06:28.223893 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:06:28.223893 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 13:06:28.223893 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 13:06:28.223893 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 13:06:28.223893 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 13:06:28.225741 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:06:28.225741 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:06:28.225741 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 13:06:28.225741 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:06:28.225741 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 13:06:28.225741 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:06:28.225741 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:06:28.225741 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:06:28.225741 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:06:28.225741 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:06:28.225741 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:06:28.225741 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:06:28.225741 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:06:28.225741 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:06:28.225741 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:06:28.225741 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:06:28.225741 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:06:28.225741 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:06:28.226926 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:06:28.226926 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:06:28.226926 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 13:06:28.226926 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 13:06:28.226926 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 13:06:28.226926 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 13:06:28.226926 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 13:06:28.226926 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 13:06:28.226926 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 03 13:06:28.226926 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:06:28.226926 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 620/1239] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:06:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:06:28.231257 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a722f-ba7d-4402-b6c1-8c5c11999d6c None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:28.329327 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a722f-ba7d-4402-b6c1-8c5c11999d6c None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:28.363058 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c69cf9-07ba-4707-bfdb-9f395cc10ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:28.363724 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c69cf9-07ba-4707-bfdb-9f395cc10ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:28.364007 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c69cf9-07ba-4707-bfdb-9f395cc10ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:28.364311 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c69cf9-07ba-4707-bfdb-9f395cc10ab7 None admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:28.365294 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c69cf9-07ba-4707-bfdb-9f395cc10ab7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:06:28.365602 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c69cf9-07ba-4707-bfdb-9f395cc10ab7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:28.367026 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c69cf9-07ba-4707-bfdb-9f395cc10ab7 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:28.383771 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 620/1240] 10.222.0.61 () {56 vars in 1143 bytes} [Fri Jun 3 13:06:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:06:28.390275 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8965d3b-8227-407a-905c-ebbdb3852b21 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:28.490224 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8965d3b-8227-407a-905c-ebbdb3852b21 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:28.523709 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab6ded-d028-4ae6-aa61-d58872a3a28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:28.524387 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab6ded-d028-4ae6-aa61-d58872a3a28a None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:28.524672 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab6ded-d028-4ae6-aa61-d58872a3a28a None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:28.524948 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab6ded-d028-4ae6-aa61-d58872a3a28a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:28.583812 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:28.590013 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab6ded-d028-4ae6-aa61-d58872a3a28a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:28.592071 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab6ded-d028-4ae6-aa61-d58872a3a28a None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:28.687562 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 621/1241] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:06:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 13:06:28.693457 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c69cf9-07ba-4707-bfdb-9f395cc10ab7 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:28.721038 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:28.793301 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c69cf9-07ba-4707-bfdb-9f395cc10ab7 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:28.827508 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0b53a-b14f-4118-8dcc-8d96ad83745d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:28.828330 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0b53a-b14f-4118-8dcc-8d96ad83745d None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:28.828617 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0b53a-b14f-4118-8dcc-8d96ad83745d None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:28.828893 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0b53a-b14f-4118-8dcc-8d96ad83745d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:28.838750 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca0b53a-b14f-4118-8dcc-8d96ad83745d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:28.840218 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca0b53a-b14f-4118-8dcc-8d96ad83745d None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:28.858978 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-eca0b53a-b14f-4118-8dcc-8d96ad83745d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:06:28.858978 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:06:28.858978 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:06:28.858978 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:06:28.858978 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:06:28.858978 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:06:28.858978 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:06:28.858978 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:06:28.858978 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:06:28.858978 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:06:28.858978 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:06:28.858978 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:06:28.858978 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:06:28.858978 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:06:28.858978 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:06:28.859881 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:06:28.859881 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:06:28.859881 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:06:28.859881 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:06:28.859881 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:06:28.859881 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:06:28.859881 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:06:28.859881 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:06:28.859881 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:06:28.859881 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:06:28.859881 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:06:28.859881 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:06:28.859881 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:06:28.859881 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:06:28.859881 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:06:28.859881 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:06:28.859881 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:06:28.862136 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:06:28.862136 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:06:28.862136 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:06:28.862136 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:06:28.862136 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 621/1242] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:06:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:06:28.865880 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab6ded-d028-4ae6-aa61-d58872a3a28a None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:28.956405 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:28.961878 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab6ded-d028-4ae6-aa61-d58872a3a28a None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:29.004338 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff114d15-7190-4052-9bb3-9eaf5dbb7f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:29.005003 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff114d15-7190-4052-9bb3-9eaf5dbb7f7a None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:29.005283 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff114d15-7190-4052-9bb3-9eaf5dbb7f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:29.005553 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff114d15-7190-4052-9bb3-9eaf5dbb7f7a None admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:29.006277 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff114d15-7190-4052-9bb3-9eaf5dbb7f7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:06:29.006580 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff114d15-7190-4052-9bb3-9eaf5dbb7f7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:29.007950 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff114d15-7190-4052-9bb3-9eaf5dbb7f7a None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:29.020100 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 622/1243] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:06:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:06:29.025732 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0b53a-b14f-4118-8dcc-8d96ad83745d None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:29.103529 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:29.126351 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0b53a-b14f-4118-8dcc-8d96ad83745d None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:29.159769 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456066e-c858-4e07-9bb5-641ab02c144e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:29.160627 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456066e-c858-4e07-9bb5-641ab02c144e None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:29.160915 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456066e-c858-4e07-9bb5-641ab02c144e None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:29.161190 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456066e-c858-4e07-9bb5-641ab02c144e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:29.167997 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9456066e-c858-4e07-9bb5-641ab02c144e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:29.170034 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9456066e-c858-4e07-9bb5-641ab02c144e None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:29.183429 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-9456066e-c858-4e07-9bb5-641ab02c144e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:06:29.183429 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:06:29.183429 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:06:29.183429 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:06:29.183429 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:06:29.183429 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:06:29.183429 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:06:29.183429 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:06:29.183429 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:06:29.183429 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:06:29.183429 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:06:29.183429 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:06:29.183429 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 13:06:29.183429 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 13:06:29.183429 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 13:06:29.185176 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 13:06:29.185176 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:06:29.185176 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:06:29.185176 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:06:29.185176 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:06:29.185176 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:06:29.185176 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:06:29.185176 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:06:29.185176 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:06:29.185176 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:06:29.185176 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:06:29.185176 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:06:29.185176 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:06:29.185176 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:06:29.185176 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:06:29.185176 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:06:29.185176 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:06:29.186590 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 13:06:29.186590 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 13:06:29.186590 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 13:06:29.186590 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 13:06:29.186590 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 13:06:29.186590 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 13:06:29.186590 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:06:29.186590 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:06:29.186590 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 622/1244] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:06:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:06:29.191325 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff114d15-7190-4052-9bb3-9eaf5dbb7f7a None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:29.287706 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff114d15-7190-4052-9bb3-9eaf5dbb7f7a None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:29.320590 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1485bfc-3147-494a-92a7-04f87993aa3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:29.321235 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1485bfc-3147-494a-92a7-04f87993aa3a None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:29.321515 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1485bfc-3147-494a-92a7-04f87993aa3a None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:29.321786 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1485bfc-3147-494a-92a7-04f87993aa3a None admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:29.322554 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1485bfc-3147-494a-92a7-04f87993aa3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:06:29.322856 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1485bfc-3147-494a-92a7-04f87993aa3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:29.324306 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1485bfc-3147-494a-92a7-04f87993aa3a None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:29.336066 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 623/1245] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 13:06:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:06:29.342284 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456066e-c858-4e07-9bb5-641ab02c144e None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:29.440256 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456066e-c858-4e07-9bb5-641ab02c144e None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:29.475407 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc7ff4c-0384-41c4-a650-57bcd7d7df32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:29.476335 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7ff4c-0384-41c4-a650-57bcd7d7df32 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:29.476618 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7ff4c-0384-41c4-a650-57bcd7d7df32 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:29.476893 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7ff4c-0384-41c4-a650-57bcd7d7df32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:29.477753 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc7ff4c-0384-41c4-a650-57bcd7d7df32 None admin] RBAC: Adding query filter params (role.id=eb985092d5f14e92a783e26568bf457b, scope.project.id=c8c0bf799c9f451b8167a646a5c82eda, user.id=a5c4ad16c9454b74ae8445b115cf0af4) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:06:29.478060 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc7ff4c-0384-41c4-a650-57bcd7d7df32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:29.479474 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc7ff4c-0384-41c4-a650-57bcd7d7df32 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:29.485902 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 623/1246] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 13:06:29 2022] GET /identity/v3/role_assignments?user.id=a5c4ad16c9454b74ae8445b115cf0af4&scope.project.id=c8c0bf799c9f451b8167a646a5c82eda&role.id=eb985092d5f14e92a783e26568bf457b => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:06:31.782882 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e043973-323a-409d-903e-5d10d0506245 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:31.783423 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e043973-323a-409d-903e-5d10d0506245 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:31.783423 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e043973-323a-409d-903e-5d10d0506245 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:31.784822 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 624/1247] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:06:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:06:31.791373 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb75c04-e99a-483b-9dae-b6ce5a0b725f None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:31.791373 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb75c04-e99a-483b-9dae-b6ce5a0b725f None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:31.791373 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb75c04-e99a-483b-9dae-b6ce5a0b725f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:31.796441 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:31.808526 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-aeb75c04-e99a-483b-9dae-b6ce5a0b725f None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:06:31.809917 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-aeb75c04-e99a-483b-9dae-b6ce5a0b725f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:06:31.874695 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 624/1248] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:06:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:06:31.897770 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e043973-323a-409d-903e-5d10d0506245 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:31.915967 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:31.998155 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e043973-323a-409d-903e-5d10d0506245 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:32.032786 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33dc0f6-55fa-4d5a-8cbe-868216e2aff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:32.033617 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33dc0f6-55fa-4d5a-8cbe-868216e2aff6 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:32.033852 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33dc0f6-55fa-4d5a-8cbe-868216e2aff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:32.034126 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33dc0f6-55fa-4d5a-8cbe-868216e2aff6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:32.043987 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33dc0f6-55fa-4d5a-8cbe-868216e2aff6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:06:32.052276 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-a33dc0f6-55fa-4d5a-8cbe-868216e2aff6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:06:32.052276 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:06:32.052276 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:06:32.052276 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:06:32.052276 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:06:32.052276 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:06:32.052276 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:06:32.052276 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:06:32.052276 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:06:32.052276 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:06:32.052276 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:06:32.052276 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:06:32.052276 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:06:32.052276 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:06:32.052276 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:06:32.052276 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:06:32.054085 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:06:32.054085 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:06:32.054085 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:06:32.054085 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:06:32.054085 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:06:32.054085 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:06:32.054085 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:06:32.054085 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:06:32.054085 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:06:32.054085 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:06:32.054085 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:06:32.054085 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:06:32.054085 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:06:32.054085 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:06:32.054085 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:06:32.054085 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:06:32.055425 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:06:32.055425 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:06:32.055425 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:06:32.055425 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:06:32.055425 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:06:32.055425 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:06:32.055425 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:06:32.055425 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:06:32.055425 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:06:32.055425 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:06:32.055425 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:06:32.055425 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:06:32.055425 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 625/1249] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 13:06:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:06:32.060978 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb75c04-e99a-483b-9dae-b6ce5a0b725f None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:32.157110 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb75c04-e99a-483b-9dae-b6ce5a0b725f None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:32.184836 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:32.189529 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b628f8-b000-4bd4-8cb2-b33b784a0de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:32.190182 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b628f8-b000-4bd4-8cb2-b33b784a0de9 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:32.190469 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b628f8-b000-4bd4-8cb2-b33b784a0de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:32.190737 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b628f8-b000-4bd4-8cb2-b33b784a0de9 None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:32.191469 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b628f8-b000-4bd4-8cb2-b33b784a0de9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:06:32.191770 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b628f8-b000-4bd4-8cb2-b33b784a0de9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:32.193155 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b628f8-b000-4bd4-8cb2-b33b784a0de9 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:32.201413 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 625/1250] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:06:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:06:32.207227 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33dc0f6-55fa-4d5a-8cbe-868216e2aff6 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:32.286123 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:32.309248 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33dc0f6-55fa-4d5a-8cbe-868216e2aff6 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:32.342928 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc12aa-3f2a-4a06-ac2b-68a3aa4410eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:32.343740 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc12aa-3f2a-4a06-ac2b-68a3aa4410eb None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:32.344044 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc12aa-3f2a-4a06-ac2b-68a3aa4410eb None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:32.344376 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc12aa-3f2a-4a06-ac2b-68a3aa4410eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:32.357254 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cc12aa-3f2a-4a06-ac2b-68a3aa4410eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:32.358718 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cc12aa-3f2a-4a06-ac2b-68a3aa4410eb None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:32.375911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-70cc12aa-3f2a-4a06-ac2b-68a3aa4410eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:06:32.375911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:06:32.375911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:06:32.375911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:06:32.375911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:06:32.375911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:06:32.375911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:06:32.375911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:06:32.375911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:06:32.375911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:06:32.375911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:06:32.375911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:06:32.375911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:06:32.375911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:06:32.375911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:06:32.377077 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:06:32.377077 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:06:32.377077 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:06:32.377077 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:06:32.377077 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:06:32.377077 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:06:32.377077 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:06:32.377077 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:06:32.377077 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:06:32.377077 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:06:32.377077 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:06:32.377077 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:06:32.377077 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:06:32.377077 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:06:32.377077 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:06:32.377077 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:06:32.377077 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:06:32.378037 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:06:32.378037 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:06:32.378037 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:06:32.378037 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:06:32.378037 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 626/1251] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:06:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:06:32.382857 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b628f8-b000-4bd4-8cb2-b33b784a0de9 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:32.482967 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b628f8-b000-4bd4-8cb2-b33b784a0de9 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:32.517218 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060de1f-1eac-4e7b-9885-ebf0d3656c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:32.517914 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060de1f-1eac-4e7b-9885-ebf0d3656c8b None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:32.518161 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060de1f-1eac-4e7b-9885-ebf0d3656c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:32.518437 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060de1f-1eac-4e7b-9885-ebf0d3656c8b None admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:32.519150 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060de1f-1eac-4e7b-9885-ebf0d3656c8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:06:32.519454 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060de1f-1eac-4e7b-9885-ebf0d3656c8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:32.520858 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060de1f-1eac-4e7b-9885-ebf0d3656c8b None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:32.532735 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 626/1252] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:06:32.538874 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc12aa-3f2a-4a06-ac2b-68a3aa4410eb None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:32.636572 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc12aa-3f2a-4a06-ac2b-68a3aa4410eb None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:32.662455 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:32.670248 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da805f69-c437-474d-9cc5-57bfd19fc6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:32.671047 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da805f69-c437-474d-9cc5-57bfd19fc6d9 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:32.671330 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da805f69-c437-474d-9cc5-57bfd19fc6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:32.671604 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da805f69-c437-474d-9cc5-57bfd19fc6d9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:32.678828 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da805f69-c437-474d-9cc5-57bfd19fc6d9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:32.680301 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da805f69-c437-474d-9cc5-57bfd19fc6d9 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:32.694904 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-da805f69-c437-474d-9cc5-57bfd19fc6d9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 03 13:06:32.694904 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:06:32.694904 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:06:32.694904 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:06:32.694904 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:06:32.694904 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:06:32.694904 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:06:32.694904 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:06:32.694904 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:06:32.694904 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:06:32.694904 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:06:32.694904 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:06:32.694904 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 13:06:32.694904 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 13:06:32.694904 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 13:06:32.694904 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 13:06:32.696178 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:06:32.696178 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:06:32.696178 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 13:06:32.696178 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:06:32.696178 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 13:06:32.696178 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:06:32.696178 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:06:32.696178 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:06:32.696178 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:06:32.696178 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:06:32.696178 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:06:32.696178 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:06:32.696178 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:06:32.696178 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:06:32.696178 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:06:32.696178 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:06:32.696178 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:06:32.696178 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:06:32.697448 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:06:32.697448 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:06:32.697448 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 13:06:32.697448 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 13:06:32.697448 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 13:06:32.697448 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 13:06:32.697448 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 13:06:32.697448 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 13:06:32.697448 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 03 13:06:32.697448 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:06:32.697448 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 627/1253] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:06:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:06:32.702891 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060de1f-1eac-4e7b-9885-ebf0d3656c8b None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:32.757657 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:32.801230 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060de1f-1eac-4e7b-9885-ebf0d3656c8b None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:32.834593 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac517a9-620b-4664-9c98-7228cb962f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:32.835254 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac517a9-620b-4664-9c98-7228cb962f62 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:32.835536 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac517a9-620b-4664-9c98-7228cb962f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:32.835809 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac517a9-620b-4664-9c98-7228cb962f62 None admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:32.836675 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac517a9-620b-4664-9c98-7228cb962f62 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:06:32.836986 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac517a9-620b-4664-9c98-7228cb962f62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:32.838548 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac517a9-620b-4664-9c98-7228cb962f62 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:32.857946 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 627/1254] 10.222.0.61 () {56 vars in 1143 bytes} [Fri Jun 3 13:06:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:06:32.863856 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da805f69-c437-474d-9cc5-57bfd19fc6d9 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:32.973734 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da805f69-c437-474d-9cc5-57bfd19fc6d9 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:33.016803 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401ddf0-4489-433e-ac56-7e09a2fe79c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:33.017478 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401ddf0-4489-433e-ac56-7e09a2fe79c1 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:33.018148 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401ddf0-4489-433e-ac56-7e09a2fe79c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:33.018148 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401ddf0-4489-433e-ac56-7e09a2fe79c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:33.074041 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:33.086188 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0401ddf0-4489-433e-ac56-7e09a2fe79c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:33.087692 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0401ddf0-4489-433e-ac56-7e09a2fe79c1 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:33.186147 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 628/1255] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:06:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 13:06:33.192006 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac517a9-620b-4664-9c98-7228cb962f62 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:33.295254 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac517a9-620b-4664-9c98-7228cb962f62 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:33.308253 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:33.328981 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37cdab8-7e0a-4ee9-a0d1-3fa7a8eda396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:33.329795 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37cdab8-7e0a-4ee9-a0d1-3fa7a8eda396 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:33.330103 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37cdab8-7e0a-4ee9-a0d1-3fa7a8eda396 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:33.330382 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37cdab8-7e0a-4ee9-a0d1-3fa7a8eda396 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:33.341484 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37cdab8-7e0a-4ee9-a0d1-3fa7a8eda396 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:33.343090 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37cdab8-7e0a-4ee9-a0d1-3fa7a8eda396 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:33.361776 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-a37cdab8-7e0a-4ee9-a0d1-3fa7a8eda396 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:06:33.361776 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:06:33.361776 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:06:33.361776 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:06:33.361776 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:06:33.361776 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:06:33.361776 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:06:33.361776 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:06:33.361776 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:06:33.361776 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:06:33.361776 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:06:33.361776 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:06:33.361776 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:06:33.361776 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:06:33.361776 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:06:33.362847 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:06:33.362847 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:06:33.362847 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:06:33.362847 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:06:33.362847 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:06:33.362847 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:06:33.362847 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:06:33.362847 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:06:33.362847 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:06:33.362847 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:06:33.362847 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:06:33.362847 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:06:33.362847 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:06:33.362847 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:06:33.362847 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:06:33.362847 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:06:33.362847 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:06:33.363896 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:06:33.363896 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:06:33.363896 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:06:33.363896 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:06:33.363896 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 628/1256] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:06:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:06:33.368880 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401ddf0-4489-433e-ac56-7e09a2fe79c1 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:33.453171 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:33.466315 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401ddf0-4489-433e-ac56-7e09a2fe79c1 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:33.500623 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7f300-9d7f-4062-bdb7-631de787433d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:33.501290 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7f300-9d7f-4062-bdb7-631de787433d None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:33.501574 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7f300-9d7f-4062-bdb7-631de787433d None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:33.501858 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7f300-9d7f-4062-bdb7-631de787433d None admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:33.502575 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f7f300-9d7f-4062-bdb7-631de787433d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:06:33.502886 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f7f300-9d7f-4062-bdb7-631de787433d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:33.504285 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f7f300-9d7f-4062-bdb7-631de787433d None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:33.515470 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 629/1257] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:06:33.521347 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37cdab8-7e0a-4ee9-a0d1-3fa7a8eda396 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:33.622085 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37cdab8-7e0a-4ee9-a0d1-3fa7a8eda396 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:33.664100 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fccc5d-d065-456b-8a7a-60a80cd54a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:33.665746 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fccc5d-d065-456b-8a7a-60a80cd54a62 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:33.665746 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fccc5d-d065-456b-8a7a-60a80cd54a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:33.665746 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fccc5d-d065-456b-8a7a-60a80cd54a62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:33.672600 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fccc5d-d065-456b-8a7a-60a80cd54a62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:33.674024 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fccc5d-d065-456b-8a7a-60a80cd54a62 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:33.687451 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-95fccc5d-d065-456b-8a7a-60a80cd54a62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:06:33.687451 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:06:33.687451 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:06:33.687451 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:06:33.687451 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:06:33.687451 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:06:33.687451 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:06:33.687451 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:06:33.687451 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:06:33.687451 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:06:33.687451 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:06:33.687451 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:06:33.687451 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 13:06:33.687451 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 13:06:33.687451 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 13:06:33.688548 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 13:06:33.688548 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:06:33.688548 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:06:33.688548 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:06:33.688548 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:06:33.688548 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:06:33.688548 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:06:33.688548 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:06:33.688548 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:06:33.688548 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:06:33.688548 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:06:33.688548 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:06:33.688548 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:06:33.688548 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:06:33.688548 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:06:33.688548 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:06:33.688548 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:06:33.689845 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 13:06:33.689845 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 13:06:33.689845 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 13:06:33.689845 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 13:06:33.689845 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 13:06:33.689845 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 13:06:33.689845 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:06:33.689845 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:06:33.689845 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 629/1258] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:06:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:06:33.694589 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7f300-9d7f-4062-bdb7-631de787433d None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:33.795815 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7f300-9d7f-4062-bdb7-631de787433d None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:33.828606 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d90df-a454-4304-a7aa-494a0b2c5e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:33.829254 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d90df-a454-4304-a7aa-494a0b2c5e86 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:33.829532 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d90df-a454-4304-a7aa-494a0b2c5e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:33.829836 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d90df-a454-4304-a7aa-494a0b2c5e86 None admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:33.830598 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698d90df-a454-4304-a7aa-494a0b2c5e86 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:06:33.830902 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698d90df-a454-4304-a7aa-494a0b2c5e86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:33.832343 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698d90df-a454-4304-a7aa-494a0b2c5e86 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:33.844108 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 630/1259] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 13:06:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:06:33.850292 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fccc5d-d065-456b-8a7a-60a80cd54a62 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:33.881114 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:33.950491 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fccc5d-d065-456b-8a7a-60a80cd54a62 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:33.986836 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8bb5a2-ecb9-4b8d-bcff-1d0bfae6679e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:33.987490 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8bb5a2-ecb9-4b8d-bcff-1d0bfae6679e None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:33.987774 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8bb5a2-ecb9-4b8d-bcff-1d0bfae6679e None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:33.988047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8bb5a2-ecb9-4b8d-bcff-1d0bfae6679e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:33.988908 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8bb5a2-ecb9-4b8d-bcff-1d0bfae6679e None admin] RBAC: Adding query filter params (role.id=bbd5f3e0c18e4992886fcfb4a3feb426, scope.project.id=c8c0bf799c9f451b8167a646a5c82eda, user.id=a5c4ad16c9454b74ae8445b115cf0af4) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:06:33.989649 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8bb5a2-ecb9-4b8d-bcff-1d0bfae6679e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:33.990704 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8bb5a2-ecb9-4b8d-bcff-1d0bfae6679e None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:33.999324 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 630/1260] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 13:06:33 2022] GET /identity/v3/role_assignments?user.id=a5c4ad16c9454b74ae8445b115cf0af4&scope.project.id=c8c0bf799c9f451b8167a646a5c82eda&role.id=bbd5f3e0c18e4992886fcfb4a3feb426 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:06:36.255557 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b2b01-efc0-4510-a18f-86a237a3edeb None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:36.256082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b2b01-efc0-4510-a18f-86a237a3edeb None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:36.256082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b2b01-efc0-4510-a18f-86a237a3edeb None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:36.257429 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 631/1261] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:06:36.263476 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199746a-f631-450c-b194-90bc5caa90de None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:36.263893 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199746a-f631-450c-b194-90bc5caa90de None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:36.263995 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199746a-f631-450c-b194-90bc5caa90de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:36.279894 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-0199746a-f631-450c-b194-90bc5caa90de None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:06:36.281087 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-0199746a-f631-450c-b194-90bc5caa90de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:06:36.347260 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 631/1262] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:06:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:06:36.369850 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b2b01-efc0-4510-a18f-86a237a3edeb None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:36.381293 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:36.468920 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b2b01-efc0-4510-a18f-86a237a3edeb None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:36.502202 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d506c56-5be8-4088-ac85-fe47e24ab484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:36.502994 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d506c56-5be8-4088-ac85-fe47e24ab484 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:36.503276 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d506c56-5be8-4088-ac85-fe47e24ab484 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:36.503550 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d506c56-5be8-4088-ac85-fe47e24ab484 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:36.514973 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d506c56-5be8-4088-ac85-fe47e24ab484 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:06:36.522409 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-1d506c56-5be8-4088-ac85-fe47e24ab484 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:06:36.522409 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:06:36.522409 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:06:36.522409 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:06:36.522409 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:06:36.522409 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:06:36.522409 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:06:36.522409 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:06:36.522409 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:06:36.522409 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:06:36.522409 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:06:36.522409 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:06:36.522409 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:06:36.522409 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:06:36.522409 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:06:36.522409 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:06:36.527673 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:06:36.527673 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:06:36.527673 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:06:36.527673 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:06:36.527673 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:06:36.527673 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:06:36.527673 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:06:36.527673 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:06:36.527673 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:06:36.527673 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:06:36.527673 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:06:36.527673 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:06:36.527673 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:06:36.527673 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:06:36.527673 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:06:36.527673 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:06:36.528814 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:06:36.528814 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:06:36.528814 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:06:36.528814 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:06:36.528814 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:06:36.528814 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:06:36.528814 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:06:36.528814 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:06:36.528814 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:06:36.528814 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:06:36.528814 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:06:36.528814 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:06:36.528814 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 632/1263] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 13:06:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:06:36.529834 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0199746a-f631-450c-b194-90bc5caa90de None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:36.548813 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:36.640847 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0199746a-f631-450c-b194-90bc5caa90de None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:36.673234 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c286da8-5c30-44a2-840d-66c0360b133a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:36.673885 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c286da8-5c30-44a2-840d-66c0360b133a None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:36.674242 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c286da8-5c30-44a2-840d-66c0360b133a None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:36.674519 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c286da8-5c30-44a2-840d-66c0360b133a None admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:36.675314 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c286da8-5c30-44a2-840d-66c0360b133a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:06:36.675634 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c286da8-5c30-44a2-840d-66c0360b133a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:36.677012 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c286da8-5c30-44a2-840d-66c0360b133a None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:36.686095 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 632/1264] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:06:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:06:36.691975 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d506c56-5be8-4088-ac85-fe47e24ab484 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:36.760451 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:36.792546 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d506c56-5be8-4088-ac85-fe47e24ab484 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:36.825114 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98209b9d-46ab-4dcd-ae50-cc32e4f7c398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:36.826131 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98209b9d-46ab-4dcd-ae50-cc32e4f7c398 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:36.826229 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98209b9d-46ab-4dcd-ae50-cc32e4f7c398 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:36.826499 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98209b9d-46ab-4dcd-ae50-cc32e4f7c398 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:36.836627 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98209b9d-46ab-4dcd-ae50-cc32e4f7c398 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:36.838121 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98209b9d-46ab-4dcd-ae50-cc32e4f7c398 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:36.854843 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-98209b9d-46ab-4dcd-ae50-cc32e4f7c398 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:06:36.854843 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:06:36.854843 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:06:36.854843 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:06:36.854843 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:06:36.854843 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:06:36.854843 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:06:36.854843 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:06:36.854843 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:06:36.854843 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:06:36.854843 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:06:36.854843 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:06:36.854843 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:06:36.854843 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:06:36.854843 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:06:36.855796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:06:36.855796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:06:36.855796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:06:36.855796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:06:36.855796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:06:36.855796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:06:36.855796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:06:36.855796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:06:36.855796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:06:36.855796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:06:36.855796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:06:36.855796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:06:36.855796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:06:36.855796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:06:36.855796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:06:36.855796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:06:36.855796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:06:36.857708 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:06:36.857708 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:06:36.857708 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:06:36.857708 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:06:36.857708 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 633/1265] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:06:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:06:36.862445 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c286da8-5c30-44a2-840d-66c0360b133a None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:36.946768 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:36.970462 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c286da8-5c30-44a2-840d-66c0360b133a None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:37.005188 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e333858-3868-490f-af8b-c07ce79af18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:37.005851 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e333858-3868-490f-af8b-c07ce79af18e None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:37.006136 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e333858-3868-490f-af8b-c07ce79af18e None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:37.006470 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e333858-3868-490f-af8b-c07ce79af18e None admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:37.007180 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e333858-3868-490f-af8b-c07ce79af18e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:06:37.007483 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e333858-3868-490f-af8b-c07ce79af18e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:37.008966 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e333858-3868-490f-af8b-c07ce79af18e None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:37.020020 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 633/1266] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:06:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:06:37.025961 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98209b9d-46ab-4dcd-ae50-cc32e4f7c398 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:37.124783 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98209b9d-46ab-4dcd-ae50-cc32e4f7c398 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:37.143788 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:37.157646 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0fd05c-f6a1-46b1-8e84-d79c23854f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:37.158437 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fd05c-f6a1-46b1-8e84-d79c23854f6c None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:37.158716 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fd05c-f6a1-46b1-8e84-d79c23854f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:37.158989 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fd05c-f6a1-46b1-8e84-d79c23854f6c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:37.166193 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0fd05c-f6a1-46b1-8e84-d79c23854f6c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:37.167658 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0fd05c-f6a1-46b1-8e84-d79c23854f6c None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:37.182705 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-4f0fd05c-f6a1-46b1-8e84-d79c23854f6c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 03 13:06:37.182705 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:06:37.182705 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:06:37.182705 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:06:37.182705 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:06:37.182705 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:06:37.182705 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:06:37.182705 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:06:37.182705 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:06:37.182705 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:06:37.182705 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:06:37.182705 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:06:37.182705 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 13:06:37.182705 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 13:06:37.182705 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 13:06:37.182705 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 13:06:37.190831 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:06:37.190831 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:06:37.190831 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 13:06:37.190831 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:06:37.190831 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 13:06:37.190831 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:06:37.190831 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:06:37.190831 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:06:37.190831 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:06:37.190831 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:06:37.190831 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:06:37.190831 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:06:37.190831 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:06:37.190831 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:06:37.190831 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:06:37.190831 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:06:37.190831 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:06:37.190831 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:06:37.192017 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:06:37.192017 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:06:37.192017 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 13:06:37.192017 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 13:06:37.192017 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 13:06:37.192017 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 13:06:37.192017 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 13:06:37.192017 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 13:06:37.192017 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 03 13:06:37.192017 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:06:37.192017 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 634/1267] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:06:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:06:37.192759 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e333858-3868-490f-af8b-c07ce79af18e None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:37.288917 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e333858-3868-490f-af8b-c07ce79af18e None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:37.322638 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44201739-afc5-40c8-886f-289118936ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:37.323391 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44201739-afc5-40c8-886f-289118936ce2 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:37.323673 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44201739-afc5-40c8-886f-289118936ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:37.323945 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44201739-afc5-40c8-886f-289118936ce2 None admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:37.324800 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44201739-afc5-40c8-886f-289118936ce2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:06:37.325799 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44201739-afc5-40c8-886f-289118936ce2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:37.327397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44201739-afc5-40c8-886f-289118936ce2 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:37.336437 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:37.345038 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 634/1268] 10.222.0.61 () {56 vars in 1143 bytes} [Fri Jun 3 13:06:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:06:37.350617 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0fd05c-f6a1-46b1-8e84-d79c23854f6c None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:37.450734 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0fd05c-f6a1-46b1-8e84-d79c23854f6c None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:37.483980 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07101c-cf30-4c42-9f2d-946dc0438d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:37.484896 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07101c-cf30-4c42-9f2d-946dc0438d36 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:37.485183 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07101c-cf30-4c42-9f2d-946dc0438d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:37.485455 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07101c-cf30-4c42-9f2d-946dc0438d36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:37.496096 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de07101c-cf30-4c42-9f2d-946dc0438d36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:37.497848 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de07101c-cf30-4c42-9f2d-946dc0438d36 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:37.515479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-de07101c-cf30-4c42-9f2d-946dc0438d36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:06:37.515479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:06:37.515479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:06:37.515479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:06:37.515479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:06:37.515479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:06:37.515479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:06:37.515479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:06:37.515479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:06:37.515479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:06:37.515479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:06:37.515479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:06:37.515479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:06:37.515479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:06:37.515479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:06:37.516592 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:06:37.516592 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:06:37.516592 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:06:37.516592 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:06:37.516592 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:06:37.516592 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:06:37.516592 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:06:37.516592 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:06:37.516592 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:06:37.516592 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:06:37.516592 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:06:37.516592 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:06:37.516592 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:06:37.516592 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:06:37.516592 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:06:37.516592 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:06:37.516592 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:06:37.517830 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:06:37.517830 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:06:37.517830 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:06:37.517830 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:06:37.517830 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 635/1269] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:06:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:06:37.522296 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44201739-afc5-40c8-886f-289118936ce2 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:37.620484 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44201739-afc5-40c8-886f-289118936ce2 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:37.653999 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91bee2-1047-4a8f-ad9f-467a7e2cba72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:37.654645 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91bee2-1047-4a8f-ad9f-467a7e2cba72 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:37.654926 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91bee2-1047-4a8f-ad9f-467a7e2cba72 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:37.655198 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91bee2-1047-4a8f-ad9f-467a7e2cba72 None admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:37.655901 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab91bee2-1047-4a8f-ad9f-467a7e2cba72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:06:37.656230 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab91bee2-1047-4a8f-ad9f-467a7e2cba72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:37.657603 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab91bee2-1047-4a8f-ad9f-467a7e2cba72 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:37.668528 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 635/1270] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:06:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:06:37.674630 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07101c-cf30-4c42-9f2d-946dc0438d36 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:37.707933 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:37.775160 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07101c-cf30-4c42-9f2d-946dc0438d36 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:37.808889 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370e9eb-3696-4988-b307-850ff07583c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:37.810338 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370e9eb-3696-4988-b307-850ff07583c1 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:37.810612 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370e9eb-3696-4988-b307-850ff07583c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:37.810882 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370e9eb-3696-4988-b307-850ff07583c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:37.817562 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370e9eb-3696-4988-b307-850ff07583c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:37.818989 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370e9eb-3696-4988-b307-850ff07583c1 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:37.832947 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-9370e9eb-3696-4988-b307-850ff07583c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:06:37.832947 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:06:37.832947 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:06:37.832947 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:06:37.832947 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:06:37.832947 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:06:37.832947 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:06:37.832947 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:06:37.832947 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:06:37.832947 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:06:37.832947 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:06:37.832947 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:06:37.832947 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 13:06:37.832947 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 13:06:37.832947 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 13:06:37.834609 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 13:06:37.834609 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:06:37.834609 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:06:37.834609 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:06:37.834609 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:06:37.834609 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:06:37.834609 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:06:37.834609 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:06:37.834609 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:06:37.834609 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:06:37.834609 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:06:37.834609 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:06:37.834609 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:06:37.834609 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:06:37.834609 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:06:37.834609 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:06:37.834609 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:06:37.836660 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 13:06:37.836660 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 13:06:37.836660 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 13:06:37.836660 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 13:06:37.836660 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 13:06:37.836660 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 13:06:37.836660 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:06:37.836660 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:06:37.836660 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 636/1271] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:06:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:06:37.841454 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91bee2-1047-4a8f-ad9f-467a7e2cba72 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:37.902067 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:37.941755 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91bee2-1047-4a8f-ad9f-467a7e2cba72 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:37.974316 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d87dc-8b4e-4b99-b10d-9350749af77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:37.975019 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d87dc-8b4e-4b99-b10d-9350749af77e None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:37.975362 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d87dc-8b4e-4b99-b10d-9350749af77e None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:37.975644 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d87dc-8b4e-4b99-b10d-9350749af77e None admin] PATH_INFO: `/v3/projects` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:37.976704 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d87dc-8b4e-4b99-b10d-9350749af77e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:06:37.977014 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d87dc-8b4e-4b99-b10d-9350749af77e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:37.978448 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d87dc-8b4e-4b99-b10d-9350749af77e None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:37.990372 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 636/1272] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 13:06:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:06:37.996460 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370e9eb-3696-4988-b307-850ff07583c1 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:38.092432 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:38.101055 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370e9eb-3696-4988-b307-850ff07583c1 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:38.136256 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a9828a-7a0d-42a0-81bf-6ec2677cfe80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:38.137142 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9828a-7a0d-42a0-81bf-6ec2677cfe80 None admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:38.137453 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9828a-7a0d-42a0-81bf-6ec2677cfe80 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:38.137932 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9828a-7a0d-42a0-81bf-6ec2677cfe80 None admin] PATH_INFO: `/v3/projects/c8c0bf799c9f451b8167a646a5c82eda/users/a5c4ad16c9454b74ae8445b115cf0af4/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:38.139969 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a9828a-7a0d-42a0-81bf-6ec2677cfe80 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8c0bf799c9f451b8167a646a5c82eda, user_id=a5c4ad16c9454b74ae8445b115cf0af4, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:38.141508 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a9828a-7a0d-42a0-81bf-6ec2677cfe80 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:38.328238 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 637/1273] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jun 3 13:06:37 2022] PUT /identity/v3/projects/c8c0bf799c9f451b8167a646a5c82eda/users/a5c4ad16c9454b74ae8445b115cf0af4/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:06:40.643712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50c0a5-2226-4a8f-9ed8-1e86c12cf5df None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:40.644280 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50c0a5-2226-4a8f-9ed8-1e86c12cf5df None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:40.644280 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50c0a5-2226-4a8f-9ed8-1e86c12cf5df None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:40.645684 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 637/1274] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:06:40.651001 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e56d0-c389-411a-a39d-735de92dcb6c None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:40.651427 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e56d0-c389-411a-a39d-735de92dcb6c None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:40.651535 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e56d0-c389-411a-a39d-735de92dcb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:40.670089 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-414e56d0-c389-411a-a39d-735de92dcb6c None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:06:40.671279 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-414e56d0-c389-411a-a39d-735de92dcb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:06:40.740699 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 638/1275] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:06:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:06:40.764669 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50c0a5-2226-4a8f-9ed8-1e86c12cf5df None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:40.867511 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50c0a5-2226-4a8f-9ed8-1e86c12cf5df None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:40.884681 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:40.900907 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e2cb6-ca40-43dd-886d-d8a3fdeb780c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:40.901630 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e2cb6-ca40-43dd-886d-d8a3fdeb780c None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:40.901911 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e2cb6-ca40-43dd-886d-d8a3fdeb780c None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:40.902185 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e2cb6-ca40-43dd-886d-d8a3fdeb780c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:40.913160 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2e2cb6-ca40-43dd-886d-d8a3fdeb780c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 13:06:40.921905 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-db2e2cb6-ca40-43dd-886d-d8a3fdeb780c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:06:40.921905 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:06:40.921905 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:06:40.921905 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:06:40.921905 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:06:40.921905 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:06:40.921905 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:06:40.921905 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:06:40.921905 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:06:40.921905 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:06:40.921905 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:06:40.921905 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:06:40.921905 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 13:06:40.921905 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 13:06:40.921905 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 13:06:40.921905 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 13:06:40.923094 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 13:06:40.923094 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 13:06:40.923094 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 13:06:40.923094 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 13:06:40.923094 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:06:40.923094 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:06:40.923094 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:06:40.923094 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:06:40.923094 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:06:40.923094 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:06:40.923094 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:06:40.923094 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:06:40.923094 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:06:40.923094 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:06:40.923094 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:06:40.923094 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:06:40.923954 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:06:40.923954 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:06:40.923954 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:06:40.923954 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:06:40.923954 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 13:06:40.923954 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 13:06:40.923954 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 13:06:40.923954 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 13:06:40.923954 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 13:06:40.923954 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 13:06:40.923954 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 13:06:40.923954 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:06:40.923954 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 638/1276] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jun 3 13:06:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:06:40.929162 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e56d0-c389-411a-a39d-735de92dcb6c None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:41.011738 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:41.030217 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e56d0-c389-411a-a39d-735de92dcb6c None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:41.065067 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d5f31-25ad-4bcd-a057-f86c585bfbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:41.065734 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d5f31-25ad-4bcd-a057-f86c585bfbc6 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:41.066018 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d5f31-25ad-4bcd-a057-f86c585bfbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:41.066345 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d5f31-25ad-4bcd-a057-f86c585bfbc6 None admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:41.067058 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d5f31-25ad-4bcd-a057-f86c585bfbc6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:06:41.067366 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d5f31-25ad-4bcd-a057-f86c585bfbc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:41.068811 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d5f31-25ad-4bcd-a057-f86c585bfbc6 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:41.077129 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 639/1277] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jun 3 13:06:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:06:41.082915 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e2cb6-ca40-43dd-886d-d8a3fdeb780c None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:41.232708 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e2cb6-ca40-43dd-886d-d8a3fdeb780c None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:41.268881 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb21163-6653-47b5-8140-7b34e629d4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:41.269727 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb21163-6653-47b5-8140-7b34e629d4ef None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:41.269983 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb21163-6653-47b5-8140-7b34e629d4ef None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:41.270303 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb21163-6653-47b5-8140-7b34e629d4ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:41.282175 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb21163-6653-47b5-8140-7b34e629d4ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:41.283748 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb21163-6653-47b5-8140-7b34e629d4ef None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:41.301894 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-2cb21163-6653-47b5-8140-7b34e629d4ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:06:41.301894 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:06:41.301894 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:06:41.301894 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:06:41.301894 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:06:41.301894 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:06:41.301894 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:06:41.301894 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:06:41.301894 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:06:41.301894 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:06:41.301894 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:06:41.301894 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:06:41.301894 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:06:41.301894 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:06:41.301894 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:06:41.303021 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:06:41.303021 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:06:41.303021 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:06:41.303021 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:06:41.303021 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:06:41.303021 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:06:41.303021 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:06:41.303021 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:06:41.303021 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:06:41.303021 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:06:41.303021 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:06:41.303021 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:06:41.303021 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:06:41.303021 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:06:41.303021 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:06:41.303021 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:06:41.303021 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:06:41.304157 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:06:41.304157 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:06:41.304157 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:06:41.304157 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:06:41.304157 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 639/1278] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:06:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:06:41.309019 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d5f31-25ad-4bcd-a057-f86c585bfbc6 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:41.424720 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d5f31-25ad-4bcd-a057-f86c585bfbc6 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:41.460540 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c80da2-5d58-4a4a-b609-f1f0407822e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:41.461202 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c80da2-5d58-4a4a-b609-f1f0407822e4 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:41.461486 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c80da2-5d58-4a4a-b609-f1f0407822e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:41.461757 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c80da2-5d58-4a4a-b609-f1f0407822e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:41.462478 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c80da2-5d58-4a4a-b609-f1f0407822e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:06:41.462786 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c80da2-5d58-4a4a-b609-f1f0407822e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:41.464228 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c80da2-5d58-4a4a-b609-f1f0407822e4 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:41.477077 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 640/1279] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:06:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:06:41.484354 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb21163-6653-47b5-8140-7b34e629d4ef None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:41.519069 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:41.594010 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb21163-6653-47b5-8140-7b34e629d4ef None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:41.638307 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b017fc4-9eae-462e-8705-96ec1407d3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:41.639522 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b017fc4-9eae-462e-8705-96ec1407d3da None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:41.639806 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b017fc4-9eae-462e-8705-96ec1407d3da None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:41.640084 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b017fc4-9eae-462e-8705-96ec1407d3da None admin] PATH_INFO: `/v3/users/placement` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:41.648672 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b017fc4-9eae-462e-8705-96ec1407d3da None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:41.650093 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b017fc4-9eae-462e-8705-96ec1407d3da None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:41.664712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-7b017fc4-9eae-462e-8705-96ec1407d3da None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 03 13:06:41.664712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:06:41.664712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:06:41.664712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:06:41.664712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:06:41.664712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:06:41.664712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:06:41.664712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:06:41.664712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:06:41.664712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:06:41.664712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:06:41.664712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:06:41.664712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 13:06:41.664712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 13:06:41.664712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 13:06:41.664712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 13:06:41.665822 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:06:41.665822 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:06:41.665822 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 13:06:41.665822 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:06:41.665822 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 13:06:41.665822 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 13:06:41.665822 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:06:41.665822 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:06:41.665822 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:06:41.665822 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:06:41.665822 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:06:41.665822 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:06:41.665822 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:06:41.665822 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:06:41.665822 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:06:41.665822 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:06:41.665822 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:06:41.665822 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:06:41.667051 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:06:41.667051 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:06:41.667051 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 13:06:41.667051 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 13:06:41.667051 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 13:06:41.667051 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 13:06:41.667051 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 13:06:41.667051 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 13:06:41.667051 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 03 13:06:41.667051 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:06:41.667051 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 640/1280] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:06:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:06:41.671958 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c80da2-5d58-4a4a-b609-f1f0407822e4 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:41.675788 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:41.808252 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c80da2-5d58-4a4a-b609-f1f0407822e4 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:41.842091 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c3abca-979f-4781-a6f1-38cf2a6b7a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:41.842755 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3abca-979f-4781-a6f1-38cf2a6b7a57 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:41.843043 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3abca-979f-4781-a6f1-38cf2a6b7a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:41.843321 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3abca-979f-4781-a6f1-38cf2a6b7a57 None admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:41.844172 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c3abca-979f-4781-a6f1-38cf2a6b7a57 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:06:41.844515 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c3abca-979f-4781-a6f1-38cf2a6b7a57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:41.846005 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c3abca-979f-4781-a6f1-38cf2a6b7a57 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:41.864662 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 641/1281] 10.222.0.61 () {56 vars in 1143 bytes} [Fri Jun 3 13:06:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:06:41.870511 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b017fc4-9eae-462e-8705-96ec1407d3da None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:41.962980 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:41.973687 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b017fc4-9eae-462e-8705-96ec1407d3da None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:42.009002 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369696e-2f8d-4192-938b-d4e3e83d9bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:42.009642 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369696e-2f8d-4192-938b-d4e3e83d9bff None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:42.009929 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369696e-2f8d-4192-938b-d4e3e83d9bff None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:42.010208 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369696e-2f8d-4192-938b-d4e3e83d9bff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:42.077170 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369696e-2f8d-4192-938b-d4e3e83d9bff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:42.078563 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369696e-2f8d-4192-938b-d4e3e83d9bff None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:42.165616 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:42.176001 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 641/1282] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jun 3 13:06:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 13:06:42.181789 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c3abca-979f-4781-a6f1-38cf2a6b7a57 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:42.244083 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:42.319284 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c3abca-979f-4781-a6f1-38cf2a6b7a57 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:42.353710 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a577527-405f-4480-ad7d-324c3bbee979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:42.354427 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a577527-405f-4480-ad7d-324c3bbee979 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:42.354710 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a577527-405f-4480-ad7d-324c3bbee979 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:42.354984 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a577527-405f-4480-ad7d-324c3bbee979 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:42.366671 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a577527-405f-4480-ad7d-324c3bbee979 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:42.368113 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a577527-405f-4480-ad7d-324c3bbee979 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:42.385091 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-4a577527-405f-4480-ad7d-324c3bbee979 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:06:42.385091 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:06:42.385091 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:06:42.385091 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:06:42.385091 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:06:42.385091 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:06:42.385091 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:06:42.385091 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:06:42.385091 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:06:42.385091 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:06:42.385091 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:06:42.385091 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:06:42.385091 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 13:06:42.385091 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 13:06:42.385091 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 13:06:42.386103 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 13:06:42.386103 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:06:42.386103 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:06:42.386103 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:06:42.386103 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:06:42.386103 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:06:42.386103 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:06:42.386103 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:06:42.386103 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:06:42.386103 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:06:42.386103 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:06:42.386103 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:06:42.386103 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:06:42.386103 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:06:42.386103 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:06:42.386103 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:06:42.386103 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:06:42.387009 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 13:06:42.387009 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 13:06:42.387009 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 13:06:42.387009 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:06:42.387009 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 642/1283] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:06:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:06:42.392209 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369696e-2f8d-4192-938b-d4e3e83d9bff None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:42.490085 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369696e-2f8d-4192-938b-d4e3e83d9bff None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:42.522481 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd19a91-21db-4fa5-86a8-17518f17901f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:42.523125 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd19a91-21db-4fa5-86a8-17518f17901f None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:42.523404 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd19a91-21db-4fa5-86a8-17518f17901f None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:42.523669 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd19a91-21db-4fa5-86a8-17518f17901f None admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:42.524394 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd19a91-21db-4fa5-86a8-17518f17901f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:06:42.524694 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd19a91-21db-4fa5-86a8-17518f17901f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:42.526033 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd19a91-21db-4fa5-86a8-17518f17901f None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:42.537527 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 642/1284] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jun 3 13:06:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:06:42.543250 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a577527-405f-4480-ad7d-324c3bbee979 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:42.643526 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a577527-405f-4480-ad7d-324c3bbee979 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:42.657840 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:42.686330 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2021580-a9a7-42bc-888e-24f54e19ce5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:42.687119 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2021580-a9a7-42bc-888e-24f54e19ce5f None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:42.687398 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2021580-a9a7-42bc-888e-24f54e19ce5f None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:42.687666 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2021580-a9a7-42bc-888e-24f54e19ce5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:42.696461 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2021580-a9a7-42bc-888e-24f54e19ce5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:42.697902 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2021580-a9a7-42bc-888e-24f54e19ce5f None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:42.712608 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application [None req-e2021580-a9a7-42bc-888e-24f54e19ce5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:06:42.712608 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:06:42.712608 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:06:42.712608 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:06:42.712608 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:06:42.712608 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:06:42.712608 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:06:42.712608 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:06:42.712608 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:06:42.712608 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:06:42.712608 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:06:42.712608 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:06:42.712608 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 13:06:42.712608 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 13:06:42.712608 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 13:06:42.713663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 13:06:42.713663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:06:42.713663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:06:42.713663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:06:42.713663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:06:42.713663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:06:42.713663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:06:42.713663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:06:42.713663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application with Lock( Jun 03 13:06:42.713663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:06:42.713663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:06:42.713663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:06:42.713663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:06:42.713663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:06:42.713663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:06:42.713663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:06:42.713663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:06:42.714814 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 13:06:42.714814 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 13:06:42.714814 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 13:06:42.714814 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 13:06:42.714814 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 13:06:42.714814 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 13:06:42.714814 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 13:06:42.714814 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: ERROR keystone.server.flask.application Jun 03 13:06:42.714814 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 643/1285] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jun 3 13:06:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:06:42.720552 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd19a91-21db-4fa5-86a8-17518f17901f None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:42.772106 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:42.820631 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd19a91-21db-4fa5-86a8-17518f17901f None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:42.853450 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d3a18-dfee-42c1-bd42-4ddf03e76e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:42.854163 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d3a18-dfee-42c1-bd42-4ddf03e76e56 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:42.854455 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d3a18-dfee-42c1-bd42-4ddf03e76e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:42.854908 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d3a18-dfee-42c1-bd42-4ddf03e76e56 None admin] PATH_INFO: `/v3/projects` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:42.856823 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d3a18-dfee-42c1-bd42-4ddf03e76e56 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:06:42.857128 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d3a18-dfee-42c1-bd42-4ddf03e76e56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:42.858560 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d3a18-dfee-42c1-bd42-4ddf03e76e56 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:42.870781 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 643/1286] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jun 3 13:06:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:06:42.877666 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2021580-a9a7-42bc-888e-24f54e19ce5f None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:42.978578 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2021580-a9a7-42bc-888e-24f54e19ce5f None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:43.013665 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731df53-3371-49d3-8bd1-06e814daf951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:43.014342 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731df53-3371-49d3-8bd1-06e814daf951 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:43.014627 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731df53-3371-49d3-8bd1-06e814daf951 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:43.014902 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731df53-3371-49d3-8bd1-06e814daf951 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:43.015724 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6731df53-3371-49d3-8bd1-06e814daf951 None admin] RBAC: Adding query filter params (role.id=bbd5f3e0c18e4992886fcfb4a3feb426, scope.project.id=c8c0bf799c9f451b8167a646a5c82eda, user.id=a5c4ad16c9454b74ae8445b115cf0af4) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:06:43.016036 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6731df53-3371-49d3-8bd1-06e814daf951 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:43.017504 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6731df53-3371-49d3-8bd1-06e814daf951 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:43.023242 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 644/1287] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jun 3 13:06:42 2022] GET /identity/v3/role_assignments?user.id=a5c4ad16c9454b74ae8445b115cf0af4&scope.project.id=c8c0bf799c9f451b8167a646a5c82eda&role.id=bbd5f3e0c18e4992886fcfb4a3feb426 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:06:45.326903 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6126612-f901-4486-883b-465d5cf632a4 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:45.327426 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6126612-f901-4486-883b-465d5cf632a4 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:45.327426 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6126612-f901-4486-883b-465d5cf632a4 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:45.328755 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 644/1288] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:06:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:06:45.334055 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b368a77-89b0-4d47-ba67-7dc37cdce556 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:45.334433 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b368a77-89b0-4d47-ba67-7dc37cdce556 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:45.334615 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b368a77-89b0-4d47-ba67-7dc37cdce556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:45.351435 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-2b368a77-89b0-4d47-ba67-7dc37cdce556 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:06:45.352650 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-2b368a77-89b0-4d47-ba67-7dc37cdce556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:06:45.381422 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:45.417671 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 645/1289] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:06:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:06:45.440020 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6126612-f901-4486-883b-465d5cf632a4 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:45.541152 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6126612-f901-4486-883b-465d5cf632a4 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:45.552368 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:45.575517 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666b3b3-b42b-45fc-ba25-478923ead862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:45.576517 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666b3b3-b42b-45fc-ba25-478923ead862 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:45.576803 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666b3b3-b42b-45fc-ba25-478923ead862 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:45.577126 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666b3b3-b42b-45fc-ba25-478923ead862 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:45.577726 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4666b3b3-b42b-45fc-ba25-478923ead862 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:45.579078 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4666b3b3-b42b-45fc-ba25-478923ead862 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:45.592407 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-4666b3b3-b42b-45fc-ba25-478923ead862 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 13:06:45.592407 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:06:45.592407 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 13:06:45.592407 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 13:06:45.592407 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 13:06:45.592407 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 13:06:45.592407 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 13:06:45.592407 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:06:45.592407 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 13:06:45.592407 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:06:45.592407 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 13:06:45.592407 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:06:45.592407 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:06:45.592407 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:06:45.592407 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:06:45.592407 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:06:45.592407 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:06:45.610757 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:06:45.610757 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:06:45.610757 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:06:45.610757 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:06:45.610757 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:06:45.610757 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:06:45.610757 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 13:06:45.610757 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 13:06:45.610757 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 13:06:45.610757 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 13:06:45.610757 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:06:45.610757 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:06:45.610757 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:06:45.610757 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:06:45.610757 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:06:45.610757 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:06:45.611647 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:06:45.611647 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:06:45.611647 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:06:45.611647 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:06:45.611647 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:06:45.611647 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:06:45.611647 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:06:45.611647 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:06:45.611647 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:06:45.611647 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:06:45.611647 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 13:06:45.611647 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:06:45.611647 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 13:06:45.611647 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:06:45.611647 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 645/1290] 10.222.0.61 () {56 vars in 1117 bytes} [Fri Jun 3 13:06:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:06:45.612562 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b368a77-89b0-4d47-ba67-7dc37cdce556 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:45.705953 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b368a77-89b0-4d47-ba67-7dc37cdce556 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:45.753287 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb34c09-cf9e-41cf-9228-f8d42577bc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:45.753946 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb34c09-cf9e-41cf-9228-f8d42577bc58 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:45.754226 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb34c09-cf9e-41cf-9228-f8d42577bc58 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:45.754500 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb34c09-cf9e-41cf-9228-f8d42577bc58 None admin] PATH_INFO: `/v3/services` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:45.755200 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb34c09-cf9e-41cf-9228-f8d42577bc58 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:06:45.755504 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb34c09-cf9e-41cf-9228-f8d42577bc58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:45.756899 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb34c09-cf9e-41cf-9228-f8d42577bc58 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:45.761649 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 646/1291] 10.222.0.61 () {56 vars in 1116 bytes} [Fri Jun 3 13:06:45 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:06:45.767712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666b3b3-b42b-45fc-ba25-478923ead862 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:45.866963 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666b3b3-b42b-45fc-ba25-478923ead862 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:45.899199 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd3dbc2-09cd-4a17-8596-ab7a02e305ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:45.899846 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3dbc2-09cd-4a17-8596-ab7a02e305ef None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:45.900124 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3dbc2-09cd-4a17-8596-ab7a02e305ef None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:45.900427 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3dbc2-09cd-4a17-8596-ab7a02e305ef None admin] PATH_INFO: `/v3/services` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:45.901117 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd3dbc2-09cd-4a17-8596-ab7a02e305ef None admin] RBAC: Adding query filter params (type=placement) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:06:45.901416 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd3dbc2-09cd-4a17-8596-ab7a02e305ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:45.902769 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd3dbc2-09cd-4a17-8596-ab7a02e305ef None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:45.907456 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 646/1292] 10.222.0.61 () {56 vars in 1116 bytes} [Fri Jun 3 13:06:45 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:06:48.147184 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca5745-8867-492c-8522-0f2ab8621307 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:48.147740 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca5745-8867-492c-8522-0f2ab8621307 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:48.147740 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca5745-8867-492c-8522-0f2ab8621307 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:48.149139 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 647/1293] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:06:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:06:48.154777 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3a201-1435-405a-8a6c-e19bdedbf3d8 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:48.155254 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3a201-1435-405a-8a6c-e19bdedbf3d8 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:48.155424 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3a201-1435-405a-8a6c-e19bdedbf3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:48.172528 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-f5a3a201-1435-405a-8a6c-e19bdedbf3d8 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:06:48.173697 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-f5a3a201-1435-405a-8a6c-e19bdedbf3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:06:48.203642 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:48.241713 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 647/1294] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:06:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:06:48.265383 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca5745-8867-492c-8522-0f2ab8621307 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:48.296556 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:48.365967 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca5745-8867-492c-8522-0f2ab8621307 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:48.405110 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b3397f-8110-4758-b83b-86032080a9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:48.405808 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3397f-8110-4758-b83b-86032080a9f6 None admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:48.406124 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3397f-8110-4758-b83b-86032080a9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:48.406441 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3397f-8110-4758-b83b-86032080a9f6 None admin] PATH_INFO: `/v3/services` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:48.407270 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b3397f-8110-4758-b83b-86032080a9f6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:48.408762 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b3397f-8110-4758-b83b-86032080a9f6 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:48.485638 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 648/1295] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Jun 3 13:06:48 2022] POST /identity/v3/services => generated 246 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:06:50.721502 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad43d2-dc5b-41a5-b8e1-b5a13fe9bfd7 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:50.722048 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad43d2-dc5b-41a5-b8e1-b5a13fe9bfd7 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:50.722048 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad43d2-dc5b-41a5-b8e1-b5a13fe9bfd7 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:50.723408 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 648/1296] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:06:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:06:50.728861 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a52c7-0449-42c9-a756-f0981fdeb9de None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:50.729286 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a52c7-0449-42c9-a756-f0981fdeb9de None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:50.729419 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a52c7-0449-42c9-a756-f0981fdeb9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:50.747103 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-ff3a52c7-0449-42c9-a756-f0981fdeb9de None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:06:50.748564 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-ff3a52c7-0449-42c9-a756-f0981fdeb9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:06:50.819768 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 649/1297] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:06:50 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:06:50.843371 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad43d2-dc5b-41a5-b8e1-b5a13fe9bfd7 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:50.944719 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad43d2-dc5b-41a5-b8e1-b5a13fe9bfd7 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:50.979420 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd34f4-9ba9-46f7-b99b-2e38d90d41c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:50.980258 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd34f4-9ba9-46f7-b99b-2e38d90d41c2 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:50.980540 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd34f4-9ba9-46f7-b99b-2e38d90d41c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:50.980807 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd34f4-9ba9-46f7-b99b-2e38d90d41c2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:50.981743 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd34f4-9ba9-46f7-b99b-2e38d90d41c2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:50.983132 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd34f4-9ba9-46f7-b99b-2e38d90d41c2 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:50.995024 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-71cd34f4-9ba9-46f7-b99b-2e38d90d41c2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 13:06:50.995024 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:06:50.995024 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 13:06:50.995024 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 13:06:50.995024 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 13:06:50.995024 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 13:06:50.995024 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 13:06:50.995024 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:06:50.995024 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 13:06:50.995024 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:06:50.995024 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 13:06:50.995024 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:06:50.995024 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:06:50.995024 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:06:50.995024 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:06:50.995024 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:06:50.995024 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:06:50.996344 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:06:50.996344 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:06:50.996344 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:06:50.996344 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:06:50.996344 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:06:50.996344 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:06:50.996344 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 13:06:50.996344 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 13:06:50.996344 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 13:06:50.996344 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 13:06:50.996344 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:06:50.996344 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:06:50.996344 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:06:50.996344 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:06:50.996344 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:06:50.996344 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:06:51.002152 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:06:51.002152 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:06:51.002152 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:06:51.002152 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:06:51.002152 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:06:51.002152 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:06:51.002152 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:06:51.002152 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:06:51.002152 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:06:51.002152 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:06:51.002152 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 13:06:51.002152 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:06:51.002152 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 13:06:51.002152 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:06:51.002152 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 649/1298] 10.222.0.61 () {56 vars in 1117 bytes} [Fri Jun 3 13:06:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:06:51.003772 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a52c7-0449-42c9-a756-f0981fdeb9de None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:51.021152 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:51.098424 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a52c7-0449-42c9-a756-f0981fdeb9de None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:51.130881 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab935791-15f0-493a-b04a-69a1ece138a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:51.131536 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab935791-15f0-493a-b04a-69a1ece138a4 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:51.131820 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab935791-15f0-493a-b04a-69a1ece138a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:51.132098 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab935791-15f0-493a-b04a-69a1ece138a4 None admin] PATH_INFO: `/v3/services` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:51.132826 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab935791-15f0-493a-b04a-69a1ece138a4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:06:51.133130 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab935791-15f0-493a-b04a-69a1ece138a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:51.134491 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab935791-15f0-493a-b04a-69a1ece138a4 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:51.140004 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 650/1299] 10.222.0.61 () {56 vars in 1116 bytes} [Fri Jun 3 13:06:51 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:06:51.146102 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd34f4-9ba9-46f7-b99b-2e38d90d41c2 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:51.177969 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:51.244226 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd34f4-9ba9-46f7-b99b-2e38d90d41c2 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:51.277354 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89927f0d-1957-45a6-a27d-546acbf5e10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:51.278133 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89927f0d-1957-45a6-a27d-546acbf5e10f None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:51.278509 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89927f0d-1957-45a6-a27d-546acbf5e10f None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:51.278790 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89927f0d-1957-45a6-a27d-546acbf5e10f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:51.279583 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89927f0d-1957-45a6-a27d-546acbf5e10f None admin] RBAC: Adding query filter params (interface=public, service_id=e79128bfa8ef481ca43e05ec3c1229f5, region_id=RegionOne) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:06:51.279887 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89927f0d-1957-45a6-a27d-546acbf5e10f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:51.281263 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89927f0d-1957-45a6-a27d-546acbf5e10f None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:51.286196 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 650/1300] 10.222.0.61 () {56 vars in 1251 bytes} [Fri Jun 3 13:06:51 2022] GET /identity/v3/endpoints?service_id=e79128bfa8ef481ca43e05ec3c1229f5&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:06:51.291933 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab935791-15f0-493a-b04a-69a1ece138a4 None admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:51.372158 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:51.390539 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab935791-15f0-493a-b04a-69a1ece138a4 None admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:51.424988 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be5aa0-0ef8-4ce9-b707-bac897315739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:51.425643 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be5aa0-0ef8-4ce9-b707-bac897315739 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:51.425924 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be5aa0-0ef8-4ce9-b707-bac897315739 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:51.426259 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be5aa0-0ef8-4ce9-b707-bac897315739 None admin] PATH_INFO: `/v3/services` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:51.426873 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4be5aa0-0ef8-4ce9-b707-bac897315739 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:51.428272 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4be5aa0-0ef8-4ce9-b707-bac897315739 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:51.435786 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 651/1301] 10.222.0.61 () {56 vars in 1087 bytes} [Fri Jun 3 13:06:51 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:06:53.696700 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d81ca-0e19-4dfa-88c3-8254651e27e1 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:53.697262 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d81ca-0e19-4dfa-88c3-8254651e27e1 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:53.697262 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d81ca-0e19-4dfa-88c3-8254651e27e1 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:53.698615 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 651/1302] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:06:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:06:53.703955 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04bf86-df14-414c-b267-20e76a7454bc None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:53.704416 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04bf86-df14-414c-b267-20e76a7454bc None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:53.706269 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04bf86-df14-414c-b267-20e76a7454bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:53.721709 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-6f04bf86-df14-414c-b267-20e76a7454bc None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:06:53.722877 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-6f04bf86-df14-414c-b267-20e76a7454bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:06:53.787961 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 652/1303] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:06:53 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 13:06:53.811398 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d81ca-0e19-4dfa-88c3-8254651e27e1 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:53.906684 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:53.913306 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d81ca-0e19-4dfa-88c3-8254651e27e1 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:53.946769 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5908291-2cf7-482c-86f4-d0b9069ea147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:53.947488 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5908291-2cf7-482c-86f4-d0b9069ea147 None admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:53.947771 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5908291-2cf7-482c-86f4-d0b9069ea147 None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:53.948046 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5908291-2cf7-482c-86f4-d0b9069ea147 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:53.948721 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5908291-2cf7-482c-86f4-d0b9069ea147 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:53.950202 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5908291-2cf7-482c-86f4-d0b9069ea147 None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:53.962516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application [None req-b5908291-2cf7-482c-86f4-d0b9069ea147 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 13:06:53.962516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:06:53.962516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 13:06:53.962516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 13:06:53.962516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 13:06:53.962516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 13:06:53.962516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 13:06:53.962516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:06:53.962516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 13:06:53.962516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:06:53.962516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 13:06:53.962516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:06:53.962516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 13:06:53.962516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 13:06:53.962516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 13:06:53.962516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 13:06:53.962516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 13:06:53.967612 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 13:06:53.967612 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 13:06:53.967612 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 13:06:53.967612 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 13:06:53.967612 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 13:06:53.967612 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 13:06:53.967612 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 13:06:53.967612 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 13:06:53.967612 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 13:06:53.967612 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 13:06:53.967612 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 13:06:53.967612 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 13:06:53.967612 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 13:06:53.967612 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 13:06:53.967612 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 13:06:53.967612 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 13:06:53.968785 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 13:06:53.968785 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application with Lock( Jun 03 13:06:53.968785 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 13:06:53.968785 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self._enter() Jun 03 13:06:53.968785 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 13:06:53.968785 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 13:06:53.968785 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 13:06:53.968785 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application return self.creator() Jun 03 13:06:53.968785 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 13:06:53.968785 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application created_value = creator( Jun 03 13:06:53.968785 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 13:06:53.968785 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 13:06:53.968785 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 13:06:53.968785 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: ERROR keystone.server.flask.application Jun 03 13:06:53.968785 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 652/1304] 10.222.0.61 () {56 vars in 1117 bytes} [Fri Jun 3 13:06:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 13:06:53.969926 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f04bf86-df14-414c-b267-20e76a7454bc None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:54.046513 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:54.069006 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f04bf86-df14-414c-b267-20e76a7454bc None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:54.102669 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086465fa-bbf6-4fb2-9869-ae8ba94974f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:54.103316 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086465fa-bbf6-4fb2-9869-ae8ba94974f5 None admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:54.103678 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086465fa-bbf6-4fb2-9869-ae8ba94974f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:54.103952 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086465fa-bbf6-4fb2-9869-ae8ba94974f5 None admin] PATH_INFO: `/v3/services` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:54.104683 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086465fa-bbf6-4fb2-9869-ae8ba94974f5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:06:54.106491 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086465fa-bbf6-4fb2-9869-ae8ba94974f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:54.107073 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086465fa-bbf6-4fb2-9869-ae8ba94974f5 None admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:54.112105 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 653/1305] 10.222.0.61 () {56 vars in 1116 bytes} [Fri Jun 3 13:06:53 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:06:54.118094 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5908291-2cf7-482c-86f4-d0b9069ea147 None admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:06:54.213998 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5908291-2cf7-482c-86f4-d0b9069ea147 None admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:06:54.247750 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce8407-1fd3-4550-a8f3-689c6c9a9c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:06:54.248438 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce8407-1fd3-4550-a8f3-689c6c9a9c5d None admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:06:54.248722 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce8407-1fd3-4550-a8f3-689c6c9a9c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:06:54.248996 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce8407-1fd3-4550-a8f3-689c6c9a9c5d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:06:54.249735 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce8407-1fd3-4550-a8f3-689c6c9a9c5d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:06:54.251085 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce8407-1fd3-4550-a8f3-689c6c9a9c5d None admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:06:54.333346 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 653/1306] 10.222.0.61 () {60 vars in 1144 bytes} [Fri Jun 3 13:06:54 2022] POST /identity/v3/endpoints => generated 331 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:07:04.136589 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=30 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:07:04.329446 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:13:17.746035 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5d0b5-6ea8-4293-ac93-ab6d60a9676a None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:17.746508 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5d0b5-6ea8-4293-ac93-ab6d60a9676a None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:17.746605 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5d0b5-6ea8-4293-ac93-ab6d60a9676a None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:17.751856 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 654/1307] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:13:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:13:17.753392 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ec09e-45a7-4a06-82a7-bb757ecde488 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:17.753831 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ec09e-45a7-4a06-82a7-bb757ecde488 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:17.753972 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ec09e-45a7-4a06-82a7-bb757ecde488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:17.851892 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-259ec09e-45a7-4a06-82a7-bb757ecde488 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:13:17.854045 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-259ec09e-45a7-4a06-82a7-bb757ecde488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:17.995712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 654/1308] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:13:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:13:18.038967 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff80215-fdce-4d6b-82d3-c5e2f5a96ba3 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:18.039193 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff80215-fdce-4d6b-82d3-c5e2f5a96ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:18.039469 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff80215-fdce-4d6b-82d3-c5e2f5a96ba3 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:18.042084 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 655/1309] 10.222.0.61 () {54 vars in 964 bytes} [Fri Jun 3 13:13:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:13:18.050105 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9e835-27f6-430b-99ee-15334e91fb7e None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:18.050473 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9e835-27f6-430b-99ee-15334e91fb7e None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:18.050891 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9e835-27f6-430b-99ee-15334e91fb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:18.216532 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-55c9e835-27f6-430b-99ee-15334e91fb7e None None] MFA Rules not processed for user `bdb5b24bd01c405c93e32ab4b329bcf1`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:13:18.219801 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-55c9e835-27f6-430b-99ee-15334e91fb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:18.261196 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:13:18.333827 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 655/1310] 10.222.0.61 () {58 vars in 1061 bytes} [Fri Jun 3 13:13:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:13:18.343434 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff80215-fdce-4d6b-82d3-c5e2f5a96ba3 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:18.345203 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-4ff80215-fdce-4d6b-82d3-c5e2f5a96ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:18.463208 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff80215-fdce-4d6b-82d3-c5e2f5a96ba3 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:18.547520 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ca3db-d221-4672-940d-d34b0570dd76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:18.548086 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ca3db-d221-4672-940d-d34b0570dd76 service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:18.548389 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ca3db-d221-4672-940d-d34b0570dd76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:18.548662 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ca3db-d221-4672-940d-d34b0570dd76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:18.550299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-175ca3db-d221-4672-940d-d34b0570dd76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:18.615423 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:13:18.674983 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ca3db-d221-4672-940d-d34b0570dd76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:18.677545 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ca3db-d221-4672-940d-d34b0570dd76 service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:18.700830 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 656/1311] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:13:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:13:21.482001 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4bfa1-1aea-4eb0-b6ad-de3ff1acad54 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:21.482556 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4bfa1-1aea-4eb0-b6ad-de3ff1acad54 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:21.482556 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4bfa1-1aea-4eb0-b6ad-de3ff1acad54 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:21.484367 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 656/1312] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:13:21.489542 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686302d6-9bec-4845-9e68-f08f86d3553f None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:21.489935 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686302d6-9bec-4845-9e68-f08f86d3553f None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:21.490112 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686302d6-9bec-4845-9e68-f08f86d3553f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:21.566976 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-686302d6-9bec-4845-9e68-f08f86d3553f None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:13:21.568436 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-686302d6-9bec-4845-9e68-f08f86d3553f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:21.676272 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 657/1313] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:13:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:13:21.711482 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f4bfa1-1aea-4eb0-b6ad-de3ff1acad54 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:21.713553 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-f7f4bfa1-1aea-4eb0-b6ad-de3ff1acad54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:21.831686 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f4bfa1-1aea-4eb0-b6ad-de3ff1acad54 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:21.910144 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:13:21.913261 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93943697-043a-4ff1-a4ea-dbc0155602ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:21.913916 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93943697-043a-4ff1-a4ea-dbc0155602ea service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:21.914206 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93943697-043a-4ff1-a4ea-dbc0155602ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:21.914481 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93943697-043a-4ff1-a4ea-dbc0155602ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:21.917190 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-93943697-043a-4ff1-a4ea-dbc0155602ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:22.037795 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93943697-043a-4ff1-a4ea-dbc0155602ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:22.039228 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93943697-043a-4ff1-a4ea-dbc0155602ea service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:22.059428 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 657/1314] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:13:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:13:24.885470 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e5fc0-b2a7-4041-bdc8-9df96a929bf5 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:24.886011 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e5fc0-b2a7-4041-bdc8-9df96a929bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:24.886130 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e5fc0-b2a7-4041-bdc8-9df96a929bf5 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:24.887455 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 658/1315] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:13:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:13:24.892931 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ac13c-d7c3-49d0-9555-65854b10e9b1 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:24.893326 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ac13c-d7c3-49d0-9555-65854b10e9b1 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:24.893479 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ac13c-d7c3-49d0-9555-65854b10e9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:24.956965 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-6f3ac13c-d7c3-49d0-9555-65854b10e9b1 None None] MFA Rules not processed for user `dd10501b4efc4e1584a8886555a4f00a`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:13:24.958157 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-6f3ac13c-d7c3-49d0-9555-65854b10e9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:25.012096 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:13:25.056416 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 658/1316] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:13:24 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:13:25.096528 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e5fc0-b2a7-4041-bdc8-9df96a929bf5 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:25.098042 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-fd5e5fc0-b2a7-4041-bdc8-9df96a929bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:25.107712 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:13:25.200762 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e5fc0-b2a7-4041-bdc8-9df96a929bf5 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:25.271720 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108e532-899b-45ef-b558-97ef18ed180e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:25.272388 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108e532-899b-45ef-b558-97ef18ed180e service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:25.272673 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108e532-899b-45ef-b558-97ef18ed180e service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:25.272948 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108e532-899b-45ef-b558-97ef18ed180e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:25.275153 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-e108e532-899b-45ef-b558-97ef18ed180e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:25.336560 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:13:25.382991 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e108e532-899b-45ef-b558-97ef18ed180e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:25.384552 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e108e532-899b-45ef-b558-97ef18ed180e service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:25.403542 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 659/1317] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:13:25 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:13:28.433681 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fc439-0921-4c2d-b09a-a46517dd2a55 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:28.434227 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fc439-0921-4c2d-b09a-a46517dd2a55 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:28.434227 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fc439-0921-4c2d-b09a-a46517dd2a55 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:28.435522 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 659/1318] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:13:28.440896 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896e1f0-1751-46fe-977e-2de0773d5a0c None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:28.441345 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896e1f0-1751-46fe-977e-2de0773d5a0c None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:28.441452 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896e1f0-1751-46fe-977e-2de0773d5a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:28.505216 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-5896e1f0-1751-46fe-977e-2de0773d5a0c None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:13:28.506411 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-5896e1f0-1751-46fe-977e-2de0773d5a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:28.600122 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 660/1319] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:13:28 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:13:28.654743 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7dd82a-8f7a-43f2-84d9-d880cc8eef13 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:28.655036 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7dd82a-8f7a-43f2-84d9-d880cc8eef13 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:28.655320 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7dd82a-8f7a-43f2-84d9-d880cc8eef13 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:28.656749 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 660/1320] 10.222.0.61 () {54 vars in 964 bytes} [Fri Jun 3 13:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:13:28.662429 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad55b9-b945-4399-b79e-85ecd2fda810 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:28.662721 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad55b9-b945-4399-b79e-85ecd2fda810 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:28.663000 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad55b9-b945-4399-b79e-85ecd2fda810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:28.685539 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:13:28.739667 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-5fad55b9-b945-4399-b79e-85ecd2fda810 None None] MFA Rules not processed for user `bdb5b24bd01c405c93e32ab4b329bcf1`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:13:28.740899 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-5fad55b9-b945-4399-b79e-85ecd2fda810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:28.816687 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 661/1321] 10.222.0.61 () {58 vars in 1061 bytes} [Fri Jun 3 13:13:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:13:28.826438 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7dd82a-8f7a-43f2-84d9-d880cc8eef13 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:28.827980 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-8f7dd82a-8f7a-43f2-84d9-d880cc8eef13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:28.928031 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7dd82a-8f7a-43f2-84d9-d880cc8eef13 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:29.000662 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592cdd68-54aa-4bd0-9c8f-a8994617ee3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:29.001709 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cdd68-54aa-4bd0-9c8f-a8994617ee3d service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:29.001709 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cdd68-54aa-4bd0-9c8f-a8994617ee3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:29.001897 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cdd68-54aa-4bd0-9c8f-a8994617ee3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:29.003452 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-592cdd68-54aa-4bd0-9c8f-a8994617ee3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:29.012718 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:13:29.244290 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592cdd68-54aa-4bd0-9c8f-a8994617ee3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:29.245723 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592cdd68-54aa-4bd0-9c8f-a8994617ee3d service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:29.264196 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 661/1322] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:13:28 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:13:32.976524 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9905d-9c06-4169-b31f-d0df72c7c8fc None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:32.977098 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9905d-9c06-4169-b31f-d0df72c7c8fc None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:32.977098 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9905d-9c06-4169-b31f-d0df72c7c8fc None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:32.978644 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 662/1323] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:13:32.984355 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2310d9-a1fe-4a80-ac5a-615d2421fa9b None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:32.984773 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2310d9-a1fe-4a80-ac5a-615d2421fa9b None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:32.984945 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2310d9-a1fe-4a80-ac5a-615d2421fa9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:33.050082 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-7f2310d9-a1fe-4a80-ac5a-615d2421fa9b None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:13:33.051278 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-7f2310d9-a1fe-4a80-ac5a-615d2421fa9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:33.111989 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:13:33.150869 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 662/1324] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:13:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:13:33.186559 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9905d-9c06-4169-b31f-d0df72c7c8fc None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:33.188228 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-26d9905d-9c06-4169-b31f-d0df72c7c8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:33.291915 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9905d-9c06-4169-b31f-d0df72c7c8fc None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:33.304008 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:13:33.366489 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82126b7b-e83b-4060-a807-ee6dabe29f2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:33.367134 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82126b7b-e83b-4060-a807-ee6dabe29f2d service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:33.367420 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82126b7b-e83b-4060-a807-ee6dabe29f2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:33.367691 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82126b7b-e83b-4060-a807-ee6dabe29f2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:33.369909 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-82126b7b-e83b-4060-a807-ee6dabe29f2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:33.478103 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82126b7b-e83b-4060-a807-ee6dabe29f2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:33.479550 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82126b7b-e83b-4060-a807-ee6dabe29f2d service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:33.498407 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 663/1325] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:13:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:13:35.849956 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd760538-e51a-4134-a6af-1715b6f2766c None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:35.850495 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd760538-e51a-4134-a6af-1715b6f2766c None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:35.850495 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd760538-e51a-4134-a6af-1715b6f2766c None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:35.851896 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 663/1326] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:13:35.858359 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d904f4-105f-4884-8db1-86d65fa11d4a None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:35.858835 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d904f4-105f-4884-8db1-86d65fa11d4a None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:35.858941 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d904f4-105f-4884-8db1-86d65fa11d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:35.907246 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:13:35.926631 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-07d904f4-105f-4884-8db1-86d65fa11d4a None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:13:35.927830 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-07d904f4-105f-4884-8db1-86d65fa11d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:36.028236 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 664/1327] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:13:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:13:36.063611 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd760538-e51a-4134-a6af-1715b6f2766c None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:36.065153 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-cd760538-e51a-4134-a6af-1715b6f2766c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:36.170939 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd760538-e51a-4134-a6af-1715b6f2766c None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:36.244668 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17d390-658e-4367-864c-d6faf81e99b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:36.245311 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17d390-658e-4367-864c-d6faf81e99b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:36.245587 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17d390-658e-4367-864c-d6faf81e99b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:36.245857 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17d390-658e-4367-864c-d6faf81e99b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:36.247466 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-cb17d390-658e-4367-864c-d6faf81e99b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:36.263480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:13:36.357803 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb17d390-658e-4367-864c-d6faf81e99b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:36.359505 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb17d390-658e-4367-864c-d6faf81e99b1 service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:36.378361 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 664/1328] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:13:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:13:38.744615 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505b85f-13e5-4b76-91c7-965a25b8ead8 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:38.745188 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505b85f-13e5-4b76-91c7-965a25b8ead8 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:38.745188 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505b85f-13e5-4b76-91c7-965a25b8ead8 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:38.746548 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 665/1329] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:13:38.751788 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d334f41-5810-4a33-a44c-2319742c3d2e None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:38.752234 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d334f41-5810-4a33-a44c-2319742c3d2e None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:38.752362 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d334f41-5810-4a33-a44c-2319742c3d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:38.816728 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-2d334f41-5810-4a33-a44c-2319742c3d2e None None] MFA Rules not processed for user `dd10501b4efc4e1584a8886555a4f00a`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:13:38.817910 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-2d334f41-5810-4a33-a44c-2319742c3d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:38.882926 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:13:38.914701 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 665/1330] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:13:38 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:13:38.954116 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505b85f-13e5-4b76-91c7-965a25b8ead8 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:38.955720 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-d505b85f-13e5-4b76-91c7-965a25b8ead8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:39.059598 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505b85f-13e5-4b76-91c7-965a25b8ead8 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:39.079724 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:13:39.133529 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b653a0b-91e1-4a39-9d6e-9cd8792cd0b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:39.135038 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b653a0b-91e1-4a39-9d6e-9cd8792cd0b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:39.135327 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b653a0b-91e1-4a39-9d6e-9cd8792cd0b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:39.135605 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b653a0b-91e1-4a39-9d6e-9cd8792cd0b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:39.137299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-6b653a0b-91e1-4a39-9d6e-9cd8792cd0b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:39.248163 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b653a0b-91e1-4a39-9d6e-9cd8792cd0b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:39.249625 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b653a0b-91e1-4a39-9d6e-9cd8792cd0b4 service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:39.267855 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 666/1331] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:13:38 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:13:41.967176 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db239937-79ff-418a-8832-249603aae489 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:41.967720 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db239937-79ff-418a-8832-249603aae489 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:41.967720 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db239937-79ff-418a-8832-249603aae489 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:41.969178 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 666/1332] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:13:41.979104 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a452a-fd21-4ace-85c5-25694ea49f02 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:41.979104 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a452a-fd21-4ace-85c5-25694ea49f02 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:41.979104 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a452a-fd21-4ace-85c5-25694ea49f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:42.040866 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:13:42.044618 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-ca4a452a-fd21-4ace-85c5-25694ea49f02 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:13:42.046137 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-ca4a452a-fd21-4ace-85c5-25694ea49f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:42.152470 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 667/1333] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:13:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:13:42.189800 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db239937-79ff-418a-8832-249603aae489 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:42.191349 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-db239937-79ff-418a-8832-249603aae489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:42.303073 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db239937-79ff-418a-8832-249603aae489 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:42.379857 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f1c94-e7a1-4592-81b4-9e9745194977 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:42.384096 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f1c94-e7a1-4592-81b4-9e9745194977 service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:42.384096 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f1c94-e7a1-4592-81b4-9e9745194977 service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:42.384096 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f1c94-e7a1-4592-81b4-9e9745194977 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:42.384096 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-897f1c94-e7a1-4592-81b4-9e9745194977 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:42.418357 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:13:42.513085 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897f1c94-e7a1-4592-81b4-9e9745194977 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:42.529718 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897f1c94-e7a1-4592-81b4-9e9745194977 service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:42.534296 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 667/1334] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:13:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:13:44.882837 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb02e3d-ea06-49b3-8600-64ee9ccda589 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:44.883400 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb02e3d-ea06-49b3-8600-64ee9ccda589 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:44.883400 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb02e3d-ea06-49b3-8600-64ee9ccda589 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:44.885594 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 668/1335] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:13:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:13:44.891190 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf5632-2572-4142-9d82-e8010381f36a None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:44.891615 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf5632-2572-4142-9d82-e8010381f36a None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:44.891760 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf5632-2572-4142-9d82-e8010381f36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:44.960508 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-99cf5632-2572-4142-9d82-e8010381f36a None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:13:44.961676 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-99cf5632-2572-4142-9d82-e8010381f36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:45.036219 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:13:45.059544 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 668/1336] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:13:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:13:45.098988 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb02e3d-ea06-49b3-8600-64ee9ccda589 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:45.100582 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-3eb02e3d-ea06-49b3-8600-64ee9ccda589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:45.203596 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb02e3d-ea06-49b3-8600-64ee9ccda589 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:45.232018 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:13:45.278375 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d39f7-c0bf-47b1-abbf-6ad11a53778d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:45.279022 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d39f7-c0bf-47b1-abbf-6ad11a53778d service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:45.279306 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d39f7-c0bf-47b1-abbf-6ad11a53778d service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:45.279586 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d39f7-c0bf-47b1-abbf-6ad11a53778d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:45.281260 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-7b2d39f7-c0bf-47b1-abbf-6ad11a53778d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:45.389170 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d39f7-c0bf-47b1-abbf-6ad11a53778d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:45.390525 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d39f7-c0bf-47b1-abbf-6ad11a53778d service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:45.409222 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 669/1337] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:13:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:13:48.268943 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7e81e-6bda-4951-a3e5-98caa4575d5c None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:48.269530 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7e81e-6bda-4951-a3e5-98caa4575d5c None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:48.269530 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7e81e-6bda-4951-a3e5-98caa4575d5c None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:48.270997 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 669/1338] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:13:48.277041 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c86688-b8e4-47b2-8cb3-0a4541ff4660 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:48.280128 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c86688-b8e4-47b2-8cb3-0a4541ff4660 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:48.280128 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c86688-b8e4-47b2-8cb3-0a4541ff4660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:48.341547 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-e3c86688-b8e4-47b2-8cb3-0a4541ff4660 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:13:48.343157 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-e3c86688-b8e4-47b2-8cb3-0a4541ff4660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:48.351076 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:13:48.448347 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 670/1339] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:13:48 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:13:48.484493 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7e81e-6bda-4951-a3e5-98caa4575d5c None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:48.486566 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-adf7e81e-6bda-4951-a3e5-98caa4575d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:48.591531 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7e81e-6bda-4951-a3e5-98caa4575d5c None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:48.594957 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9084a52-f4d7-491a-856e-79eb4fc7a232 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:48.595592 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9084a52-f4d7-491a-856e-79eb4fc7a232 service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:48.595877 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9084a52-f4d7-491a-856e-79eb4fc7a232 service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:48.596166 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9084a52-f4d7-491a-856e-79eb4fc7a232 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:48.625510 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9084a52-f4d7-491a-856e-79eb4fc7a232 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:48.626915 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9084a52-f4d7-491a-856e-79eb4fc7a232 service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:48.654011 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 670/1340] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:13:48 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:13:53.170816 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2067a79-5f0f-4946-b432-c7d3cc422abf None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:53.171384 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2067a79-5f0f-4946-b432-c7d3cc422abf None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:53.171384 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2067a79-5f0f-4946-b432-c7d3cc422abf None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:53.172928 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 671/1341] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:13:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:13:53.178174 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318fa75-44e8-414d-8c5b-65299025288e None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:53.181940 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318fa75-44e8-414d-8c5b-65299025288e None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:53.181940 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318fa75-44e8-414d-8c5b-65299025288e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:53.245467 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-8318fa75-44e8-414d-8c5b-65299025288e None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:13:53.246662 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-8318fa75-44e8-414d-8c5b-65299025288e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:53.269191 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:13:53.323593 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 671/1342] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:13:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:13:53.363714 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2067a79-5f0f-4946-b432-c7d3cc422abf None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:53.375614 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2067a79-5f0f-4946-b432-c7d3cc422abf None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:53.379629 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e277eb-4b76-4e34-b89d-dce95a098114 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:53.380426 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e277eb-4b76-4e34-b89d-dce95a098114 service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:53.380769 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e277eb-4b76-4e34-b89d-dce95a098114 service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:53.381109 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e277eb-4b76-4e34-b89d-dce95a098114 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:53.391740 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e277eb-4b76-4e34-b89d-dce95a098114 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:53.393229 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e277eb-4b76-4e34-b89d-dce95a098114 service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:53.403530 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 672/1343] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:13:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:13:56.650730 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfef225-71d3-47e6-abdd-d1f0c06b73b7 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:56.651245 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfef225-71d3-47e6-abdd-d1f0c06b73b7 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:56.651245 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfef225-71d3-47e6-abdd-d1f0c06b73b7 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:56.652746 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 672/1344] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:13:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:13:56.658087 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a369c4f-6380-4b4b-9850-7846d555cfb4 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:56.658535 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a369c4f-6380-4b4b-9850-7846d555cfb4 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:56.658690 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a369c4f-6380-4b4b-9850-7846d555cfb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:56.686760 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-8a369c4f-6380-4b4b-9850-7846d555cfb4 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:13:56.687876 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-8a369c4f-6380-4b4b-9850-7846d555cfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:13:56.695644 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 673/1345] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:13:56 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:13:56.733274 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfef225-71d3-47e6-abdd-d1f0c06b73b7 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:13:56.744185 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfef225-71d3-47e6-abdd-d1f0c06b73b7 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:13:56.747696 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df99f11-9c01-4ec9-84ea-c2c00868b7bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:13:56.748365 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df99f11-9c01-4ec9-84ea-c2c00868b7bf service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:13:56.748654 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df99f11-9c01-4ec9-84ea-c2c00868b7bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:13:56.748932 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df99f11-9c01-4ec9-84ea-c2c00868b7bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:13:56.757741 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df99f11-9c01-4ec9-84ea-c2c00868b7bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:13:56.759300 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df99f11-9c01-4ec9-84ea-c2c00868b7bf service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:13:56.768712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 673/1346] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:13:56 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:14:01.413688 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1adb2-6856-4d3b-afa4-04d56e1b3149 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:01.414223 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1adb2-6856-4d3b-afa4-04d56e1b3149 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:01.414223 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1adb2-6856-4d3b-afa4-04d56e1b3149 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:01.416263 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 674/1347] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:14:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:14:01.421332 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb02d63-2f06-4e03-9d26-766cd39a3908 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:01.421790 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb02d63-2f06-4e03-9d26-766cd39a3908 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:01.422015 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb02d63-2f06-4e03-9d26-766cd39a3908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:01.440385 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-8fb02d63-2f06-4e03-9d26-766cd39a3908 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:14:01.441581 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-8fb02d63-2f06-4e03-9d26-766cd39a3908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:01.450413 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 674/1348] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:14:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:14:01.489348 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1adb2-6856-4d3b-afa4-04d56e1b3149 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:01.490994 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-18e1adb2-6856-4d3b-afa4-04d56e1b3149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:01.503994 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1adb2-6856-4d3b-afa4-04d56e1b3149 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:01.507461 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e652749-91e8-4f34-86d4-77d97057f861 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:01.508083 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e652749-91e8-4f34-86d4-77d97057f861 service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:01.508966 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e652749-91e8-4f34-86d4-77d97057f861 service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:01.509285 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e652749-91e8-4f34-86d4-77d97057f861 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:01.518167 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e652749-91e8-4f34-86d4-77d97057f861 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:01.519592 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e652749-91e8-4f34-86d4-77d97057f861 service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:01.529440 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 675/1349] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:14:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:14:07.097127 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1497203-6ec9-46a2-9090-f20096f948a5 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:07.098007 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1497203-6ec9-46a2-9090-f20096f948a5 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:07.098511 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1497203-6ec9-46a2-9090-f20096f948a5 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:07.100403 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 675/1350] 10.222.0.61 () {54 vars in 921 bytes} [Fri Jun 3 13:14:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:14:07.106132 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd803e-965c-47b9-b8ad-90ed31a216cb None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:07.107056 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd803e-965c-47b9-b8ad-90ed31a216cb None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:07.107754 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd803e-965c-47b9-b8ad-90ed31a216cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:07.182796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-98bd803e-965c-47b9-b8ad-90ed31a216cb None None] MFA Rules not processed for user `a5c4ad16c9454b74ae8445b115cf0af4`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:14:07.184005 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-98bd803e-965c-47b9-b8ad-90ed31a216cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:07.234361 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:07.269789 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 676/1351] 10.222.0.61 () {58 vars in 1018 bytes} [Fri Jun 3 13:14:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:14:11.434979 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=31 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:11.782221 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50e3fa-69cf-4239-bca5-52c8b51d03ed None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:11.782500 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50e3fa-69cf-4239-bca5-52c8b51d03ed None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:11.782771 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50e3fa-69cf-4239-bca5-52c8b51d03ed None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:11.784193 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 676/1352] 10.222.0.61 () {54 vars in 921 bytes} [Fri Jun 3 13:14:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:14:11.790066 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d136ac-5b54-4cc4-8766-f1b41886c84c None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:11.790565 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d136ac-5b54-4cc4-8766-f1b41886c84c None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:11.790681 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d136ac-5b54-4cc4-8766-f1b41886c84c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:11.811752 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-80d136ac-5b54-4cc4-8766-f1b41886c84c None None] MFA Rules not processed for user `a5c4ad16c9454b74ae8445b115cf0af4`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:14:11.813297 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-80d136ac-5b54-4cc4-8766-f1b41886c84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:11.823111 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 677/1353] 10.222.0.61 () {58 vars in 1018 bytes} [Fri Jun 3 13:14:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:14:13.266617 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef2dcc-2c7e-4b29-90a2-12f2c526acc2 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:13.267141 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef2dcc-2c7e-4b29-90a2-12f2c526acc2 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:13.267141 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef2dcc-2c7e-4b29-90a2-12f2c526acc2 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:13.268471 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 677/1354] 10.222.0.61 () {54 vars in 921 bytes} [Fri Jun 3 13:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:14:13.273532 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd6630-d7e0-44a6-b199-7a268cd16c8c None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:13.274757 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd6630-d7e0-44a6-b199-7a268cd16c8c None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:13.274757 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd6630-d7e0-44a6-b199-7a268cd16c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:13.293766 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-f4bd6630-d7e0-44a6-b199-7a268cd16c8c None None] MFA Rules not processed for user `a5c4ad16c9454b74ae8445b115cf0af4`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:14:13.294972 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-f4bd6630-d7e0-44a6-b199-7a268cd16c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:13.303819 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 678/1355] 10.222.0.61 () {58 vars in 1018 bytes} [Fri Jun 3 13:14:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:14:17.318548 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251245a-f26f-4ca4-b170-0e94a528a140 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:17.318548 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251245a-f26f-4ca4-b170-0e94a528a140 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:17.325344 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251245a-f26f-4ca4-b170-0e94a528a140 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:17.325344 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 678/1356] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:14:17.326202 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d648455-659d-4181-ba7b-aaee224c4bb8 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:17.326651 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d648455-659d-4181-ba7b-aaee224c4bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:17.326755 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d648455-659d-4181-ba7b-aaee224c4bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:17.345009 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-5d648455-659d-4181-ba7b-aaee224c4bb8 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:14:17.346194 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-5d648455-659d-4181-ba7b-aaee224c4bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:17.354119 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 679/1357] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:14:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:14:17.418461 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4261918-3f9e-4428-8d33-58cc3f75c4c1 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:17.419220 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4261918-3f9e-4428-8d33-58cc3f75c4c1 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:17.419516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4261918-3f9e-4428-8d33-58cc3f75c4c1 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:17.421818 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 679/1358] 10.222.0.61 () {54 vars in 961 bytes} [Fri Jun 3 13:14:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:14:17.428758 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6faac9c-12b4-41d6-a9aa-0339749a0ffc None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:17.429730 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6faac9c-12b4-41d6-a9aa-0339749a0ffc None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:17.430364 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6faac9c-12b4-41d6-a9aa-0339749a0ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:17.492676 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-c6faac9c-12b4-41d6-a9aa-0339749a0ffc None None] MFA Rules not processed for user `066aaba3e9af4f85ab0cba89a3d32e34`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:14:17.493874 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-c6faac9c-12b4-41d6-a9aa-0339749a0ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:17.586860 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 680/1359] 10.222.0.61 () {58 vars in 1058 bytes} [Fri Jun 3 13:14:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:14:17.595058 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4261918-3f9e-4428-8d33-58cc3f75c4c1 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:17.611752 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4261918-3f9e-4428-8d33-58cc3f75c4c1 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:17.617829 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0959ea4-014c-49ba-8774-9f8a4736c5f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066aaba3e9af4f85ab0cba89a3d32e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:17.618572 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0959ea4-014c-49ba-8774-9f8a4736c5f2 service nova] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:17.618863 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0959ea4-014c-49ba-8774-9f8a4736c5f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:17.619153 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0959ea4-014c-49ba-8774-9f8a4736c5f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:17.629023 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0959ea4-014c-49ba-8774-9f8a4736c5f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:17.630672 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0959ea4-014c-49ba-8774-9f8a4736c5f2 service nova] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:17.642285 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 680/1360] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:14:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:14:20.134831 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f91f9-a317-4bfc-81cd-3dae376e4481 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:20.135647 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f91f9-a317-4bfc-81cd-3dae376e4481 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:20.135647 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f91f9-a317-4bfc-81cd-3dae376e4481 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:20.137053 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 681/1361] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:14:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:14:20.142558 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fef668-6e4a-4dfd-a257-bbfb5bfaf26f None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:20.143016 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fef668-6e4a-4dfd-a257-bbfb5bfaf26f None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:20.143101 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fef668-6e4a-4dfd-a257-bbfb5bfaf26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:20.163086 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-d5fef668-6e4a-4dfd-a257-bbfb5bfaf26f None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:14:20.165072 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-d5fef668-6e4a-4dfd-a257-bbfb5bfaf26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:20.173089 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 681/1362] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:14:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:14:20.220079 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f91f9-a317-4bfc-81cd-3dae376e4481 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:20.236516 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f91f9-a317-4bfc-81cd-3dae376e4481 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:20.242403 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d745da-7a5f-40fd-9fee-7c6e80001f5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066aaba3e9af4f85ab0cba89a3d32e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:20.243691 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d745da-7a5f-40fd-9fee-7c6e80001f5b service nova] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:20.243985 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d745da-7a5f-40fd-9fee-7c6e80001f5b service nova] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:20.244293 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d745da-7a5f-40fd-9fee-7c6e80001f5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:20.252882 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d745da-7a5f-40fd-9fee-7c6e80001f5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:20.254470 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d745da-7a5f-40fd-9fee-7c6e80001f5b service nova] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:20.264621 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 682/1363] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:14:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:14:23.122746 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df83059-a57c-433d-9635-03db1645ec01 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:23.123260 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df83059-a57c-433d-9635-03db1645ec01 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:23.123260 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df83059-a57c-433d-9635-03db1645ec01 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:23.124709 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 682/1364] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:14:23.130078 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0445b4a-b0c6-493f-95bd-edba1523120a None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:23.130494 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0445b4a-b0c6-493f-95bd-edba1523120a None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:23.130764 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0445b4a-b0c6-493f-95bd-edba1523120a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:23.150384 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-d0445b4a-b0c6-493f-95bd-edba1523120a None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:14:23.151575 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-d0445b4a-b0c6-493f-95bd-edba1523120a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:23.159543 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 683/1365] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:14:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:14:23.206793 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219fa01-0c58-4b2f-bb04-6ae2f556145f None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:23.207078 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219fa01-0c58-4b2f-bb04-6ae2f556145f None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:23.207353 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219fa01-0c58-4b2f-bb04-6ae2f556145f None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:23.208822 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 683/1366] 10.222.0.61 () {54 vars in 961 bytes} [Fri Jun 3 13:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:14:23.215038 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d697387-c4ed-487e-bfbc-287f8cd0926c None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:23.215367 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d697387-c4ed-487e-bfbc-287f8cd0926c None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:23.215641 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d697387-c4ed-487e-bfbc-287f8cd0926c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:23.234642 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-1d697387-c4ed-487e-bfbc-287f8cd0926c None None] MFA Rules not processed for user `066aaba3e9af4f85ab0cba89a3d32e34`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:14:23.235836 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-1d697387-c4ed-487e-bfbc-287f8cd0926c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:23.245507 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 684/1367] 10.222.0.61 () {58 vars in 1058 bytes} [Fri Jun 3 13:14:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:14:23.253354 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219fa01-0c58-4b2f-bb04-6ae2f556145f None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:23.268122 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219fa01-0c58-4b2f-bb04-6ae2f556145f None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:23.273516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0641948c-369a-4f8c-8f16-38496f785a54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066aaba3e9af4f85ab0cba89a3d32e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:23.274365 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641948c-369a-4f8c-8f16-38496f785a54 service nova] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:23.274713 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641948c-369a-4f8c-8f16-38496f785a54 service nova] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:23.275048 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641948c-369a-4f8c-8f16-38496f785a54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:23.283134 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0641948c-369a-4f8c-8f16-38496f785a54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:23.284721 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0641948c-369a-4f8c-8f16-38496f785a54 service nova] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:23.300543 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 684/1368] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:14:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 13:14:25.798367 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea4eeb-e793-4fac-8846-59f1b03cf061 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:25.798981 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea4eeb-e793-4fac-8846-59f1b03cf061 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:25.798981 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea4eeb-e793-4fac-8846-59f1b03cf061 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:25.800379 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 685/1369] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:14:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:14:25.807205 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c5e1a-bedc-442f-992c-c63c0d9f9ecc None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:25.807768 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c5e1a-bedc-442f-992c-c63c0d9f9ecc None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:25.807768 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c5e1a-bedc-442f-992c-c63c0d9f9ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:25.826816 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-1f8c5e1a-bedc-442f-992c-c63c0d9f9ecc None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:14:25.827012 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98447b-6dab-4bbe-b88f-03c54eec1dae None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:25.827128 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98447b-6dab-4bbe-b88f-03c54eec1dae None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:25.827375 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98447b-6dab-4bbe-b88f-03c54eec1dae None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:25.828634 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-1f8c5e1a-bedc-442f-992c-c63c0d9f9ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:25.829043 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 686/1370] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:14:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 13:14:25.833870 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4877208-304e-466c-9809-d7a97b4977d5 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:25.834160 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4877208-304e-466c-9809-d7a97b4977d5 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:25.834441 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4877208-304e-466c-9809-d7a97b4977d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:25.837046 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 685/1371] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:14:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:14:25.856768 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-a4877208-304e-466c-9809-d7a97b4977d5 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:14:25.858325 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-a4877208-304e-466c-9809-d7a97b4977d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:25.866610 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 687/1372] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:14:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:14:25.881722 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c5e1a-bedc-442f-992c-c63c0d9f9ecc None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:25.894588 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c5e1a-bedc-442f-992c-c63c0d9f9ecc None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:25.900761 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca72c6a-e330-447e-9151-fcb79bd14205 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066aaba3e9af4f85ab0cba89a3d32e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:25.901494 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca72c6a-e330-447e-9151-fcb79bd14205 service nova] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:25.901859 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca72c6a-e330-447e-9151-fcb79bd14205 service nova] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:25.902338 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca72c6a-e330-447e-9151-fcb79bd14205 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:25.911256 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca72c6a-e330-447e-9151-fcb79bd14205 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:25.913048 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca72c6a-e330-447e-9151-fcb79bd14205 service nova] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:25.925536 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 686/1373] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:14:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:14:26.154069 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6272976-4b8e-49a1-921c-586f89a92147 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:26.154434 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6272976-4b8e-49a1-921c-586f89a92147 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:26.154653 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6272976-4b8e-49a1-921c-586f89a92147 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:26.156195 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 688/1374] 10.222.0.61 () {54 vars in 963 bytes} [Fri Jun 3 13:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:14:26.162852 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bceb3-58b8-4ec3-bc1b-46e58fd4822c None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:26.169156 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bceb3-58b8-4ec3-bc1b-46e58fd4822c None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:26.169156 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bceb3-58b8-4ec3-bc1b-46e58fd4822c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:26.222190 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-682bceb3-58b8-4ec3-bc1b-46e58fd4822c None None] MFA Rules not processed for user `303176c26fc74d4892b2f83c81f01b60`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:14:26.223670 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-682bceb3-58b8-4ec3-bc1b-46e58fd4822c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:26.301931 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 687/1375] 10.222.0.61 () {58 vars in 1060 bytes} [Fri Jun 3 13:14:26 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:14:26.310232 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6272976-4b8e-49a1-921c-586f89a92147 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:26.322166 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6272976-4b8e-49a1-921c-586f89a92147 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:26.325705 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8845762-5d98-4756-8580-7a6122a262eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:26.326521 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8845762-5d98-4756-8580-7a6122a262eb service cinder] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:26.326846 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8845762-5d98-4756-8580-7a6122a262eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:26.327106 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8845762-5d98-4756-8580-7a6122a262eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:26.338462 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8845762-5d98-4756-8580-7a6122a262eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:26.339960 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8845762-5d98-4756-8580-7a6122a262eb service cinder] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:26.350573 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 689/1376] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:14:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:14:28.347167 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb6738-65b5-43c4-bb26-8ac4bf972ad6 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:28.347757 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb6738-65b5-43c4-bb26-8ac4bf972ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:28.347757 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb6738-65b5-43c4-bb26-8ac4bf972ad6 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:28.349147 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 688/1377] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:14:28.355642 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a464a45-6efc-4d58-be86-07c2d4df1b0d None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:28.356211 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a464a45-6efc-4d58-be86-07c2d4df1b0d None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:28.356211 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a464a45-6efc-4d58-be86-07c2d4df1b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:28.375983 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-2a464a45-6efc-4d58-be86-07c2d4df1b0d None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:14:28.377253 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-2a464a45-6efc-4d58-be86-07c2d4df1b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:28.385698 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 690/1378] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:14:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:14:28.431452 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb6738-65b5-43c4-bb26-8ac4bf972ad6 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:28.447260 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb6738-65b5-43c4-bb26-8ac4bf972ad6 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:28.453045 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af41ec8-4e07-4e2a-b0e5-c899e97e90d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066aaba3e9af4f85ab0cba89a3d32e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:28.453731 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af41ec8-4e07-4e2a-b0e5-c899e97e90d4 service nova] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:28.454014 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af41ec8-4e07-4e2a-b0e5-c899e97e90d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:28.454290 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af41ec8-4e07-4e2a-b0e5-c899e97e90d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:28.463911 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af41ec8-4e07-4e2a-b0e5-c899e97e90d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:28.465586 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af41ec8-4e07-4e2a-b0e5-c899e97e90d4 service nova] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:28.477127 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 689/1379] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:14:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:14:30.907322 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fcd80f-8b75-48ba-913a-a9d035f82d37 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:30.907900 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fcd80f-8b75-48ba-913a-a9d035f82d37 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:30.907900 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fcd80f-8b75-48ba-913a-a9d035f82d37 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:30.909283 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 691/1380] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:14:30.918522 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba236bd7-a4a1-45c4-b123-47e7c3d7350c None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:30.918994 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba236bd7-a4a1-45c4-b123-47e7c3d7350c None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:30.919210 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba236bd7-a4a1-45c4-b123-47e7c3d7350c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:30.941556 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-ba236bd7-a4a1-45c4-b123-47e7c3d7350c None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:14:30.942755 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-ba236bd7-a4a1-45c4-b123-47e7c3d7350c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:30.951382 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 690/1381] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:14:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:14:30.996034 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fcd80f-8b75-48ba-913a-a9d035f82d37 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:31.012676 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fcd80f-8b75-48ba-913a-a9d035f82d37 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:31.018209 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ec476-97c6-4307-9990-558ddcfb4864 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066aaba3e9af4f85ab0cba89a3d32e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:31.018891 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ec476-97c6-4307-9990-558ddcfb4864 service nova] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:31.019129 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ec476-97c6-4307-9990-558ddcfb4864 service nova] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:31.019456 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ec476-97c6-4307-9990-558ddcfb4864 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:31.028608 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91ec476-97c6-4307-9990-558ddcfb4864 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:31.030204 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91ec476-97c6-4307-9990-558ddcfb4864 service nova] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:31.040583 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 692/1382] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:14:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:14:33.717168 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbed76-97d1-4c75-9df7-3d32e447f2fe None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:33.717755 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbed76-97d1-4c75-9df7-3d32e447f2fe None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:33.717755 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbed76-97d1-4c75-9df7-3d32e447f2fe None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:33.719137 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 691/1383] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:14:33.724587 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d88a61-63da-4165-930e-f5944051ecca None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:33.725392 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d88a61-63da-4165-930e-f5944051ecca None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:33.725670 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d88a61-63da-4165-930e-f5944051ecca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:33.732913 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:33.745776 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-93d88a61-63da-4165-930e-f5944051ecca None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:14:33.751393 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-93d88a61-63da-4165-930e-f5944051ecca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:33.756185 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 693/1384] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:14:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:14:33.797536 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedbed76-97d1-4c75-9df7-3d32e447f2fe None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:33.813269 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedbed76-97d1-4c75-9df7-3d32e447f2fe None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:33.818932 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e404f-ed25-4d8b-944b-69235c8a7b81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066aaba3e9af4f85ab0cba89a3d32e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:33.819576 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e404f-ed25-4d8b-944b-69235c8a7b81 service nova] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:33.819857 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e404f-ed25-4d8b-944b-69235c8a7b81 service nova] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:33.820129 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e404f-ed25-4d8b-944b-69235c8a7b81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:33.829499 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e404f-ed25-4d8b-944b-69235c8a7b81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:33.831073 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e404f-ed25-4d8b-944b-69235c8a7b81 service nova] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:33.841379 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 692/1385] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:14:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:14:36.112974 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7cec2-a741-4eb2-804c-fba7704174d1 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:36.113666 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7cec2-a741-4eb2-804c-fba7704174d1 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:36.113666 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7cec2-a741-4eb2-804c-fba7704174d1 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:36.115027 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 694/1386] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:14:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:14:36.121342 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76462c-f3e2-4fa4-8228-c0e3befe4df3 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:36.121808 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76462c-f3e2-4fa4-8228-c0e3befe4df3 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:36.122130 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76462c-f3e2-4fa4-8228-c0e3befe4df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:36.144649 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-7d76462c-f3e2-4fa4-8228-c0e3befe4df3 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:14:36.146222 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-7d76462c-f3e2-4fa4-8228-c0e3befe4df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:36.156248 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 693/1387] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:14:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:14:36.204211 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7cec2-a741-4eb2-804c-fba7704174d1 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:36.219554 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7cec2-a741-4eb2-804c-fba7704174d1 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:36.225492 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7257aaf-319f-47d3-8952-ca17b6968a28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066aaba3e9af4f85ab0cba89a3d32e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:36.226174 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7257aaf-319f-47d3-8952-ca17b6968a28 service nova] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:36.226531 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7257aaf-319f-47d3-8952-ca17b6968a28 service nova] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:36.226808 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7257aaf-319f-47d3-8952-ca17b6968a28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:36.235965 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7257aaf-319f-47d3-8952-ca17b6968a28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:36.237713 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7257aaf-319f-47d3-8952-ca17b6968a28 service nova] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:36.248582 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 695/1388] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:14:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:14:38.806356 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ddc9e-a7a8-4da1-96be-4c01dcab7c8f None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:38.806903 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ddc9e-a7a8-4da1-96be-4c01dcab7c8f None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:38.807235 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ddc9e-a7a8-4da1-96be-4c01dcab7c8f None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:38.809610 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 694/1389] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:14:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 13:14:38.816856 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a7f2a-a0aa-4ac3-9aa2-d25f615c28da None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:38.817346 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a7f2a-a0aa-4ac3-9aa2-d25f615c28da None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:38.817767 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a7f2a-a0aa-4ac3-9aa2-d25f615c28da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:38.843612 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-926a7f2a-a0aa-4ac3-9aa2-d25f615c28da None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:14:38.845550 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-926a7f2a-a0aa-4ac3-9aa2-d25f615c28da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:38.858697 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 696/1390] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:14:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:14:38.906222 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ddc9e-a7a8-4da1-96be-4c01dcab7c8f None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:38.929096 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ddc9e-a7a8-4da1-96be-4c01dcab7c8f None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:38.936246 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331735d-17fb-4456-98d0-502243857672 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066aaba3e9af4f85ab0cba89a3d32e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:38.936987 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331735d-17fb-4456-98d0-502243857672 service nova] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:38.937241 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331735d-17fb-4456-98d0-502243857672 service nova] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:38.941340 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331735d-17fb-4456-98d0-502243857672 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:38.947805 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331735d-17fb-4456-98d0-502243857672 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:38.951107 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331735d-17fb-4456-98d0-502243857672 service nova] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:38.964952 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 695/1391] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:14:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:14:41.542121 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bf865-534d-43fd-a78b-eb372a738843 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:41.542741 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bf865-534d-43fd-a78b-eb372a738843 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:41.542741 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bf865-534d-43fd-a78b-eb372a738843 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:41.544083 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 697/1392] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 13:14:41.549591 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec5168-4c92-4889-8abf-78e73a015508 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:41.550039 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec5168-4c92-4889-8abf-78e73a015508 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:41.550141 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec5168-4c92-4889-8abf-78e73a015508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:41.557026 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=87 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:41.569379 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-19ec5168-4c92-4889-8abf-78e73a015508 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:14:41.571251 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-19ec5168-4c92-4889-8abf-78e73a015508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:41.579147 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 696/1393] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:14:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:14:41.624194 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259bf865-534d-43fd-a78b-eb372a738843 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:41.638545 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259bf865-534d-43fd-a78b-eb372a738843 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:41.643881 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320da0b6-5821-4f8f-b4c2-2d5f1ce92c0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066aaba3e9af4f85ab0cba89a3d32e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:41.644540 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320da0b6-5821-4f8f-b4c2-2d5f1ce92c0e service nova] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:41.644849 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320da0b6-5821-4f8f-b4c2-2d5f1ce92c0e service nova] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:41.645124 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320da0b6-5821-4f8f-b4c2-2d5f1ce92c0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:41.653599 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320da0b6-5821-4f8f-b4c2-2d5f1ce92c0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:41.655178 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320da0b6-5821-4f8f-b4c2-2d5f1ce92c0e service nova] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:41.664983 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 698/1394] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:14:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:14:42.778152 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05208022-5a63-4da6-b68c-01b9a4b58d29 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:42.778755 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05208022-5a63-4da6-b68c-01b9a4b58d29 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:42.778755 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05208022-5a63-4da6-b68c-01b9a4b58d29 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:42.780101 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 697/1395] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:14:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:14:42.785518 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566acec3-2004-40a6-ae60-6762fd329700 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:42.785968 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566acec3-2004-40a6-ae60-6762fd329700 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:42.786087 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566acec3-2004-40a6-ae60-6762fd329700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:42.805020 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-566acec3-2004-40a6-ae60-6762fd329700 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:14:42.806267 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-566acec3-2004-40a6-ae60-6762fd329700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:42.814057 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 699/1396] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:14:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:14:42.869872 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e261a-fbfb-4a9b-aabd-03c413fa947e None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:42.870162 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e261a-fbfb-4a9b-aabd-03c413fa947e None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:42.870439 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e261a-fbfb-4a9b-aabd-03c413fa947e None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:42.871816 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 698/1397] 10.222.0.61 () {54 vars in 962 bytes} [Fri Jun 3 13:14:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:14:42.876871 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544e752-2383-4fa1-a0c2-7b9819c600da None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:42.877162 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544e752-2383-4fa1-a0c2-7b9819c600da None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:42.877439 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544e752-2383-4fa1-a0c2-7b9819c600da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:42.925753 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-8544e752-2383-4fa1-a0c2-7b9819c600da None None] MFA Rules not processed for user `60eeb0b3e37a4604ab8f8b73c2b021f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:14:42.926562 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-8544e752-2383-4fa1-a0c2-7b9819c600da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:42.993528 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 700/1398] 10.222.0.61 () {58 vars in 1059 bytes} [Fri Jun 3 13:14:42 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:14:43.001194 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e261a-fbfb-4a9b-aabd-03c413fa947e None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:43.013147 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e261a-fbfb-4a9b-aabd-03c413fa947e None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:43.016701 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e8058-0725-48c6-919c-bb662b49a5df service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60eeb0b3e37a4604ab8f8b73c2b021f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:43.017336 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e8058-0725-48c6-919c-bb662b49a5df service glance] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:43.017619 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e8058-0725-48c6-919c-bb662b49a5df service glance] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:43.017891 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e8058-0725-48c6-919c-bb662b49a5df service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:43.027379 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898e8058-0725-48c6-919c-bb662b49a5df service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:43.028879 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898e8058-0725-48c6-919c-bb662b49a5df service glance] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:43.043322 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 699/1399] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:14:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:14:43.753604 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77930f8c-5574-49f7-97e3-f3f05aff00d8 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:43.753896 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77930f8c-5574-49f7-97e3-f3f05aff00d8 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:43.754181 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77930f8c-5574-49f7-97e3-f3f05aff00d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:43.813399 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-77930f8c-5574-49f7-97e3-f3f05aff00d8 None None] MFA Rules not processed for user `06c55d0ea52f40ae9125d2efe1d159a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:14:43.814637 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-77930f8c-5574-49f7-97e3-f3f05aff00d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:43.879732 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 701/1400] 10.222.0.61 () {58 vars in 1009 bytes} [Fri Jun 3 13:14:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:14:43.926925 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ea030-9f5f-463a-9173-8921bfb44119 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:43.927428 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ea030-9f5f-463a-9173-8921bfb44119 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:43.927743 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ea030-9f5f-463a-9173-8921bfb44119 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:43.929284 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 700/1401] 10.222.0.61 () {54 vars in 942 bytes} [Fri Jun 3 13:14:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:14:43.936394 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec692b-a1cc-459b-9187-29bb8c29d8fa None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:43.936750 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec692b-a1cc-459b-9187-29bb8c29d8fa None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:43.937094 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec692b-a1cc-459b-9187-29bb8c29d8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:43.950873 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:43.987072 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-a6ec692b-a1cc-459b-9187-29bb8c29d8fa None None] MFA Rules not processed for user `b07ad3dd7477497ea25c2a01bff35712`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:14:43.988309 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-a6ec692b-a1cc-459b-9187-29bb8c29d8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:44.061179 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 702/1402] 10.222.0.61 () {58 vars in 1039 bytes} [Fri Jun 3 13:14:43 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:14:44.070337 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ea030-9f5f-463a-9173-8921bfb44119 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:44.083613 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ea030-9f5f-463a-9173-8921bfb44119 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:44.088815 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473fb7f3-a736-467e-a16a-9f8f51f4c15f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07ad3dd7477497ea25c2a01bff35712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:44.089456 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473fb7f3-a736-467e-a16a-9f8f51f4c15f service swift] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:44.089734 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473fb7f3-a736-467e-a16a-9f8f51f4c15f service swift] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:44.090060 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473fb7f3-a736-467e-a16a-9f8f51f4c15f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:44.098684 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473fb7f3-a736-467e-a16a-9f8f51f4c15f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:44.100299 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473fb7f3-a736-467e-a16a-9f8f51f4c15f service swift] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:44.108961 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 701/1403] 10.222.0.61 () {60 vars in 1384 bytes} [Fri Jun 3 13:14:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 13:14:44.137014 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3904ae8-f35e-4db2-9559-29758492d7c2 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:44.137297 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3904ae8-f35e-4db2-9559-29758492d7c2 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:44.137572 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3904ae8-f35e-4db2-9559-29758492d7c2 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:44.138944 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 703/1404] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:14:44.144250 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de236931-5d2e-4758-84f1-8d84b90d52ab None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:44.144542 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de236931-5d2e-4758-84f1-8d84b90d52ab None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:44.144815 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de236931-5d2e-4758-84f1-8d84b90d52ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:44.162845 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-de236931-5d2e-4758-84f1-8d84b90d52ab None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:14:44.164822 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-de236931-5d2e-4758-84f1-8d84b90d52ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:44.172827 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 702/1405] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:14:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:14:44.216448 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3904ae8-f35e-4db2-9559-29758492d7c2 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:44.231404 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3904ae8-f35e-4db2-9559-29758492d7c2 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:44.237021 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329fcf3-64fa-4398-b6c7-e74f4106d0b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066aaba3e9af4f85ab0cba89a3d32e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:44.237646 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329fcf3-64fa-4398-b6c7-e74f4106d0b9 service nova] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:44.237953 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329fcf3-64fa-4398-b6c7-e74f4106d0b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:44.238218 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329fcf3-64fa-4398-b6c7-e74f4106d0b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:44.247006 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2329fcf3-64fa-4398-b6c7-e74f4106d0b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:44.248619 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2329fcf3-64fa-4398-b6c7-e74f4106d0b9 service nova] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:44.258406 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 704/1406] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:14:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:14:46.736262 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0587d3-5cd9-4663-a7f2-027e34b22260 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:46.736814 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0587d3-5cd9-4663-a7f2-027e34b22260 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:46.736814 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0587d3-5cd9-4663-a7f2-027e34b22260 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:46.738181 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 703/1407] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:14:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:14:46.743934 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a364a0-3d32-4d95-8232-5b1f7938fae6 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:46.744488 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a364a0-3d32-4d95-8232-5b1f7938fae6 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:46.744488 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a364a0-3d32-4d95-8232-5b1f7938fae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:46.764379 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-10a364a0-3d32-4d95-8232-5b1f7938fae6 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:14:46.765625 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-10a364a0-3d32-4d95-8232-5b1f7938fae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:14:46.775948 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 705/1408] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:14:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:14:46.823083 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0587d3-5cd9-4663-a7f2-027e34b22260 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:14:46.838830 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0587d3-5cd9-4663-a7f2-027e34b22260 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:14:46.844527 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ad740-14c7-46a6-ab74-71b6fbc0a870 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066aaba3e9af4f85ab0cba89a3d32e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:14:46.845161 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ad740-14c7-46a6-ab74-71b6fbc0a870 service nova] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:14:46.845442 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ad740-14c7-46a6-ab74-71b6fbc0a870 service nova] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:14:46.845717 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ad740-14c7-46a6-ab74-71b6fbc0a870 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:14:46.855170 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ad740-14c7-46a6-ab74-71b6fbc0a870 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:14:46.856776 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ad740-14c7-46a6-ab74-71b6fbc0a870 service nova] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:14:46.866675 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 704/1409] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:14:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:14:56.758425 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=50 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:57.077436 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=23 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:15:08.828869 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9950a6a-2197-454c-82c5-181145634d3e None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:08.829499 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9950a6a-2197-454c-82c5-181145634d3e None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:08.829499 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9950a6a-2197-454c-82c5-181145634d3e None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:08.830878 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 706/1410] 10.222.0.61 () {54 vars in 918 bytes} [Fri Jun 3 13:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:15:08.836447 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d94fd4-8150-4eb5-b8f1-a55b2f12440e None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:08.836891 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d94fd4-8150-4eb5-b8f1-a55b2f12440e None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:08.836992 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d94fd4-8150-4eb5-b8f1-a55b2f12440e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:08.854563 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-e8d94fd4-8150-4eb5-b8f1-a55b2f12440e None None] MFA Rules not processed for user `a5c4ad16c9454b74ae8445b115cf0af4`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:15:08.858771 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-e8d94fd4-8150-4eb5-b8f1-a55b2f12440e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:15:08.864821 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 705/1411] 10.222.0.61 () {58 vars in 1015 bytes} [Fri Jun 3 13:15:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:15:08.878951 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879c162-66e4-4601-856b-b25363fd595f None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:08.893244 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879c162-66e4-4601-856b-b25363fd595f None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:08.893244 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879c162-66e4-4601-856b-b25363fd595f None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:08.893244 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 707/1412] 10.222.0.61 () {54 vars in 918 bytes} [Fri Jun 3 13:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:15:08.893531 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa417c03-0303-40d8-a57d-3130e75a6cb2 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:08.893531 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa417c03-0303-40d8-a57d-3130e75a6cb2 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:08.893531 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa417c03-0303-40d8-a57d-3130e75a6cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:08.905842 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-fa417c03-0303-40d8-a57d-3130e75a6cb2 None None] MFA Rules not processed for user `066aaba3e9af4f85ab0cba89a3d32e34`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:15:08.907007 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-fa417c03-0303-40d8-a57d-3130e75a6cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:15:08.916431 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 706/1413] 10.222.0.61 () {58 vars in 1015 bytes} [Fri Jun 3 13:15:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:15:11.633912 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade81ac-d474-4944-a398-37be6e6b5f45 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:11.634495 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade81ac-d474-4944-a398-37be6e6b5f45 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:11.634495 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade81ac-d474-4944-a398-37be6e6b5f45 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:11.635810 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 708/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 13:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:15:11.641079 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8f3e5-fc07-4818-bc9e-abd34bd52da2 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:11.641494 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8f3e5-fc07-4818-bc9e-abd34bd52da2 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:11.641634 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8f3e5-fc07-4818-bc9e-abd34bd52da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:11.659751 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-96c8f3e5-fc07-4818-bc9e-abd34bd52da2 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:15:11.660953 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-96c8f3e5-fc07-4818-bc9e-abd34bd52da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:15:11.668776 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 707/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 13:15:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:15:11.711829 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade81ac-d474-4944-a398-37be6e6b5f45 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:15:11.725870 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade81ac-d474-4944-a398-37be6e6b5f45 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:15:11.731436 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e4bea-9582-4afd-9da7-d179588a9907 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066aaba3e9af4f85ab0cba89a3d32e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:15:11.732066 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e4bea-9582-4afd-9da7-d179588a9907 service nova] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:11.732438 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e4bea-9582-4afd-9da7-d179588a9907 service nova] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:11.732673 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e4bea-9582-4afd-9da7-d179588a9907 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:11.741097 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804e4bea-9582-4afd-9da7-d179588a9907 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:15:11.742680 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804e4bea-9582-4afd-9da7-d179588a9907 service nova] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:15:11.752042 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 709/1416] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:15:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:15:12.738686 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a5ec1-9768-49f5-8052-02b3c49a3988 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:12.739271 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a5ec1-9768-49f5-8052-02b3c49a3988 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:12.739271 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a5ec1-9768-49f5-8052-02b3c49a3988 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:12.740725 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 708/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 13:15:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:15:12.746050 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfc589-dd99-427d-a28a-93c7584df33e None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:12.746505 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfc589-dd99-427d-a28a-93c7584df33e None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:12.746617 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfc589-dd99-427d-a28a-93c7584df33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:12.765212 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-d0cfc589-dd99-427d-a28a-93c7584df33e None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:15:12.766396 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-d0cfc589-dd99-427d-a28a-93c7584df33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:15:12.774573 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 710/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 13:15:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:15:12.943106 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a5ec1-9768-49f5-8052-02b3c49a3988 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:15:12.958169 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a5ec1-9768-49f5-8052-02b3c49a3988 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:15:12.967734 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5761f-bd34-46f2-9053-954d6a5ce61e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066aaba3e9af4f85ab0cba89a3d32e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:15:12.968403 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5761f-bd34-46f2-9053-954d6a5ce61e service nova] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:12.968686 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5761f-bd34-46f2-9053-954d6a5ce61e service nova] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:12.968958 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5761f-bd34-46f2-9053-954d6a5ce61e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:12.977506 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5761f-bd34-46f2-9053-954d6a5ce61e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:15:12.979088 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5761f-bd34-46f2-9053-954d6a5ce61e service nova] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:15:12.989063 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 709/1419] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:15:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:15:13.941378 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa533a8-f5eb-402f-b348-ba47dcbc8dfa None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:13.941978 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa533a8-f5eb-402f-b348-ba47dcbc8dfa None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:13.941978 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa533a8-f5eb-402f-b348-ba47dcbc8dfa None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:13.943397 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 711/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 13:15:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:15:13.948773 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0980c38-c8c0-4f62-baa6-463d92dced28 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:13.949292 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0980c38-c8c0-4f62-baa6-463d92dced28 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:13.949403 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0980c38-c8c0-4f62-baa6-463d92dced28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:13.968664 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-c0980c38-c8c0-4f62-baa6-463d92dced28 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:15:13.969855 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-c0980c38-c8c0-4f62-baa6-463d92dced28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:15:13.978260 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 710/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 13:15:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:15:14.134486 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa533a8-f5eb-402f-b348-ba47dcbc8dfa None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:15:14.149179 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa533a8-f5eb-402f-b348-ba47dcbc8dfa None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:15:14.154730 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62634e1b-2d01-4ac9-ba07-48c0ff97cb4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066aaba3e9af4f85ab0cba89a3d32e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:15:14.155360 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62634e1b-2d01-4ac9-ba07-48c0ff97cb4e service nova] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:14.155636 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62634e1b-2d01-4ac9-ba07-48c0ff97cb4e service nova] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:14.155931 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62634e1b-2d01-4ac9-ba07-48c0ff97cb4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:14.164011 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62634e1b-2d01-4ac9-ba07-48c0ff97cb4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:15:14.165633 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62634e1b-2d01-4ac9-ba07-48c0ff97cb4e service nova] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:15:14.174968 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 712/1422] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:15:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 13:15:15.088934 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1618ae5-0b2e-45f4-aebb-1f135a9338a7 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:15.089468 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1618ae5-0b2e-45f4-aebb-1f135a9338a7 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:15.089468 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1618ae5-0b2e-45f4-aebb-1f135a9338a7 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:15.090834 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 711/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 13:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:15:15.095781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b5b47-b194-406a-8bdc-f92135472720 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:15.096237 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b5b47-b194-406a-8bdc-f92135472720 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:15.096353 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b5b47-b194-406a-8bdc-f92135472720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:15.114996 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-3f7b5b47-b194-406a-8bdc-f92135472720 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:15:15.122252 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-3f7b5b47-b194-406a-8bdc-f92135472720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:15:15.124442 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 713/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 13:15:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:15:15.275096 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1618ae5-0b2e-45f4-aebb-1f135a9338a7 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:15:15.289657 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1618ae5-0b2e-45f4-aebb-1f135a9338a7 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:15:15.295115 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd016cda-5536-48a1-bfc6-301ad82137ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066aaba3e9af4f85ab0cba89a3d32e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:15:15.295803 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd016cda-5536-48a1-bfc6-301ad82137ba service nova] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:15.296079 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd016cda-5536-48a1-bfc6-301ad82137ba service nova] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:15.296384 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd016cda-5536-48a1-bfc6-301ad82137ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:15.304549 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd016cda-5536-48a1-bfc6-301ad82137ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:15:15.306107 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd016cda-5536-48a1-bfc6-301ad82137ba service nova] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:15:15.315573 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 712/1425] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:15:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:15:16.221631 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8ad7f-abf5-43d4-8caa-103a27104deb None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:16.222169 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8ad7f-abf5-43d4-8caa-103a27104deb None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:16.222169 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8ad7f-abf5-43d4-8caa-103a27104deb None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:16.223588 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 714/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 13:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 13:15:16.229106 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c7c1a-a50c-419f-9335-12e4c8a9c53a None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:16.229519 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c7c1a-a50c-419f-9335-12e4c8a9c53a None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:16.229651 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c7c1a-a50c-419f-9335-12e4c8a9c53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:16.247879 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-0a6c7c1a-a50c-419f-9335-12e4c8a9c53a None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:15:16.249092 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-0a6c7c1a-a50c-419f-9335-12e4c8a9c53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:15:16.256792 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 713/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 13:15:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:15:16.406185 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8ad7f-abf5-43d4-8caa-103a27104deb None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:15:16.421117 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8ad7f-abf5-43d4-8caa-103a27104deb None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:15:16.426393 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e861a7c9-1d7c-47b4-bab1-d4ccd8bb286c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066aaba3e9af4f85ab0cba89a3d32e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:15:16.427026 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861a7c9-1d7c-47b4-bab1-d4ccd8bb286c service nova] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:16.427307 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861a7c9-1d7c-47b4-bab1-d4ccd8bb286c service nova] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:16.427586 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861a7c9-1d7c-47b4-bab1-d4ccd8bb286c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:16.436160 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e861a7c9-1d7c-47b4-bab1-d4ccd8bb286c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:15:16.437760 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e861a7c9-1d7c-47b4-bab1-d4ccd8bb286c service nova] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:15:16.446987 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 715/1428] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:15:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:15:17.385726 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65556d-6b90-42c8-9cf9-56c5404b113e None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:17.386246 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65556d-6b90-42c8-9cf9-56c5404b113e None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:17.386246 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65556d-6b90-42c8-9cf9-56c5404b113e None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:17.387568 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 714/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 13:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:15:17.392730 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1db594-1193-4f41-8874-85af20006303 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:17.393181 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1db594-1193-4f41-8874-85af20006303 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:17.393297 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1db594-1193-4f41-8874-85af20006303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:17.411850 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-ef1db594-1193-4f41-8874-85af20006303 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:15:17.413077 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-ef1db594-1193-4f41-8874-85af20006303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:15:17.421772 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 716/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 13:15:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:15:17.572865 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65556d-6b90-42c8-9cf9-56c5404b113e None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:15:17.587368 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65556d-6b90-42c8-9cf9-56c5404b113e None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:15:17.592834 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa9889-253a-42d9-812f-effcf14ef610 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066aaba3e9af4f85ab0cba89a3d32e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:15:17.593466 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa9889-253a-42d9-812f-effcf14ef610 service nova] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:17.593745 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa9889-253a-42d9-812f-effcf14ef610 service nova] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:17.594018 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa9889-253a-42d9-812f-effcf14ef610 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:17.602558 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aa9889-253a-42d9-812f-effcf14ef610 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:15:17.604107 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aa9889-253a-42d9-812f-effcf14ef610 service nova] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:15:17.613530 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 715/1431] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:15:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:15:18.538034 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86921033-43ce-4ef6-9dea-373a4639a877 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:18.539133 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86921033-43ce-4ef6-9dea-373a4639a877 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:18.539250 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86921033-43ce-4ef6-9dea-373a4639a877 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:18.540652 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 717/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 13:15:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:15:18.545502 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f209a-24e9-4176-b869-8b2f0236a2da None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:18.545910 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f209a-24e9-4176-b869-8b2f0236a2da None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:18.546049 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f209a-24e9-4176-b869-8b2f0236a2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:18.564077 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-b39f209a-24e9-4176-b869-8b2f0236a2da None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:15:18.565273 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-b39f209a-24e9-4176-b869-8b2f0236a2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:15:18.573161 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 716/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 13:15:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:15:18.723607 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86921033-43ce-4ef6-9dea-373a4639a877 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:15:18.738834 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86921033-43ce-4ef6-9dea-373a4639a877 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:15:18.745161 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c51f9a-4a4a-44a4-a25c-21a2c9692788 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066aaba3e9af4f85ab0cba89a3d32e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:15:18.745823 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c51f9a-4a4a-44a4-a25c-21a2c9692788 service nova] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:18.746093 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c51f9a-4a4a-44a4-a25c-21a2c9692788 service nova] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:18.746371 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c51f9a-4a4a-44a4-a25c-21a2c9692788 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:18.754745 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c51f9a-4a4a-44a4-a25c-21a2c9692788 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:15:18.766575 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c51f9a-4a4a-44a4-a25c-21a2c9692788 service nova] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:15:18.766575 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 718/1434] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:15:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:15:19.683427 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109369a4-0e62-4876-a68b-7b82b3b0ddef None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:19.683949 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109369a4-0e62-4876-a68b-7b82b3b0ddef None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:19.684046 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109369a4-0e62-4876-a68b-7b82b3b0ddef None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:19.685405 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 717/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 13:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:15:19.690462 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82262402-db89-4c59-a47f-6e6e4c460c6c None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:19.690927 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82262402-db89-4c59-a47f-6e6e4c460c6c None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:19.691026 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82262402-db89-4c59-a47f-6e6e4c460c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:19.709685 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-82262402-db89-4c59-a47f-6e6e4c460c6c None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:15:19.711144 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-82262402-db89-4c59-a47f-6e6e4c460c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:15:19.719034 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 719/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 13:15:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:15:19.870035 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109369a4-0e62-4876-a68b-7b82b3b0ddef None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:15:19.884593 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109369a4-0e62-4876-a68b-7b82b3b0ddef None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:15:19.889946 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfcc6b5-370a-42fd-9144-fdf6a588b9e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066aaba3e9af4f85ab0cba89a3d32e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:15:19.890574 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfcc6b5-370a-42fd-9144-fdf6a588b9e0 service nova] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:19.890854 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfcc6b5-370a-42fd-9144-fdf6a588b9e0 service nova] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:19.891127 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfcc6b5-370a-42fd-9144-fdf6a588b9e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:19.899638 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfcc6b5-370a-42fd-9144-fdf6a588b9e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:15:19.901224 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfcc6b5-370a-42fd-9144-fdf6a588b9e0 service nova] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:15:19.910449 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 718/1437] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:15:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:15:20.824923 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a14cf-2ab9-47ce-bbc8-e67a6e0a56cb None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:20.825534 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a14cf-2ab9-47ce-bbc8-e67a6e0a56cb None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:20.825534 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a14cf-2ab9-47ce-bbc8-e67a6e0a56cb None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:20.826880 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 720/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 13:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:15:20.831805 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e5045-27a9-4a23-90d8-e339a6e9c86c None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:20.832271 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e5045-27a9-4a23-90d8-e339a6e9c86c None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:20.832389 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e5045-27a9-4a23-90d8-e339a6e9c86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:20.853104 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-c42e5045-27a9-4a23-90d8-e339a6e9c86c None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:15:20.854295 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-c42e5045-27a9-4a23-90d8-e339a6e9c86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:15:20.862973 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 719/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 13:15:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:15:21.020223 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a14cf-2ab9-47ce-bbc8-e67a6e0a56cb None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:15:21.034654 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a14cf-2ab9-47ce-bbc8-e67a6e0a56cb None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:15:21.040300 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed298c-a07e-48f8-8045-b100c9c5dd24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066aaba3e9af4f85ab0cba89a3d32e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:15:21.040926 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed298c-a07e-48f8-8045-b100c9c5dd24 service nova] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:21.041203 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed298c-a07e-48f8-8045-b100c9c5dd24 service nova] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:21.041474 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed298c-a07e-48f8-8045-b100c9c5dd24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:21.049393 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed298c-a07e-48f8-8045-b100c9c5dd24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:15:21.050995 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed298c-a07e-48f8-8045-b100c9c5dd24 service nova] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:15:21.060767 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 721/1440] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:15:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:15:23.238712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357eee2-7387-4ecd-b09b-9e82def742d9 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:23.239247 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357eee2-7387-4ecd-b09b-9e82def742d9 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:23.239247 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357eee2-7387-4ecd-b09b-9e82def742d9 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:23.240645 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 720/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 13:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:15:23.246315 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fb176-c786-467e-8831-a4936bbd69d2 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:23.246712 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fb176-c786-467e-8831-a4936bbd69d2 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:23.246864 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fb176-c786-467e-8831-a4936bbd69d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:23.264886 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-e98fb176-c786-467e-8831-a4936bbd69d2 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:15:23.266101 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-e98fb176-c786-467e-8831-a4936bbd69d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:15:23.274155 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 722/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 13:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:15:23.312236 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357eee2-7387-4ecd-b09b-9e82def742d9 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:15:23.323451 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357eee2-7387-4ecd-b09b-9e82def742d9 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:15:23.326871 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f9fef-5940-471f-a108-2ad6515fdba8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:15:23.327494 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f9fef-5940-471f-a108-2ad6515fdba8 service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:23.327771 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f9fef-5940-471f-a108-2ad6515fdba8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:23.328040 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f9fef-5940-471f-a108-2ad6515fdba8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:23.336921 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065f9fef-5940-471f-a108-2ad6515fdba8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:15:23.338308 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065f9fef-5940-471f-a108-2ad6515fdba8 service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:15:23.347336 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 721/1443] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:15:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:15:25.760279 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f89ee-099c-4f09-8adc-de8a056fc929 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:25.760833 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f89ee-099c-4f09-8adc-de8a056fc929 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:25.760833 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f89ee-099c-4f09-8adc-de8a056fc929 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:25.762247 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 723/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 13:15:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:15:25.767624 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5502d8-c218-4de9-a383-1a12f911de11 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:25.768028 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5502d8-c218-4de9-a383-1a12f911de11 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:25.768210 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5502d8-c218-4de9-a383-1a12f911de11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:25.785561 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-9b5502d8-c218-4de9-a383-1a12f911de11 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:15:25.786754 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-9b5502d8-c218-4de9-a383-1a12f911de11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:15:25.794540 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 722/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 13:15:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:15:25.833291 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f89ee-099c-4f09-8adc-de8a056fc929 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:15:25.844107 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f89ee-099c-4f09-8adc-de8a056fc929 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:15:25.847693 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2d99e-0e01-4210-b5b1-d5fafb09cec4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:15:25.848359 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2d99e-0e01-4210-b5b1-d5fafb09cec4 service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:25.848645 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2d99e-0e01-4210-b5b1-d5fafb09cec4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:25.848922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2d99e-0e01-4210-b5b1-d5fafb09cec4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:25.857715 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb2d99e-0e01-4210-b5b1-d5fafb09cec4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:15:25.859145 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb2d99e-0e01-4210-b5b1-d5fafb09cec4 service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:15:25.869172 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 724/1446] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:15:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:15:28.471540 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7f0dc-0890-46d3-ba0f-8f955769e487 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:28.472180 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7f0dc-0890-46d3-ba0f-8f955769e487 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:28.472180 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7f0dc-0890-46d3-ba0f-8f955769e487 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:28.473529 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 723/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 13:15:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:15:28.479559 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100edf05-3ad2-486d-b8f8-bc822477c738 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:28.480020 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100edf05-3ad2-486d-b8f8-bc822477c738 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:28.480166 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100edf05-3ad2-486d-b8f8-bc822477c738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:28.498587 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-100edf05-3ad2-486d-b8f8-bc822477c738 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:15:28.499767 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-100edf05-3ad2-486d-b8f8-bc822477c738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:15:28.507685 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 725/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 13:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:15:28.546709 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e7f0dc-0890-46d3-ba0f-8f955769e487 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:15:28.557415 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e7f0dc-0890-46d3-ba0f-8f955769e487 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:15:28.560856 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da057ca3-6cf9-4a54-aa6b-7ce14c8956e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:15:28.561482 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da057ca3-6cf9-4a54-aa6b-7ce14c8956e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:28.561762 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da057ca3-6cf9-4a54-aa6b-7ce14c8956e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:28.562035 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da057ca3-6cf9-4a54-aa6b-7ce14c8956e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:28.571074 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da057ca3-6cf9-4a54-aa6b-7ce14c8956e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:15:28.572529 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da057ca3-6cf9-4a54-aa6b-7ce14c8956e6 service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:15:28.581732 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 724/1449] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:15:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:15:30.941124 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd0bd7-47a5-4228-9a4c-f482de640595 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:30.941723 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd0bd7-47a5-4228-9a4c-f482de640595 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:30.941723 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd0bd7-47a5-4228-9a4c-f482de640595 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:30.943042 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 726/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 13:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:15:30.949151 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b34fb-bfde-42a5-bac4-2cf2d43b4ff7 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:30.949595 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b34fb-bfde-42a5-bac4-2cf2d43b4ff7 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:30.949755 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b34fb-bfde-42a5-bac4-2cf2d43b4ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:30.967509 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-668b34fb-bfde-42a5-bac4-2cf2d43b4ff7 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:15:30.968735 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-668b34fb-bfde-42a5-bac4-2cf2d43b4ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:15:30.976818 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 725/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 13:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:15:31.015850 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd0bd7-47a5-4228-9a4c-f482de640595 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:15:31.026523 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd0bd7-47a5-4228-9a4c-f482de640595 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:15:31.029958 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1da1e9-ecc3-4776-abbc-8821e489d2ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:15:31.030583 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1da1e9-ecc3-4776-abbc-8821e489d2ae service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:31.030862 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1da1e9-ecc3-4776-abbc-8821e489d2ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:31.031135 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1da1e9-ecc3-4776-abbc-8821e489d2ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:31.040114 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1da1e9-ecc3-4776-abbc-8821e489d2ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:15:31.041562 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1da1e9-ecc3-4776-abbc-8821e489d2ae service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:15:31.050840 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 727/1452] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:15:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:15:33.356904 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce326c4e-b702-4ce5-b97c-305e5d87fe2c None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:33.357474 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce326c4e-b702-4ce5-b97c-305e5d87fe2c None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:33.357474 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce326c4e-b702-4ce5-b97c-305e5d87fe2c None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:33.358754 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 726/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 13:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:15:33.364214 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b913e8-ce3f-4916-a1cf-ddcd387c0402 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:33.364625 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b913e8-ce3f-4916-a1cf-ddcd387c0402 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:33.364774 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b913e8-ce3f-4916-a1cf-ddcd387c0402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:33.383457 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-74b913e8-ce3f-4916-a1cf-ddcd387c0402 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:15:33.385114 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-74b913e8-ce3f-4916-a1cf-ddcd387c0402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:15:33.392867 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 728/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 13:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:15:33.431578 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce326c4e-b702-4ce5-b97c-305e5d87fe2c None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:15:33.442137 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce326c4e-b702-4ce5-b97c-305e5d87fe2c None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:15:33.445822 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312bc583-0412-424c-a7f2-c60977975d3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:15:33.446449 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312bc583-0412-424c-a7f2-c60977975d3e service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:33.446729 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312bc583-0412-424c-a7f2-c60977975d3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:33.447001 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312bc583-0412-424c-a7f2-c60977975d3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:33.455728 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312bc583-0412-424c-a7f2-c60977975d3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:15:33.457167 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312bc583-0412-424c-a7f2-c60977975d3e service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:15:33.466640 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 727/1455] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:15:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:15:35.795271 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd336ed-52e0-4c4b-8495-4c66805c22b0 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:35.795870 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd336ed-52e0-4c4b-8495-4c66805c22b0 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:35.795870 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd336ed-52e0-4c4b-8495-4c66805c22b0 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:35.797216 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 729/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 13:15:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:15:35.802369 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2983d-bc10-4ad0-8733-81de0dc64889 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:35.802848 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2983d-bc10-4ad0-8733-81de0dc64889 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:35.802954 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2983d-bc10-4ad0-8733-81de0dc64889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:35.820986 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-2bc2983d-bc10-4ad0-8733-81de0dc64889 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:15:35.822181 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-2bc2983d-bc10-4ad0-8733-81de0dc64889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:15:35.829991 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 728/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 13:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:15:35.868422 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd336ed-52e0-4c4b-8495-4c66805c22b0 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:15:35.879094 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd336ed-52e0-4c4b-8495-4c66805c22b0 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:15:35.883355 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c8428-55cd-46bf-88e8-7a9b95890738 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:15:35.884017 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c8428-55cd-46bf-88e8-7a9b95890738 service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:35.884344 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c8428-55cd-46bf-88e8-7a9b95890738 service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:35.884625 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c8428-55cd-46bf-88e8-7a9b95890738 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:35.893959 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c8428-55cd-46bf-88e8-7a9b95890738 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:15:35.895404 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c8428-55cd-46bf-88e8-7a9b95890738 service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:15:35.905519 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 730/1458] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:15:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:15:38.181794 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf5109-4bbb-45be-87bc-14165d4422b6 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:38.182354 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf5109-4bbb-45be-87bc-14165d4422b6 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:38.182354 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf5109-4bbb-45be-87bc-14165d4422b6 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:38.183709 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 729/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 13:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:15:38.189093 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193687e-80a6-4875-bcac-9076f53491d3 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:38.189517 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193687e-80a6-4875-bcac-9076f53491d3 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:38.189654 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193687e-80a6-4875-bcac-9076f53491d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:38.195972 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=70 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:15:38.207990 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-b193687e-80a6-4875-bcac-9076f53491d3 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:15:38.209205 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-b193687e-80a6-4875-bcac-9076f53491d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:15:38.217091 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 731/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 13:15:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:15:38.255504 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf5109-4bbb-45be-87bc-14165d4422b6 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:15:38.261052 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=73 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:15:38.266563 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf5109-4bbb-45be-87bc-14165d4422b6 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:15:38.270006 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43821b5d-7d14-4d83-b817-0f3ae8683e6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:15:38.270636 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43821b5d-7d14-4d83-b817-0f3ae8683e6e service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:38.270917 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43821b5d-7d14-4d83-b817-0f3ae8683e6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:38.271191 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43821b5d-7d14-4d83-b817-0f3ae8683e6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:38.280681 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43821b5d-7d14-4d83-b817-0f3ae8683e6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:15:38.282164 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43821b5d-7d14-4d83-b817-0f3ae8683e6e service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:15:38.292704 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 730/1461] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:15:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:15:40.585444 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599ad26-2790-4506-bf72-5bd47cb39735 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:40.586023 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599ad26-2790-4506-bf72-5bd47cb39735 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:40.586023 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599ad26-2790-4506-bf72-5bd47cb39735 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:40.587374 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 732/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 13:15:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:15:40.592783 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1aa87-4857-4eaf-a978-4e8bf5d4a78b None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:40.593225 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1aa87-4857-4eaf-a978-4e8bf5d4a78b None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:40.593339 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1aa87-4857-4eaf-a978-4e8bf5d4a78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:40.611719 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-f4a1aa87-4857-4eaf-a978-4e8bf5d4a78b None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:15:40.612942 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-f4a1aa87-4857-4eaf-a978-4e8bf5d4a78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:15:40.620749 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 731/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 13:15:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:15:40.657253 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599ad26-2790-4506-bf72-5bd47cb39735 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:15:40.668602 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599ad26-2790-4506-bf72-5bd47cb39735 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:15:40.672052 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0d1f4-35e0-4a11-b62c-4bada31e9172 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:15:40.672721 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0d1f4-35e0-4a11-b62c-4bada31e9172 service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:40.673006 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0d1f4-35e0-4a11-b62c-4bada31e9172 service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:40.673280 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0d1f4-35e0-4a11-b62c-4bada31e9172 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:40.682256 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c0d1f4-35e0-4a11-b62c-4bada31e9172 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:15:40.683698 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c0d1f4-35e0-4a11-b62c-4bada31e9172 service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:15:40.692899 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 733/1464] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:15:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:15:42.943123 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892da9c8-f15b-4646-bb0c-bc264d10998f None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:42.948524 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892da9c8-f15b-4646-bb0c-bc264d10998f None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:42.948524 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892da9c8-f15b-4646-bb0c-bc264d10998f None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:42.948524 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 732/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 13:15:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:15:42.951146 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444eb26-06a8-495e-bdf4-4d197b0459e8 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:42.951555 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444eb26-06a8-495e-bdf4-4d197b0459e8 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:42.951695 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444eb26-06a8-495e-bdf4-4d197b0459e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:42.970312 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-a444eb26-06a8-495e-bdf4-4d197b0459e8 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:15:42.971490 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-a444eb26-06a8-495e-bdf4-4d197b0459e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:15:42.979528 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 734/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 13:15:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:15:43.017161 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892da9c8-f15b-4646-bb0c-bc264d10998f None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:15:43.027777 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892da9c8-f15b-4646-bb0c-bc264d10998f None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:15:43.031335 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5503c2-4215-4cdd-8078-7f0d4c42d03f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:15:43.031961 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5503c2-4215-4cdd-8078-7f0d4c42d03f service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:43.032274 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5503c2-4215-4cdd-8078-7f0d4c42d03f service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:43.032548 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5503c2-4215-4cdd-8078-7f0d4c42d03f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:43.041289 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5503c2-4215-4cdd-8078-7f0d4c42d03f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:15:43.042693 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5503c2-4215-4cdd-8078-7f0d4c42d03f service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:15:43.051870 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 733/1467] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:15:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:15:45.328195 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80536953-5fc9-4907-a855-98d1c1c7d2e1 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:45.328748 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80536953-5fc9-4907-a855-98d1c1c7d2e1 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:45.328748 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80536953-5fc9-4907-a855-98d1c1c7d2e1 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:45.330174 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 735/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 13:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:15:45.336235 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdb017-d82b-4339-939d-36c1caeb7038 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:45.336692 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdb017-d82b-4339-939d-36c1caeb7038 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:45.336796 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdb017-d82b-4339-939d-36c1caeb7038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:45.354640 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-03fdb017-d82b-4339-939d-36c1caeb7038 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:15:45.355827 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-03fdb017-d82b-4339-939d-36c1caeb7038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:15:45.363767 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 734/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 13:15:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:15:45.400520 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80536953-5fc9-4907-a855-98d1c1c7d2e1 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:15:45.410985 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80536953-5fc9-4907-a855-98d1c1c7d2e1 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:15:45.414581 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1f837-0656-4819-8adf-20a3a7b42997 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:15:45.415205 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1f837-0656-4819-8adf-20a3a7b42997 service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:15:45.415484 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1f837-0656-4819-8adf-20a3a7b42997 service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:15:45.415754 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1f837-0656-4819-8adf-20a3a7b42997 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:15:45.424943 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f1f837-0656-4819-8adf-20a3a7b42997 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:15:45.426369 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f1f837-0656-4819-8adf-20a3a7b42997 service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:15:45.435857 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 736/1470] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:15:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:15:55.349018 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=17 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:15:55.431733 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=17 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:16:17.525660 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739206d8-baab-4682-af0e-067c1d6a80f9 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:16:17.526282 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739206d8-baab-4682-af0e-067c1d6a80f9 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:16:17.526282 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739206d8-baab-4682-af0e-067c1d6a80f9 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:16:17.527582 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 735/1471] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:16:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:16:17.532779 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc79d78-6b00-4567-a2b7-d03d861ec50e None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:16:17.533201 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc79d78-6b00-4567-a2b7-d03d861ec50e None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:16:17.533309 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc79d78-6b00-4567-a2b7-d03d861ec50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:16:17.551355 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-dcc79d78-6b00-4567-a2b7-d03d861ec50e None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:16:17.552577 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-dcc79d78-6b00-4567-a2b7-d03d861ec50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:16:17.560322 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 737/1472] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:16:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:16:17.607679 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e1344-1e97-409c-bdea-3b0d885b378f None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:16:17.607961 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e1344-1e97-409c-bdea-3b0d885b378f None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:16:17.608259 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e1344-1e97-409c-bdea-3b0d885b378f None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:16:17.609642 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 736/1473] 10.222.0.61 () {54 vars in 962 bytes} [Fri Jun 3 13:16:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:16:17.614671 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33965f61-8b48-4708-99ad-56230f971617 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:16:17.614956 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33965f61-8b48-4708-99ad-56230f971617 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:16:17.615259 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33965f61-8b48-4708-99ad-56230f971617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:16:17.633557 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-33965f61-8b48-4708-99ad-56230f971617 None None] MFA Rules not processed for user `60eeb0b3e37a4604ab8f8b73c2b021f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:16:17.634655 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-33965f61-8b48-4708-99ad-56230f971617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:16:17.641030 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 738/1474] 10.222.0.61 () {58 vars in 1059 bytes} [Fri Jun 3 13:16:17 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:16:17.648948 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e1344-1e97-409c-bdea-3b0d885b378f None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:16:17.659327 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e1344-1e97-409c-bdea-3b0d885b378f None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:16:17.662975 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70758e4e-c9df-412b-bd00-2033980ecfec service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60eeb0b3e37a4604ab8f8b73c2b021f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:16:17.663594 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70758e4e-c9df-412b-bd00-2033980ecfec service glance] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:16:17.663871 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70758e4e-c9df-412b-bd00-2033980ecfec service glance] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:16:17.664259 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70758e4e-c9df-412b-bd00-2033980ecfec service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:16:17.673363 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70758e4e-c9df-412b-bd00-2033980ecfec service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:16:17.674779 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70758e4e-c9df-412b-bd00-2033980ecfec service glance] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:16:17.684207 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 737/1475] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:16:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:16:20.026851 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362c389-34a5-4c64-a010-d18c7afb0bfd None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:16:20.027374 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362c389-34a5-4c64-a010-d18c7afb0bfd None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:16:20.027485 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362c389-34a5-4c64-a010-d18c7afb0bfd None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:16:20.028805 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 739/1476] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:16:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:16:20.034122 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7046e186-1437-4071-bd1e-8cffc400f2ee None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:16:20.034587 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7046e186-1437-4071-bd1e-8cffc400f2ee None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:16:20.034694 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7046e186-1437-4071-bd1e-8cffc400f2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:16:20.052229 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-7046e186-1437-4071-bd1e-8cffc400f2ee None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:16:20.053724 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-7046e186-1437-4071-bd1e-8cffc400f2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:16:20.061344 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 738/1477] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:16:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:16:20.085552 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362c389-34a5-4c64-a010-d18c7afb0bfd None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:16:20.097648 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362c389-34a5-4c64-a010-d18c7afb0bfd None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:16:20.102130 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f4ecba-581c-4256-8b09-d7b6d013a005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:16:20.102763 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4ecba-581c-4256-8b09-d7b6d013a005 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:16:20.103041 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4ecba-581c-4256-8b09-d7b6d013a005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:16:20.103310 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4ecba-581c-4256-8b09-d7b6d013a005 admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:16:20.104019 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f4ecba-581c-4256-8b09-d7b6d013a005 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:16:20.105796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: WARNING py.warnings [None req-74f4ecba-581c-4256-8b09-d7b6d013a005 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 13:16:20.105796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: warnings.warn(msg) Jun 03 13:16:20.105796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: Jun 03 13:16:20.106918 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f4ecba-581c-4256-8b09-d7b6d013a005 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:16:20.126381 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 740/1478] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jun 3 13:16:20 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:16:22.393390 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b44f7-eb7e-4d34-afcd-a6d7ca5300b1 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:16:22.393922 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b44f7-eb7e-4d34-afcd-a6d7ca5300b1 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:16:22.393922 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b44f7-eb7e-4d34-afcd-a6d7ca5300b1 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:16:22.395208 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 739/1479] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:16:22.400600 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772044c8-9378-4d1b-9680-70987b85a12f None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:16:22.401057 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772044c8-9378-4d1b-9680-70987b85a12f None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:16:22.401169 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772044c8-9378-4d1b-9680-70987b85a12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:16:22.419414 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-772044c8-9378-4d1b-9680-70987b85a12f None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:16:22.420633 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-772044c8-9378-4d1b-9680-70987b85a12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:16:22.429022 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 741/1480] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:16:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:16:22.471316 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b44f7-eb7e-4d34-afcd-a6d7ca5300b1 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:16:22.485973 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b44f7-eb7e-4d34-afcd-a6d7ca5300b1 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:16:22.492312 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b84db3b-c648-4efb-aa3a-4aa32cb6fc7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066aaba3e9af4f85ab0cba89a3d32e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:16:22.492943 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84db3b-c648-4efb-aa3a-4aa32cb6fc7e service nova] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:16:22.493226 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84db3b-c648-4efb-aa3a-4aa32cb6fc7e service nova] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:16:22.493567 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84db3b-c648-4efb-aa3a-4aa32cb6fc7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:16:22.501530 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b84db3b-c648-4efb-aa3a-4aa32cb6fc7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:16:22.503089 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b84db3b-c648-4efb-aa3a-4aa32cb6fc7e service nova] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:16:22.512638 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 740/1481] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:16:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:16:25.087853 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08f81e-4566-4fbb-bcee-cf5cb8dd9cae None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:16:25.088467 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08f81e-4566-4fbb-bcee-cf5cb8dd9cae None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:16:25.088467 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08f81e-4566-4fbb-bcee-cf5cb8dd9cae None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:16:25.089789 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 742/1482] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:16:25.094944 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a7926-7eda-4405-8ed5-4380564aaa11 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:16:25.095368 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a7926-7eda-4405-8ed5-4380564aaa11 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:16:25.095502 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a7926-7eda-4405-8ed5-4380564aaa11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:16:25.113147 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-b80a7926-7eda-4405-8ed5-4380564aaa11 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:16:25.114347 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-b80a7926-7eda-4405-8ed5-4380564aaa11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:16:25.122630 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 741/1483] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:16:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:16:25.158971 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08f81e-4566-4fbb-bcee-cf5cb8dd9cae None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:16:25.170305 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08f81e-4566-4fbb-bcee-cf5cb8dd9cae None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:16:25.173817 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5afb3-85f3-4af0-ad88-196118dc15c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:16:25.174449 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5afb3-85f3-4af0-ad88-196118dc15c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:16:25.174733 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5afb3-85f3-4af0-ad88-196118dc15c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:16:25.175013 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5afb3-85f3-4af0-ad88-196118dc15c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:16:25.184616 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5afb3-85f3-4af0-ad88-196118dc15c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:16:25.186089 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5afb3-85f3-4af0-ad88-196118dc15c0 service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:16:25.195722 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 743/1484] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:16:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:16:27.501862 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ee926-7faa-4a99-a076-6e0dfe190448 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:16:27.502448 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ee926-7faa-4a99-a076-6e0dfe190448 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:16:27.502448 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ee926-7faa-4a99-a076-6e0dfe190448 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:16:27.503860 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 742/1485] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:16:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:16:27.509761 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e875b79-75d9-4c8f-b517-022462cc07b6 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:16:27.510272 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e875b79-75d9-4c8f-b517-022462cc07b6 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:16:27.510436 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e875b79-75d9-4c8f-b517-022462cc07b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:16:27.528506 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-3e875b79-75d9-4c8f-b517-022462cc07b6 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:16:27.529700 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-3e875b79-75d9-4c8f-b517-022462cc07b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:16:27.537564 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 744/1486] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:16:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:16:27.575765 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ee926-7faa-4a99-a076-6e0dfe190448 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:16:27.587326 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ee926-7faa-4a99-a076-6e0dfe190448 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:16:27.590863 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae7a53-9349-4488-bc0f-906c4a4d20aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:16:27.591509 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae7a53-9349-4488-bc0f-906c4a4d20aa service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:16:27.591771 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae7a53-9349-4488-bc0f-906c4a4d20aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:16:27.592044 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae7a53-9349-4488-bc0f-906c4a4d20aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:16:27.600892 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aae7a53-9349-4488-bc0f-906c4a4d20aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:16:27.602328 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aae7a53-9349-4488-bc0f-906c4a4d20aa service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:16:27.611773 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 743/1487] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:16:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:16:30.009727 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d28fb6-a18a-46de-842e-c9ca86308f09 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:16:30.010266 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d28fb6-a18a-46de-842e-c9ca86308f09 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:16:30.010266 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d28fb6-a18a-46de-842e-c9ca86308f09 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:16:30.011693 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 745/1488] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:16:30.016964 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5653cf-26ee-4ca3-9b55-898e2baf63a8 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:16:30.017412 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5653cf-26ee-4ca3-9b55-898e2baf63a8 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:16:30.017520 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5653cf-26ee-4ca3-9b55-898e2baf63a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:16:30.034767 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-5d5653cf-26ee-4ca3-9b55-898e2baf63a8 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:16:30.035954 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-5d5653cf-26ee-4ca3-9b55-898e2baf63a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:16:30.045279 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 744/1489] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:16:30.086356 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d28fb6-a18a-46de-842e-c9ca86308f09 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:16:30.097122 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d28fb6-a18a-46de-842e-c9ca86308f09 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:16:30.101015 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c7a39d-b1e1-4cc0-b94f-8555e829bbcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:16:30.101649 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7a39d-b1e1-4cc0-b94f-8555e829bbcd service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:16:30.101934 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7a39d-b1e1-4cc0-b94f-8555e829bbcd service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:16:30.102208 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7a39d-b1e1-4cc0-b94f-8555e829bbcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:16:30.111084 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c7a39d-b1e1-4cc0-b94f-8555e829bbcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:16:30.112809 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c7a39d-b1e1-4cc0-b94f-8555e829bbcd service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:16:30.123003 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 746/1490] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:16:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:16:32.731713 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e52e4-a21f-4e91-b670-ec36dd499d70 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:16:32.732347 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e52e4-a21f-4e91-b670-ec36dd499d70 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:16:32.732347 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e52e4-a21f-4e91-b670-ec36dd499d70 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:16:32.733687 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 745/1491] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jun 3 13:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:16:32.739743 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696ed3e-ecd9-43ca-9b0b-235daf3433b3 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:16:32.740900 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696ed3e-ecd9-43ca-9b0b-235daf3433b3 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:16:32.741122 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696ed3e-ecd9-43ca-9b0b-235daf3433b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:16:32.759735 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-9696ed3e-ecd9-43ca-9b0b-235daf3433b3 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:16:32.760974 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-9696ed3e-ecd9-43ca-9b0b-235daf3433b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:16:32.768767 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 747/1492] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jun 3 13:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:16:32.808622 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e52e4-a21f-4e91-b670-ec36dd499d70 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:16:32.820021 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e52e4-a21f-4e91-b670-ec36dd499d70 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:16:32.823583 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1773849-d675-4354-9507-5d1d9e6feceb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:16:32.824240 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1773849-d675-4354-9507-5d1d9e6feceb service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:16:32.824523 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1773849-d675-4354-9507-5d1d9e6feceb service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:16:32.824797 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1773849-d675-4354-9507-5d1d9e6feceb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:16:32.834434 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1773849-d675-4354-9507-5d1d9e6feceb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:16:32.835847 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1773849-d675-4354-9507-5d1d9e6feceb service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:16:32.845103 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 746/1493] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:16:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:16:42.753849 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=33 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:16:42.840993 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=33 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:18:08.298558 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9c54a-2d78-496d-8b3d-f9a46fed5fe7 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:18:08.299088 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9c54a-2d78-496d-8b3d-f9a46fed5fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:18:08.299088 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9c54a-2d78-496d-8b3d-f9a46fed5fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:18:08.316782 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-a5e9c54a-2d78-496d-8b3d-f9a46fed5fe7 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:18:08.317969 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-a5e9c54a-2d78-496d-8b3d-f9a46fed5fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:18:08.325987 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 748/1494] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:18:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:18:08.334096 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80699083-db20-4246-84ea-1ad740d76044 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:18:08.334618 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80699083-db20-4246-84ea-1ad740d76044 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:18:08.334618 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80699083-db20-4246-84ea-1ad740d76044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:18:08.353767 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-80699083-db20-4246-84ea-1ad740d76044 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:18:08.354934 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-80699083-db20-4246-84ea-1ad740d76044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:18:08.362522 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 747/1495] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:18:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:18:08.367309 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e9c54a-2d78-496d-8b3d-f9a46fed5fe7 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:18:08.376983 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e9c54a-2d78-496d-8b3d-f9a46fed5fe7 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:18:08.381463 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6dacf-3e63-42c2-a32a-dec459739888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:18:08.382112 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6dacf-3e63-42c2-a32a-dec459739888 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:18:08.382467 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6dacf-3e63-42c2-a32a-dec459739888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:18:08.382748 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6dacf-3e63-42c2-a32a-dec459739888 admin admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:18:08.383475 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d6dacf-3e63-42c2-a32a-dec459739888 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:18:08.383783 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d6dacf-3e63-42c2-a32a-dec459739888 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:18:08.384903 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: WARNING py.warnings [None req-e0d6dacf-3e63-42c2-a32a-dec459739888 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 13:18:08.384903 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: warnings.warn(msg) Jun 03 13:18:08.384903 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: Jun 03 13:18:08.385789 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d6dacf-3e63-42c2-a32a-dec459739888 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:18:08.397462 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 749/1496] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:18:08.405943 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80699083-db20-4246-84ea-1ad740d76044 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:18:08.415859 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80699083-db20-4246-84ea-1ad740d76044 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:18:08.420491 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc2408-a162-45b8-b5de-f43a72458866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:18:08.421138 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc2408-a162-45b8-b5de-f43a72458866 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:18:08.421417 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc2408-a162-45b8-b5de-f43a72458866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:18:08.421690 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc2408-a162-45b8-b5de-f43a72458866 admin admin] PATH_INFO: `/v3/projects` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:18:08.422372 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bc2408-a162-45b8-b5de-f43a72458866 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:18:08.424111 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: WARNING py.warnings [None req-b1bc2408-a162-45b8-b5de-f43a72458866 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 13:18:08.424111 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: warnings.warn(msg) Jun 03 13:18:08.424111 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: Jun 03 13:18:08.425389 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bc2408-a162-45b8-b5de-f43a72458866 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:18:08.531837 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 748/1497] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:18:08 2022] POST /identity/v3/projects => generated 379 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:18:08.535957 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6dacf-3e63-42c2-a32a-dec459739888 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:18:08.546599 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6dacf-3e63-42c2-a32a-dec459739888 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:18:08.601969 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada71a83-c6e7-4921-9f34-8b23454e28e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:18:08.602558 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada71a83-c6e7-4921-9f34-8b23454e28e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:18:08.602837 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada71a83-c6e7-4921-9f34-8b23454e28e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:18:08.603107 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada71a83-c6e7-4921-9f34-8b23454e28e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:18:08.603774 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada71a83-c6e7-4921-9f34-8b23454e28e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:18:08.604818 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: WARNING py.warnings [None req-ada71a83-c6e7-4921-9f34-8b23454e28e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 13:18:08.604818 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: warnings.warn(msg) Jun 03 13:18:08.604818 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: Jun 03 13:18:08.606000 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada71a83-c6e7-4921-9f34-8b23454e28e0 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:18:08.684191 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 750/1498] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:18:08 2022] POST /identity/v3/users => generated 290 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:18:08.688419 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc2408-a162-45b8-b5de-f43a72458866 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:18:08.699343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc2408-a162-45b8-b5de-f43a72458866 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:18:08.707213 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6edbf-40db-4a49-9989-c7e7e146a0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:18:08.707213 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6edbf-40db-4a49-9989-c7e7e146a0a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:18:08.707213 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6edbf-40db-4a49-9989-c7e7e146a0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:18:08.707213 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6edbf-40db-4a49-9989-c7e7e146a0a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:18:08.707687 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b6edbf-40db-4a49-9989-c7e7e146a0a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:18:08.707687 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: WARNING py.warnings [None req-d1b6edbf-40db-4a49-9989-c7e7e146a0a9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 13:18:08.707687 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: warnings.warn(msg) Jun 03 13:18:08.707687 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: Jun 03 13:18:08.708471 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b6edbf-40db-4a49-9989-c7e7e146a0a9 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:18:08.722268 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 749/1499] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:18:08.726662 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada71a83-c6e7-4921-9f34-8b23454e28e0 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:18:08.736916 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada71a83-c6e7-4921-9f34-8b23454e28e0 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:18:08.741660 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546fa7f9-c87f-47d6-a69e-b66e181d79f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:18:08.742322 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546fa7f9-c87f-47d6-a69e-b66e181d79f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:18:08.742596 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546fa7f9-c87f-47d6-a69e-b66e181d79f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:18:08.742870 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546fa7f9-c87f-47d6-a69e-b66e181d79f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:18:08.743579 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546fa7f9-c87f-47d6-a69e-b66e181d79f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:18:08.744636 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: WARNING py.warnings [None req-546fa7f9-c87f-47d6-a69e-b66e181d79f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 13:18:08.744636 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: warnings.warn(msg) Jun 03 13:18:08.744636 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: Jun 03 13:18:08.745514 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546fa7f9-c87f-47d6-a69e-b66e181d79f3 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:18:08.759055 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 751/1500] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:18:08.763203 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6edbf-40db-4a49-9989-c7e7e146a0a9 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:18:08.773725 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6edbf-40db-4a49-9989-c7e7e146a0a9 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:18:08.778562 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397397b-4ebc-424b-966f-f3e464aac9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:18:08.783237 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397397b-4ebc-424b-966f-f3e464aac9be admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:18:08.783237 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397397b-4ebc-424b-966f-f3e464aac9be admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:18:08.783237 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397397b-4ebc-424b-966f-f3e464aac9be admin admin] PATH_INFO: `/v3/projects/205def9b646341689061c19821552a8a/users/f173b78d815d4c508c476e924c66cc48/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:18:08.802484 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a397397b-4ebc-424b-966f-f3e464aac9be admin admin] RBAC: Authorizing `identity:create_grant(project_id=205def9b646341689061c19821552a8a, user_id=f173b78d815d4c508c476e924c66cc48, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:18:08.803631 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: WARNING py.warnings [None req-a397397b-4ebc-424b-966f-f3e464aac9be admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 13:18:08.803631 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: warnings.warn(msg) Jun 03 13:18:08.803631 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: Jun 03 13:18:08.805837 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a397397b-4ebc-424b-966f-f3e464aac9be admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:18:08.925352 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 750/1501] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:18:08 2022] PUT /identity/v3/projects/205def9b646341689061c19821552a8a/users/f173b78d815d4c508c476e924c66cc48/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:18:08.938250 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce93f7b-2def-403d-adca-fa311e0383c0 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:18:08.938536 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce93f7b-2def-403d-adca-fa311e0383c0 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:18:08.938811 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce93f7b-2def-403d-adca-fa311e0383c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:18:08.965103 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-1ce93f7b-2def-403d-adca-fa311e0383c0 None None] MFA Rules not processed for user `f173b78d815d4c508c476e924c66cc48`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:18:08.966300 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-1ce93f7b-2def-403d-adca-fa311e0383c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:18:09.033580 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 752/1502] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:18:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:18:09.047011 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afff2a-5de9-43c8-8b8e-3f7ca05b5288 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:18:09.047302 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afff2a-5de9-43c8-8b8e-3f7ca05b5288 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:18:09.047578 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afff2a-5de9-43c8-8b8e-3f7ca05b5288 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:18:09.048969 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 751/1503] 10.222.0.61 () {54 vars in 963 bytes} [Fri Jun 3 13:18:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:18:09.053793 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf79141-23b6-4e3e-9079-7865f6c5ed04 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:18:09.054619 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf79141-23b6-4e3e-9079-7865f6c5ed04 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:18:09.055016 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf79141-23b6-4e3e-9079-7865f6c5ed04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:18:09.073437 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-faf79141-23b6-4e3e-9079-7865f6c5ed04 None None] MFA Rules not processed for user `303176c26fc74d4892b2f83c81f01b60`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:18:09.074624 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-faf79141-23b6-4e3e-9079-7865f6c5ed04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:18:09.117779 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:18:09.125258 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 753/1504] 10.222.0.61 () {58 vars in 1060 bytes} [Fri Jun 3 13:18:09 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:18:09.133826 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35afff2a-5de9-43c8-8b8e-3f7ca05b5288 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:18:09.144120 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35afff2a-5de9-43c8-8b8e-3f7ca05b5288 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:18:09.147589 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ecd707-e74e-4b66-9b14-b7db6a45609a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:18:09.148394 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecd707-e74e-4b66-9b14-b7db6a45609a service cinder] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:18:09.148669 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecd707-e74e-4b66-9b14-b7db6a45609a service cinder] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:18:09.148941 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecd707-e74e-4b66-9b14-b7db6a45609a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:18:09.157314 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ecd707-e74e-4b66-9b14-b7db6a45609a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:18:09.158717 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ecd707-e74e-4b66-9b14-b7db6a45609a service cinder] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:18:09.167941 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 752/1505] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:18:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:18:09.211223 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512e058-4604-4037-9c17-c15556b4b6e5 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:18:09.211660 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512e058-4604-4037-9c17-c15556b4b6e5 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:18:09.211949 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512e058-4604-4037-9c17-c15556b4b6e5 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:18:09.213275 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 754/1506] 10.222.0.61 () {52 vars in 829 bytes} [Fri Jun 3 13:18:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:18:09.217293 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ecd707-e74e-4b66-9b14-b7db6a45609a service cinder] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:18:09.278613 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ecd707-e74e-4b66-9b14-b7db6a45609a service cinder] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:18:09.283201 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a864c6d-1969-4535-bf5f-4df69f8bfda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:18:09.284072 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a864c6d-1969-4535-bf5f-4df69f8bfda8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:18:09.284414 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a864c6d-1969-4535-bf5f-4df69f8bfda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:18:09.284677 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a864c6d-1969-4535-bf5f-4df69f8bfda8 admin admin] PATH_INFO: `/v3/users/f173b78d815d4c508c476e924c66cc48` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:18:09.285890 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a864c6d-1969-4535-bf5f-4df69f8bfda8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f173b78d815d4c508c476e924c66cc48)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:18:09.286909 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: WARNING py.warnings [None req-6a864c6d-1969-4535-bf5f-4df69f8bfda8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 13:18:09.286909 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: warnings.warn(msg) Jun 03 13:18:09.286909 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: Jun 03 13:18:09.288123 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a864c6d-1969-4535-bf5f-4df69f8bfda8 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:18:09.502301 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-6a864c6d-1969-4535-bf5f-4df69f8bfda8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f173b78d815d4c508c476e924c66cc48'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:18:09.528543 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-6a864c6d-1969-4535-bf5f-4df69f8bfda8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f173b78d815d4c508c476e924c66cc48'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:18:09.529340 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-6a864c6d-1969-4535-bf5f-4df69f8bfda8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f173b78d815d4c508c476e924c66cc48'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:18:09.541661 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-6a864c6d-1969-4535-bf5f-4df69f8bfda8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f173b78d815d4c508c476e924c66cc48'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:18:09.542301 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-6a864c6d-1969-4535-bf5f-4df69f8bfda8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f173b78d815d4c508c476e924c66cc48'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:18:09.546434 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:18:09.638954 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 753/1507] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:18:09 2022] DELETE /identity/v3/users/f173b78d815d4c508c476e924c66cc48 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:18:09.643491 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e48695-0458-46b1-b39d-dd1f7e6add02 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:18:09.643999 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e48695-0458-46b1-b39d-dd1f7e6add02 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:18:09.644105 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e48695-0458-46b1-b39d-dd1f7e6add02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:18:09.662056 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-55e48695-0458-46b1-b39d-dd1f7e6add02 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:18:09.663241 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-55e48695-0458-46b1-b39d-dd1f7e6add02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:18:09.722988 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 755/1508] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:18:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:18:09.732569 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a864c6d-1969-4535-bf5f-4df69f8bfda8 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:18:09.733951 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-6a864c6d-1969-4535-bf5f-4df69f8bfda8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:18:09.791413 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a864c6d-1969-4535-bf5f-4df69f8bfda8 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:18:09.794861 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29cf76-af38-4fab-8151-8090b258b1fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:18:09.795498 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29cf76-af38-4fab-8151-8090b258b1fe service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:18:09.795774 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29cf76-af38-4fab-8151-8090b258b1fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:18:09.796067 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29cf76-af38-4fab-8151-8090b258b1fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:18:09.805316 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab29cf76-af38-4fab-8151-8090b258b1fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:18:09.806736 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab29cf76-af38-4fab-8151-8090b258b1fe service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:18:09.815991 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 754/1509] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:18:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:18:10.325971 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e48695-0458-46b1-b39d-dd1f7e6add02 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:18:10.327432 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-55e48695-0458-46b1-b39d-dd1f7e6add02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:18:10.341818 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e48695-0458-46b1-b39d-dd1f7e6add02 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:18:10.345699 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6255c-ae97-4663-a330-24f46fd6efc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:18:10.346701 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6255c-ae97-4663-a330-24f46fd6efc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:18:10.347051 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6255c-ae97-4663-a330-24f46fd6efc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:18:10.347248 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6255c-ae97-4663-a330-24f46fd6efc5 admin admin] PATH_INFO: `/v3/projects/205def9b646341689061c19821552a8a` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:18:10.348465 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6255c-ae97-4663-a330-24f46fd6efc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=205def9b646341689061c19821552a8a)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:18:10.349504 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: WARNING py.warnings [None req-d8c6255c-ae97-4663-a330-24f46fd6efc5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 13:18:10.349504 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: warnings.warn(msg) Jun 03 13:18:10.349504 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: Jun 03 13:18:10.350865 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6255c-ae97-4663-a330-24f46fd6efc5 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:18:10.466474 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-d8c6255c-ae97-4663-a330-24f46fd6efc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '205def9b646341689061c19821552a8a', 'request_id': 'req-d8c6255c-ae97-4663-a330-24f46fd6efc5'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:18:10.479992 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-d8c6255c-ae97-4663-a330-24f46fd6efc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '205def9b646341689061c19821552a8a', 'request_id': 'req-d8c6255c-ae97-4663-a330-24f46fd6efc5'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:18:10.485983 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-d8c6255c-ae97-4663-a330-24f46fd6efc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '205def9b646341689061c19821552a8a', 'request_id': 'req-d8c6255c-ae97-4663-a330-24f46fd6efc5'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:18:10.615754 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-d8c6255c-ae97-4663-a330-24f46fd6efc5 admin admin] The token cache is being invalidate because project 205def9b646341689061c19821552a8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:18:10.615976 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-d8c6255c-ae97-4663-a330-24f46fd6efc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:18:10.616687 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-d8c6255c-ae97-4663-a330-24f46fd6efc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:18:10.618334 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 756/1510] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:18:10 2022] DELETE /identity/v3/projects/205def9b646341689061c19821552a8a => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:18:19.811931 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:18:20.612244 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:19:41.609822 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2983368-6322-4138-9ce6-b05930b6f0d9 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:19:41.610428 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2983368-6322-4138-9ce6-b05930b6f0d9 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:19:41.610428 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2983368-6322-4138-9ce6-b05930b6f0d9 None None] PATH_INFO: `/v3` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:19:41.611811 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 755/1511] 10.222.0.20 () {54 vars in 925 bytes} [Fri Jun 3 13:19:41 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:19:41.633981 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0349c-f810-4823-977d-8cef15379009 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:19:41.634474 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0349c-f810-4823-977d-8cef15379009 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:19:41.634584 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0349c-f810-4823-977d-8cef15379009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:19:41.653418 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-e8e0349c-f810-4823-977d-8cef15379009 None None] MFA Rules not processed for user `a5c4ad16c9454b74ae8445b115cf0af4`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:19:41.654602 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-e8e0349c-f810-4823-977d-8cef15379009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:19:41.714593 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 757/1512] 10.222.0.20 () {58 vars in 1015 bytes} [Fri Jun 3 13:19:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:19:43.328533 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd262c6-d1ae-47b3-be18-899618ee4dd0 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:19:43.329108 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd262c6-d1ae-47b3-be18-899618ee4dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:19:43.329108 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd262c6-d1ae-47b3-be18-899618ee4dd0 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:19:43.330532 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 756/1513] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 13:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:19:43.335338 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098df17-57ea-4e41-b3be-b2a73f3ac495 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:19:43.335812 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098df17-57ea-4e41-b3be-b2a73f3ac495 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:19:43.335925 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098df17-57ea-4e41-b3be-b2a73f3ac495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:19:43.354377 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-8098df17-57ea-4e41-b3be-b2a73f3ac495 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:19:43.355581 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-8098df17-57ea-4e41-b3be-b2a73f3ac495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:19:43.414831 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 758/1514] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 13:19:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:19:43.584003 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd262c6-d1ae-47b3-be18-899618ee4dd0 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:19:43.585759 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-6fd262c6-d1ae-47b3-be18-899618ee4dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:19:43.660805 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd262c6-d1ae-47b3-be18-899618ee4dd0 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:19:43.666134 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf861ae-2d2a-43c7-b4fb-e6c6c679907b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066aaba3e9af4f85ab0cba89a3d32e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:19:43.666799 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf861ae-2d2a-43c7-b4fb-e6c6c679907b service nova] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:19:43.667083 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf861ae-2d2a-43c7-b4fb-e6c6c679907b service nova] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:19:43.667361 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf861ae-2d2a-43c7-b4fb-e6c6c679907b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:19:43.675657 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf861ae-2d2a-43c7-b4fb-e6c6c679907b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:19:43.677258 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf861ae-2d2a-43c7-b4fb-e6c6c679907b service nova] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:19:43.686586 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 757/1515] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:19:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:19:44.562116 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c2cb2-ebcf-465d-af14-f024276d0744 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:19:44.562658 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c2cb2-ebcf-465d-af14-f024276d0744 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:19:44.562658 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c2cb2-ebcf-465d-af14-f024276d0744 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:19:44.563978 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 759/1516] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 13:19:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:19:44.568859 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee4532-4279-4376-abce-1fd091f64a88 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:19:44.569315 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee4532-4279-4376-abce-1fd091f64a88 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:19:44.569414 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee4532-4279-4376-abce-1fd091f64a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:19:44.589849 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-d2ee4532-4279-4376-abce-1fd091f64a88 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:19:44.591689 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-d2ee4532-4279-4376-abce-1fd091f64a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:19:44.599286 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 758/1517] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 13:19:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:19:44.750280 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c2cb2-ebcf-465d-af14-f024276d0744 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:19:44.765144 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c2cb2-ebcf-465d-af14-f024276d0744 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:19:44.770485 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2208f-df4b-41f3-9f6a-bd355f961399 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066aaba3e9af4f85ab0cba89a3d32e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:19:44.771117 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2208f-df4b-41f3-9f6a-bd355f961399 service nova] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:19:44.775007 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2208f-df4b-41f3-9f6a-bd355f961399 service nova] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:19:44.775007 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2208f-df4b-41f3-9f6a-bd355f961399 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:19:44.780017 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab2208f-df4b-41f3-9f6a-bd355f961399 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:19:44.781629 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab2208f-df4b-41f3-9f6a-bd355f961399 service nova] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:19:44.791229 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 760/1518] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:19:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:19:49.096766 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fdd194-b2d6-4e50-881e-bbfd284b2303 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:19:49.097324 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fdd194-b2d6-4e50-881e-bbfd284b2303 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:19:49.097324 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fdd194-b2d6-4e50-881e-bbfd284b2303 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:19:49.098734 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 759/1519] 10.222.0.61 () {54 vars in 960 bytes} [Fri Jun 3 13:19:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 13:19:49.103590 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02786999-a978-4279-8d02-f32b9e62254d None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:19:49.104049 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02786999-a978-4279-8d02-f32b9e62254d None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:19:49.104168 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02786999-a978-4279-8d02-f32b9e62254d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:19:49.123934 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-02786999-a978-4279-8d02-f32b9e62254d None None] MFA Rules not processed for user `a5c4ad16c9454b74ae8445b115cf0af4`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:19:49.125176 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-02786999-a978-4279-8d02-f32b9e62254d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:19:49.133581 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 761/1520] 10.222.0.61 () {58 vars in 1057 bytes} [Fri Jun 3 13:19:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:19:49.141594 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fdd194-b2d6-4e50-881e-bbfd284b2303 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:19:49.155547 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fdd194-b2d6-4e50-881e-bbfd284b2303 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:19:49.160427 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a4427-1912-4cd5-b633-a89222fc2568 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5c4ad16c9454b74ae8445b115cf0af4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:19:49.161053 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a4427-1912-4cd5-b633-a89222fc2568 service placement] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:19:49.161333 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a4427-1912-4cd5-b633-a89222fc2568 service placement] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:19:49.161606 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a4427-1912-4cd5-b633-a89222fc2568 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:19:49.169912 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a4427-1912-4cd5-b633-a89222fc2568 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:19:49.171457 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a4427-1912-4cd5-b633-a89222fc2568 service placement] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:19:49.180931 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 760/1521] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:19:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:19:56.069065 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d83eb-db60-4440-9aee-04ed99dca2b8 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:19:56.069644 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d83eb-db60-4440-9aee-04ed99dca2b8 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:19:56.071687 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d83eb-db60-4440-9aee-04ed99dca2b8 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:19:56.073377 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 762/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 13:19:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:19:56.078958 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f55b3c-68f9-4de3-add2-f44abc6611c3 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:19:56.079379 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f55b3c-68f9-4de3-add2-f44abc6611c3 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:19:56.079491 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f55b3c-68f9-4de3-add2-f44abc6611c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:19:56.100514 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-69f55b3c-68f9-4de3-add2-f44abc6611c3 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:19:56.102506 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-69f55b3c-68f9-4de3-add2-f44abc6611c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:19:56.110481 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 761/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 13:19:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:19:56.265801 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d83eb-db60-4440-9aee-04ed99dca2b8 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:19:56.280963 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d83eb-db60-4440-9aee-04ed99dca2b8 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:19:56.286371 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae996f-845d-4cec-9d72-2966369a186b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066aaba3e9af4f85ab0cba89a3d32e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:19:56.287010 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae996f-845d-4cec-9d72-2966369a186b service nova] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:19:56.287294 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae996f-845d-4cec-9d72-2966369a186b service nova] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:19:56.287569 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae996f-845d-4cec-9d72-2966369a186b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:19:56.296447 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae996f-845d-4cec-9d72-2966369a186b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:19:56.298053 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae996f-845d-4cec-9d72-2966369a186b service nova] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:19:56.307576 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 763/1524] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:19:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:19:57.169818 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb3d99-5d58-40d3-b19c-dfc0ec08ec48 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:19:57.170356 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb3d99-5d58-40d3-b19c-dfc0ec08ec48 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:19:57.170469 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb3d99-5d58-40d3-b19c-dfc0ec08ec48 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:19:57.171761 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 762/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 13:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:19:57.176734 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb8356-16e0-4a1e-b586-3e79f914cf90 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:19:57.177167 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb8356-16e0-4a1e-b586-3e79f914cf90 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:19:57.177273 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb8356-16e0-4a1e-b586-3e79f914cf90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:19:57.195372 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-cffb8356-16e0-4a1e-b586-3e79f914cf90 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:19:57.196604 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-cffb8356-16e0-4a1e-b586-3e79f914cf90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:19:57.205153 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 764/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 13:19:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:19:57.356011 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb3d99-5d58-40d3-b19c-dfc0ec08ec48 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:19:57.370113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb3d99-5d58-40d3-b19c-dfc0ec08ec48 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:19:57.375520 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26332610-1df5-4e80-afac-0e4c681b38b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066aaba3e9af4f85ab0cba89a3d32e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:19:57.376166 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26332610-1df5-4e80-afac-0e4c681b38b0 service nova] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:19:57.376445 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26332610-1df5-4e80-afac-0e4c681b38b0 service nova] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:19:57.376718 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26332610-1df5-4e80-afac-0e4c681b38b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:19:57.384678 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26332610-1df5-4e80-afac-0e4c681b38b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:19:57.386231 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26332610-1df5-4e80-afac-0e4c681b38b0 service nova] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:19:57.402416 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 763/1527] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:19:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:20:01.415395 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0708e4-9cd5-4a8e-b996-78bfbcc09cc2 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:20:01.416002 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0708e4-9cd5-4a8e-b996-78bfbcc09cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:20:01.416002 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0708e4-9cd5-4a8e-b996-78bfbcc09cc2 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:20:01.417406 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 765/1528] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 13:20:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:20:01.422746 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50755a84-8768-4370-91b8-5308b5bdf6f8 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:20:01.423187 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50755a84-8768-4370-91b8-5308b5bdf6f8 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:20:01.423298 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50755a84-8768-4370-91b8-5308b5bdf6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:20:01.441022 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-50755a84-8768-4370-91b8-5308b5bdf6f8 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:20:01.442208 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-50755a84-8768-4370-91b8-5308b5bdf6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:20:01.452490 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 764/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 13:20:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:20:01.491717 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0708e4-9cd5-4a8e-b996-78bfbcc09cc2 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:20:01.493575 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-6c0708e4-9cd5-4a8e-b996-78bfbcc09cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:20:01.550406 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0708e4-9cd5-4a8e-b996-78bfbcc09cc2 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:20:01.553885 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390fa33-cc62-4952-b66a-21d07b3443fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:20:01.554525 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390fa33-cc62-4952-b66a-21d07b3443fc service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:20:01.554809 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390fa33-cc62-4952-b66a-21d07b3443fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:20:01.555086 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390fa33-cc62-4952-b66a-21d07b3443fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:20:01.563984 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0390fa33-cc62-4952-b66a-21d07b3443fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:20:01.565475 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0390fa33-cc62-4952-b66a-21d07b3443fc service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:20:01.570336 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:20:01.574936 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 766/1530] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:20:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:20:03.821165 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a0fd0-c274-4d72-acbb-3f98518b996c None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:20:03.821690 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a0fd0-c274-4d72-acbb-3f98518b996c None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:20:03.821690 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a0fd0-c274-4d72-acbb-3f98518b996c None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:20:03.823083 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 765/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 13:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:20:03.828517 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b6751-ec3b-4564-979c-7ea1fcbfcd1d None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:20:03.828950 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b6751-ec3b-4564-979c-7ea1fcbfcd1d None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:20:03.829067 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b6751-ec3b-4564-979c-7ea1fcbfcd1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:20:03.847425 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-9d4b6751-ec3b-4564-979c-7ea1fcbfcd1d None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:20:03.848771 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-9d4b6751-ec3b-4564-979c-7ea1fcbfcd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:20:03.857779 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 767/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 13:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:20:03.894654 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a0fd0-c274-4d72-acbb-3f98518b996c None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:20:03.896372 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-897a0fd0-c274-4d72-acbb-3f98518b996c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:20:03.910118 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a0fd0-c274-4d72-acbb-3f98518b996c None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:20:03.913667 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed309992-e68f-4f66-ac55-2d0193707c94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:20:03.914299 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed309992-e68f-4f66-ac55-2d0193707c94 service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:20:03.914585 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed309992-e68f-4f66-ac55-2d0193707c94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:20:03.914858 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed309992-e68f-4f66-ac55-2d0193707c94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:20:03.923799 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed309992-e68f-4f66-ac55-2d0193707c94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:20:03.925232 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed309992-e68f-4f66-ac55-2d0193707c94 service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:20:03.934485 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 766/1533] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:20:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:20:07.604853 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb35917-663f-4332-b696-7d0df68879bc None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:20:07.605447 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb35917-663f-4332-b696-7d0df68879bc None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:20:07.605555 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb35917-663f-4332-b696-7d0df68879bc None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:20:07.607848 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 768/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 13:20:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:20:07.613203 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac9c27-b4b9-4976-af7a-20fc07049a32 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:20:07.613657 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac9c27-b4b9-4976-af7a-20fc07049a32 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:20:07.613801 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac9c27-b4b9-4976-af7a-20fc07049a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:20:07.631651 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-f3ac9c27-b4b9-4976-af7a-20fc07049a32 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:20:07.632875 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-f3ac9c27-b4b9-4976-af7a-20fc07049a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:20:07.641204 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 767/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 13:20:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:20:07.909888 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb35917-663f-4332-b696-7d0df68879bc None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:20:07.911603 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-beb35917-663f-4332-b696-7d0df68879bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:20:07.968463 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb35917-663f-4332-b696-7d0df68879bc None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:20:07.971980 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827708ff-f714-45b4-a8fa-f2eaa5d694a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:20:07.972647 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827708ff-f714-45b4-a8fa-f2eaa5d694a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:20:07.972929 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827708ff-f714-45b4-a8fa-f2eaa5d694a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:20:07.973201 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827708ff-f714-45b4-a8fa-f2eaa5d694a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:20:07.982030 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827708ff-f714-45b4-a8fa-f2eaa5d694a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:20:07.983465 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827708ff-f714-45b4-a8fa-f2eaa5d694a8 service cinder] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:20:07.993057 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 769/1536] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:20:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:20:10.272870 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ca578-c410-4896-b8a5-fcb49bcbee53 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:20:10.273403 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ca578-c410-4896-b8a5-fcb49bcbee53 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:20:10.273403 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ca578-c410-4896-b8a5-fcb49bcbee53 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:20:10.274699 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 768/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 13:20:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:20:10.280508 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c7bef-d893-43c7-935d-5a4541c6c5f0 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:20:10.280891 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c7bef-d893-43c7-935d-5a4541c6c5f0 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:20:10.281067 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c7bef-d893-43c7-935d-5a4541c6c5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:20:10.299914 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-278c7bef-d893-43c7-935d-5a4541c6c5f0 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:20:10.301145 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-278c7bef-d893-43c7-935d-5a4541c6c5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:20:10.308917 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 770/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 13:20:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:20:10.581123 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6ca578-c410-4896-b8a5-fcb49bcbee53 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:20:10.582777 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-fe6ca578-c410-4896-b8a5-fcb49bcbee53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:20:10.590289 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=65 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:20:10.595959 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6ca578-c410-4896-b8a5-fcb49bcbee53 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:20:10.599693 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb41386-7c47-46d0-82f9-54314f9c62e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:20:10.600389 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb41386-7c47-46d0-82f9-54314f9c62e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:20:10.600662 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb41386-7c47-46d0-82f9-54314f9c62e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:20:10.600961 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb41386-7c47-46d0-82f9-54314f9c62e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:20:10.610041 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb41386-7c47-46d0-82f9-54314f9c62e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:20:10.611489 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb41386-7c47-46d0-82f9-54314f9c62e4 service cinder] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:20:10.621371 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 769/1539] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:20:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:20:20.294562 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=32 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:20:20.622295 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=5 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:21:38.872425 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676ce27-b210-44cc-9b96-fb6290a6cf61 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:38.873092 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676ce27-b210-44cc-9b96-fb6290a6cf61 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:38.873092 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676ce27-b210-44cc-9b96-fb6290a6cf61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:38.906466 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-4676ce27-b210-44cc-9b96-fb6290a6cf61 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:21:38.907747 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-4676ce27-b210-44cc-9b96-fb6290a6cf61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:38.919698 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 771/1540] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:21:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:21:38.930151 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893420a-8323-488a-be95-3e29e28a528a None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:38.931845 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893420a-8323-488a-be95-3e29e28a528a None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:38.931845 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893420a-8323-488a-be95-3e29e28a528a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:38.961066 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-f893420a-8323-488a-be95-3e29e28a528a None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:21:38.962325 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-f893420a-8323-488a-be95-3e29e28a528a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:38.976851 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 770/1541] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:21:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:21:38.981854 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4676ce27-b210-44cc-9b96-fb6290a6cf61 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:38.994399 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4676ce27-b210-44cc-9b96-fb6290a6cf61 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:39.005467 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988e89d-cb97-4123-9441-688c74e99b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:39.006228 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988e89d-cb97-4123-9441-688c74e99b14 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:39.006584 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988e89d-cb97-4123-9441-688c74e99b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:39.006929 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988e89d-cb97-4123-9441-688c74e99b14 admin admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:39.007734 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8988e89d-cb97-4123-9441-688c74e99b14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:21:39.008114 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8988e89d-cb97-4123-9441-688c74e99b14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:39.010019 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8988e89d-cb97-4123-9441-688c74e99b14 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:39.025378 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f003b9-0a2a-4a6f-9f5b-7662aff0e6d1 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:39.025592 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f003b9-0a2a-4a6f-9f5b-7662aff0e6d1 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:39.025838 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f003b9-0a2a-4a6f-9f5b-7662aff0e6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:39.030123 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 772/1542] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:21:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:21:39.039778 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988e89d-cb97-4123-9441-688c74e99b14 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:39.051602 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988e89d-cb97-4123-9441-688c74e99b14 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:39.057111 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe6773-d005-4776-9136-948f82c791df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:39.057935 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe6773-d005-4776-9136-948f82c791df admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:39.058285 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe6773-d005-4776-9136-948f82c791df admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:39.058632 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe6773-d005-4776-9136-948f82c791df admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:39.059405 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfe6773-d005-4776-9136-948f82c791df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:39.060533 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: WARNING py.warnings [None req-adfe6773-d005-4776-9136-948f82c791df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 13:21:39.060533 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: warnings.warn(msg) Jun 03 13:21:39.060533 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: Jun 03 13:21:39.061134 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-53f003b9-0a2a-4a6f-9f5b-7662aff0e6d1 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:21:39.062043 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfe6773-d005-4776-9136-948f82c791df admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:39.062884 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-53f003b9-0a2a-4a6f-9f5b-7662aff0e6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:39.083903 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 771/1543] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:21:39.085279 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb970af-cf4a-4a22-8b5e-2165406a8c57 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:39.085571 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb970af-cf4a-4a22-8b5e-2165406a8c57 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:39.085850 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb970af-cf4a-4a22-8b5e-2165406a8c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:39.118322 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-7bb970af-cf4a-4a22-8b5e-2165406a8c57 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:21:39.119716 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-7bb970af-cf4a-4a22-8b5e-2165406a8c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:39.127981 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 772/1544] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:21:39.129509 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cde406-8ecc-489b-acce-c5ed8e8c4b5f None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:39.133892 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cde406-8ecc-489b-acce-c5ed8e8c4b5f None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:39.133892 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cde406-8ecc-489b-acce-c5ed8e8c4b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:39.149642 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-31cde406-8ecc-489b-acce-c5ed8e8c4b5f None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:21:39.150839 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-31cde406-8ecc-489b-acce-c5ed8e8c4b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:39.159791 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 773/1545] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:21:39.161156 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28407c4d-28d1-4da1-b19c-7664a59b06c3 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:39.161445 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28407c4d-28d1-4da1-b19c-7664a59b06c3 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:39.161724 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28407c4d-28d1-4da1-b19c-7664a59b06c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:39.170826 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 773/1546] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:21:39 2022] POST /identity/v3/projects => generated 365 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:21:39.172374 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449fc3b2-fd1a-4238-9cb0-0b94391b3392 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:39.172618 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449fc3b2-fd1a-4238-9cb0-0b94391b3392 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:39.172896 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449fc3b2-fd1a-4238-9cb0-0b94391b3392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:39.180430 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-28407c4d-28d1-4da1-b19c-7664a59b06c3 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:21:39.185679 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-28407c4d-28d1-4da1-b19c-7664a59b06c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:39.195789 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-449fc3b2-fd1a-4238-9cb0-0b94391b3392 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:21:39.197149 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-449fc3b2-fd1a-4238-9cb0-0b94391b3392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:39.247364 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 774/1547] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:21:39.248487 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ff8b6-3a16-43d1-a7e4-288c32fc5caf None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:39.248781 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ff8b6-3a16-43d1-a7e4-288c32fc5caf None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:39.249056 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ff8b6-3a16-43d1-a7e4-288c32fc5caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:39.267065 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 774/1548] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:21:39.267413 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-ab2ff8b6-3a16-43d1-a7e4-288c32fc5caf None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:21:39.268292 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-ab2ff8b6-3a16-43d1-a7e4-288c32fc5caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:39.268514 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6faa9-0dc5-4b24-aa56-babd27369b21 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:39.268765 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6faa9-0dc5-4b24-aa56-babd27369b21 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:39.269057 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6faa9-0dc5-4b24-aa56-babd27369b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:39.276347 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 775/1549] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:21:39.277507 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c259a-4201-470e-bcf7-18786b33c747 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:39.277796 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c259a-4201-470e-bcf7-18786b33c747 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:39.278082 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c259a-4201-470e-bcf7-18786b33c747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:39.288001 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-80f6faa9-0dc5-4b24-aa56-babd27369b21 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:21:39.289256 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-80f6faa9-0dc5-4b24-aa56-babd27369b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:39.295822 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-ad2c259a-4201-470e-bcf7-18786b33c747 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:21:39.297037 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-ad2c259a-4201-470e-bcf7-18786b33c747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:39.297196 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 775/1550] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:21:39.297852 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6faa9-0dc5-4b24-aa56-babd27369b21 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:39.306705 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6faa9-0dc5-4b24-aa56-babd27369b21 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:39.306855 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 776/1551] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:21:39.308090 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea299be4-8843-4645-b7dd-b8655994935b None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:39.308417 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea299be4-8843-4645-b7dd-b8655994935b None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:39.308694 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea299be4-8843-4645-b7dd-b8655994935b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:39.313509 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8fb16f-c546-4211-ac98-6a77cbe4d95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:39.314194 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fb16f-c546-4211-ac98-6a77cbe4d95e admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:39.314475 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fb16f-c546-4211-ac98-6a77cbe4d95e admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:39.314743 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fb16f-c546-4211-ac98-6a77cbe4d95e admin admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:39.315414 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8fb16f-c546-4211-ac98-6a77cbe4d95e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:39.318357 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8fb16f-c546-4211-ac98-6a77cbe4d95e admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:39.330844 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-ea299be4-8843-4645-b7dd-b8655994935b None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:21:39.332388 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-ea299be4-8843-4645-b7dd-b8655994935b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:39.342205 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 777/1552] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:21:39.344107 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4b71a-777f-45bb-85bf-366f2cabcd25 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:39.344408 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4b71a-777f-45bb-85bf-366f2cabcd25 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:39.344679 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4b71a-777f-45bb-85bf-366f2cabcd25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:39.362605 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-3fd4b71a-777f-45bb-85bf-366f2cabcd25 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:21:39.363787 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-3fd4b71a-777f-45bb-85bf-366f2cabcd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:39.371880 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 778/1553] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:21:39.376169 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f04e8-938b-40ca-9ef6-f152a180982b None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:39.376169 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f04e8-938b-40ca-9ef6-f152a180982b None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:39.376169 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f04e8-938b-40ca-9ef6-f152a180982b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:39.391981 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-c47f04e8-938b-40ca-9ef6-f152a180982b None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:21:39.393184 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-c47f04e8-938b-40ca-9ef6-f152a180982b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:39.400940 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 779/1554] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:21:39.407088 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f04e8-938b-40ca-9ef6-f152a180982b None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:39.413163 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f04e8-938b-40ca-9ef6-f152a180982b None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:39.417808 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b26496-5ce8-4bcb-978e-d90598bfc1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:39.418454 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b26496-5ce8-4bcb-978e-d90598bfc1c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:39.418738 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b26496-5ce8-4bcb-978e-d90598bfc1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:39.419016 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b26496-5ce8-4bcb-978e-d90598bfc1c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:39.419727 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b26496-5ce8-4bcb-978e-d90598bfc1c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:21:39.420029 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b26496-5ce8-4bcb-978e-d90598bfc1c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:39.421106 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: WARNING py.warnings [None req-90b26496-5ce8-4bcb-978e-d90598bfc1c3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 13:21:39.421106 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: warnings.warn(msg) Jun 03 13:21:39.421106 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: Jun 03 13:21:39.422047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b26496-5ce8-4bcb-978e-d90598bfc1c3 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:39.434223 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 780/1555] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:21:39.435628 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170652de-1368-44dd-b434-b84d53a41349 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:39.435915 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170652de-1368-44dd-b434-b84d53a41349 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:39.436217 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170652de-1368-44dd-b434-b84d53a41349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:39.438195 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 776/1556] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:21:39 2022] POST /identity/v3/users => generated 283 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:21:39.439389 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8fb16f-c546-4211-ac98-6a77cbe4d95e admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:39.449685 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8fb16f-c546-4211-ac98-6a77cbe4d95e admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:39.455412 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ce6d3-1382-4250-88de-567f808eecd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:39.456067 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ce6d3-1382-4250-88de-567f808eecd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:39.456404 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ce6d3-1382-4250-88de-567f808eecd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:39.456687 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ce6d3-1382-4250-88de-567f808eecd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:39.457409 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245ce6d3-1382-4250-88de-567f808eecd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:21:39.457720 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245ce6d3-1382-4250-88de-567f808eecd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:39.458464 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-170652de-1368-44dd-b434-b84d53a41349 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:21:39.459340 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245ce6d3-1382-4250-88de-567f808eecd4 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:39.459668 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-170652de-1368-44dd-b434-b84d53a41349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:39.469509 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 781/1557] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:21:39.470314 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170652de-1368-44dd-b434-b84d53a41349 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:39.471911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 777/1558] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:21:39.473645 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6420a60-24a1-4940-9030-289017a85422 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:39.473945 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6420a60-24a1-4940-9030-289017a85422 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:39.474227 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6420a60-24a1-4940-9030-289017a85422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:39.482550 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170652de-1368-44dd-b434-b84d53a41349 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:39.491263 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e1141-fb98-4b66-867a-93d86b0faf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:39.492202 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e1141-fb98-4b66-867a-93d86b0faf22 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:39.492490 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e1141-fb98-4b66-867a-93d86b0faf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:39.492765 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e1141-fb98-4b66-867a-93d86b0faf22 admin admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:39.493481 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e1141-fb98-4b66-867a-93d86b0faf22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:21:39.493783 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e1141-fb98-4b66-867a-93d86b0faf22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:39.494042 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-c6420a60-24a1-4940-9030-289017a85422 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:21:39.495257 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-c6420a60-24a1-4940-9030-289017a85422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:39.495435 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e1141-fb98-4b66-867a-93d86b0faf22 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:39.503962 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 778/1559] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:21:39.505245 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0274b63-5bd9-432b-990b-e80c84ae6755 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:39.505534 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0274b63-5bd9-432b-990b-e80c84ae6755 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:39.505815 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0274b63-5bd9-432b-990b-e80c84ae6755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:39.516351 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 782/1560] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:21:39.516351 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e1141-fb98-4b66-867a-93d86b0faf22 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:39.523034 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e1141-fb98-4b66-867a-93d86b0faf22 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:39.527797 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad07af5-5364-444a-9a23-6a8c406a73bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:39.528317 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-b0274b63-5bd9-432b-990b-e80c84ae6755 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:21:39.528538 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad07af5-5364-444a-9a23-6a8c406a73bc admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:39.528923 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad07af5-5364-444a-9a23-6a8c406a73bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:39.529222 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad07af5-5364-444a-9a23-6a8c406a73bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:39.529535 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-b0274b63-5bd9-432b-990b-e80c84ae6755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:39.529927 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad07af5-5364-444a-9a23-6a8c406a73bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:21:39.530230 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad07af5-5364-444a-9a23-6a8c406a73bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:39.532137 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad07af5-5364-444a-9a23-6a8c406a73bc admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:39.538401 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 779/1561] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:21:39.539157 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0274b63-5bd9-432b-990b-e80c84ae6755 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:39.552237 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 783/1562] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:21:39.552237 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad07af5-5364-444a-9a23-6a8c406a73bc admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:39.556375 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad07af5-5364-444a-9a23-6a8c406a73bc admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:39.556669 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0274b63-5bd9-432b-990b-e80c84ae6755 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:39.561431 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc60501-3d28-490b-824a-0b9f08fccb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:39.562708 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc60501-3d28-490b-824a-0b9f08fccb6a admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:39.563017 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc60501-3d28-490b-824a-0b9f08fccb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:39.563229 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcabc4b6-30e7-44fc-be41-54681958d5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:39.563352 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc60501-3d28-490b-824a-0b9f08fccb6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:39.563869 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcabc4b6-30e7-44fc-be41-54681958d5f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:39.563969 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc60501-3d28-490b-824a-0b9f08fccb6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:39.564171 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcabc4b6-30e7-44fc-be41-54681958d5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:39.564454 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcabc4b6-30e7-44fc-be41-54681958d5f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:39.565174 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcabc4b6-30e7-44fc-be41-54681958d5f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:39.565896 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc60501-3d28-490b-824a-0b9f08fccb6a admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:39.566747 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcabc4b6-30e7-44fc-be41-54681958d5f7 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:39.578235 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 784/1563] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:21:39.579074 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcabc4b6-30e7-44fc-be41-54681958d5f7 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:39.588791 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcabc4b6-30e7-44fc-be41-54681958d5f7 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:39.593385 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17592b-5e78-4013-8997-2a2684ef26be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:39.594008 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17592b-5e78-4013-8997-2a2684ef26be admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:39.594317 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17592b-5e78-4013-8997-2a2684ef26be admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:39.594695 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17592b-5e78-4013-8997-2a2684ef26be admin admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:39.595678 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a17592b-5e78-4013-8997-2a2684ef26be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:21:39.596030 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a17592b-5e78-4013-8997-2a2684ef26be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:39.597668 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a17592b-5e78-4013-8997-2a2684ef26be admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:39.609915 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 785/1564] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:21:39.610694 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17592b-5e78-4013-8997-2a2684ef26be admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:39.622074 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17592b-5e78-4013-8997-2a2684ef26be admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:39.627370 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc9774-e3f5-4122-8b3f-ecff9ec23817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:39.628000 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc9774-e3f5-4122-8b3f-ecff9ec23817 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:39.628325 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc9774-e3f5-4122-8b3f-ecff9ec23817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:39.628605 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc9774-e3f5-4122-8b3f-ecff9ec23817 admin admin] PATH_INFO: `/v3/projects` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:39.629282 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedc9774-e3f5-4122-8b3f-ecff9ec23817 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:39.631181 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedc9774-e3f5-4122-8b3f-ecff9ec23817 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:39.677233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 780/1565] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:21:39 2022] POST /identity/v3/projects => generated 375 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:21:39.678222 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc60501-3d28-490b-824a-0b9f08fccb6a admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:39.725586 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:21:39.729477 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 786/1566] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:21:39 2022] POST /identity/v3/projects => generated 389 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:21:39.730277 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc9774-e3f5-4122-8b3f-ecff9ec23817 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:39.740650 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:21:39.740836 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc60501-3d28-490b-824a-0b9f08fccb6a admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:39.793105 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc9774-e3f5-4122-8b3f-ecff9ec23817 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:39.798304 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0418bb9-a6c9-4b10-aaed-d3fe48278c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:39.798490 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a53a360-7048-42c9-b519-6e7bc3374179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:39.798986 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0418bb9-a6c9-4b10-aaed-d3fe48278c1b admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:39.799114 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53a360-7048-42c9-b519-6e7bc3374179 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:39.799259 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0418bb9-a6c9-4b10-aaed-d3fe48278c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:39.799391 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53a360-7048-42c9-b519-6e7bc3374179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:39.799543 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0418bb9-a6c9-4b10-aaed-d3fe48278c1b admin admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:39.799670 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53a360-7048-42c9-b519-6e7bc3374179 admin admin] PATH_INFO: `/v3/projects` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:39.800291 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0418bb9-a6c9-4b10-aaed-d3fe48278c1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:21:39.800411 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a53a360-7048-42c9-b519-6e7bc3374179 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:39.800605 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0418bb9-a6c9-4b10-aaed-d3fe48278c1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:39.802205 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0418bb9-a6c9-4b10-aaed-d3fe48278c1b admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:39.802320 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a53a360-7048-42c9-b519-6e7bc3374179 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:39.814425 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 781/1567] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:21:39.815248 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0418bb9-a6c9-4b10-aaed-d3fe48278c1b admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:39.824955 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0418bb9-a6c9-4b10-aaed-d3fe48278c1b admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:39.829726 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e121fb-61ed-48c1-b184-8d8443aa26a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:39.830390 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e121fb-61ed-48c1-b184-8d8443aa26a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:39.830659 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e121fb-61ed-48c1-b184-8d8443aa26a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:39.830938 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e121fb-61ed-48c1-b184-8d8443aa26a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:39.831648 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e121fb-61ed-48c1-b184-8d8443aa26a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:21:39.831958 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e121fb-61ed-48c1-b184-8d8443aa26a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:39.833577 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e121fb-61ed-48c1-b184-8d8443aa26a8 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:39.846138 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 782/1568] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:21:39.846893 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e121fb-61ed-48c1-b184-8d8443aa26a8 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:39.857005 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e121fb-61ed-48c1-b184-8d8443aa26a8 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:39.862042 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10447921-1e02-4fa2-8b7f-b74cb3423a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:39.862663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10447921-1e02-4fa2-8b7f-b74cb3423a86 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:39.862947 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10447921-1e02-4fa2-8b7f-b74cb3423a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:39.863225 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10447921-1e02-4fa2-8b7f-b74cb3423a86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:39.863897 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10447921-1e02-4fa2-8b7f-b74cb3423a86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:39.865793 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10447921-1e02-4fa2-8b7f-b74cb3423a86 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:39.900776 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 787/1569] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:21:39 2022] POST /identity/v3/projects => generated 393 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:21:39.901611 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a53a360-7048-42c9-b519-6e7bc3374179 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:39.952585 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 783/1570] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:21:39 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:21:39.953553 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10447921-1e02-4fa2-8b7f-b74cb3423a86 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:39.965644 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a53a360-7048-42c9-b519-6e7bc3374179 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:40.021868 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10447921-1e02-4fa2-8b7f-b74cb3423a86 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:40.026837 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af796d-5acd-425e-bc43-6bbb4465d295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:40.027487 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af796d-5acd-425e-bc43-6bbb4465d295 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:40.027767 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af796d-5acd-425e-bc43-6bbb4465d295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:40.028040 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af796d-5acd-425e-bc43-6bbb4465d295 admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:40.028753 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af796d-5acd-425e-bc43-6bbb4465d295 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:40.030748 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af796d-5acd-425e-bc43-6bbb4465d295 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:40.032293 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87189511-597b-4940-8b0b-9a235ddfe4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:40.032966 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87189511-597b-4940-8b0b-9a235ddfe4e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:40.033250 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87189511-597b-4940-8b0b-9a235ddfe4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:40.033531 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87189511-597b-4940-8b0b-9a235ddfe4e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:40.034279 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87189511-597b-4940-8b0b-9a235ddfe4e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:40.035866 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87189511-597b-4940-8b0b-9a235ddfe4e4 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:40.045932 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 788/1571] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:21:40.047379 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87189511-597b-4940-8b0b-9a235ddfe4e4 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:40.056739 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87189511-597b-4940-8b0b-9a235ddfe4e4 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:40.061448 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b77323-cbc1-4e1d-856c-68ffb75212ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:40.062827 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b77323-cbc1-4e1d-856c-68ffb75212ce admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:40.063108 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b77323-cbc1-4e1d-856c-68ffb75212ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:40.063382 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b77323-cbc1-4e1d-856c-68ffb75212ce admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:40.064046 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b77323-cbc1-4e1d-856c-68ffb75212ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:40.065206 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: WARNING py.warnings [None req-b0b77323-cbc1-4e1d-856c-68ffb75212ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 13:21:40.065206 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: warnings.warn(msg) Jun 03 13:21:40.065206 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: Jun 03 13:21:40.066382 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b77323-cbc1-4e1d-856c-68ffb75212ce admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:40.113213 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 784/1572] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:21:39 2022] POST /identity/v3/projects => generated 375 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:21:40.114020 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af796d-5acd-425e-bc43-6bbb4465d295 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:40.153833 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:21:40.174635 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af796d-5acd-425e-bc43-6bbb4465d295 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:40.174957 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 789/1573] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:21:40 2022] POST /identity/v3/users => generated 288 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:21:40.175893 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b77323-cbc1-4e1d-856c-68ffb75212ce admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:40.179474 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f70476-9914-4923-a13a-470eebf42b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:40.180138 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f70476-9914-4923-a13a-470eebf42b30 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:40.180444 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f70476-9914-4923-a13a-470eebf42b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:40.180714 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f70476-9914-4923-a13a-470eebf42b30 admin admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:40.181395 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f70476-9914-4923-a13a-470eebf42b30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:40.183326 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f70476-9914-4923-a13a-470eebf42b30 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:40.185874 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b77323-cbc1-4e1d-856c-68ffb75212ce admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:40.190837 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d275d43-9114-423b-b075-055d36cf8ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:40.191552 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d275d43-9114-423b-b075-055d36cf8ab9 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:40.191831 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d275d43-9114-423b-b075-055d36cf8ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:40.192105 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d275d43-9114-423b-b075-055d36cf8ab9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:40.192824 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d275d43-9114-423b-b075-055d36cf8ab9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:40.194726 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d275d43-9114-423b-b075-055d36cf8ab9 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:40.254190 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 785/1574] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:21:40 2022] POST /identity/v3/users => generated 295 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:21:40.255136 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f70476-9914-4923-a13a-470eebf42b30 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:40.264648 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f70476-9914-4923-a13a-470eebf42b30 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:40.269427 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e245d73-0a26-4dcb-b158-36b6fe39539a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:40.270152 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e245d73-0a26-4dcb-b158-36b6fe39539a admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:40.270437 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e245d73-0a26-4dcb-b158-36b6fe39539a admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:40.270714 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e245d73-0a26-4dcb-b158-36b6fe39539a admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:40.271394 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e245d73-0a26-4dcb-b158-36b6fe39539a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:40.273339 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e245d73-0a26-4dcb-b158-36b6fe39539a admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:40.277909 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:21:40.286153 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 790/1575] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:21:40 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:21:40.286994 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d275d43-9114-423b-b075-055d36cf8ab9 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:40.348035 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d275d43-9114-423b-b075-055d36cf8ab9 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:40.352594 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48fcd3-e0b1-4441-8660-69d9947144b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:40.353249 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48fcd3-e0b1-4441-8660-69d9947144b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:40.353529 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48fcd3-e0b1-4441-8660-69d9947144b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:40.353807 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48fcd3-e0b1-4441-8660-69d9947144b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:40.354515 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa48fcd3-e0b1-4441-8660-69d9947144b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:40.356782 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa48fcd3-e0b1-4441-8660-69d9947144b5 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:40.380808 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 786/1576] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:21:40 2022] POST /identity/v3/projects => generated 379 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:21:40.381610 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e245d73-0a26-4dcb-b158-36b6fe39539a admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:40.443726 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e245d73-0a26-4dcb-b158-36b6fe39539a admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:40.448535 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c97ee0-354d-4f90-9e97-519fb2d7e81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:40.449085 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c97ee0-354d-4f90-9e97-519fb2d7e81e admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:40.449371 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c97ee0-354d-4f90-9e97-519fb2d7e81e admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:40.449644 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c97ee0-354d-4f90-9e97-519fb2d7e81e admin admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:40.450324 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c97ee0-354d-4f90-9e97-519fb2d7e81e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:40.452356 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c97ee0-354d-4f90-9e97-519fb2d7e81e admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:40.457770 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 791/1577] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:21:40 2022] POST /identity/v3/users => generated 297 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:21:40.457770 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48fcd3-e0b1-4441-8660-69d9947144b5 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:40.465417 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48fcd3-e0b1-4441-8660-69d9947144b5 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:40.470938 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf9f46-39ad-4eb4-ad02-98eee26fd394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:40.471845 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf9f46-39ad-4eb4-ad02-98eee26fd394 admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:40.472124 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf9f46-39ad-4eb4-ad02-98eee26fd394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:40.472428 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf9f46-39ad-4eb4-ad02-98eee26fd394 admin admin] PATH_INFO: `/v3/projects/5502e6bd5a2c4ab7b9b60df486fcd2d0/users/c0bdcca509694d1ab1a38a2a9796df6d/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:40.489252 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf9f46-39ad-4eb4-ad02-98eee26fd394 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5502e6bd5a2c4ab7b9b60df486fcd2d0, user_id=c0bdcca509694d1ab1a38a2a9796df6d, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:40.492122 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf9f46-39ad-4eb4-ad02-98eee26fd394 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:40.521134 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 787/1578] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:21:40 2022] POST /identity/v3/users => generated 293 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:21:40.521973 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c97ee0-354d-4f90-9e97-519fb2d7e81e admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:40.532087 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c97ee0-354d-4f90-9e97-519fb2d7e81e admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:40.536715 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2623027-28b9-4f83-b076-815b52a648f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:40.537349 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2623027-28b9-4f83-b076-815b52a648f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:40.537732 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2623027-28b9-4f83-b076-815b52a648f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:40.538008 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2623027-28b9-4f83-b076-815b52a648f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:40.538670 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2623027-28b9-4f83-b076-815b52a648f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:40.540610 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2623027-28b9-4f83-b076-815b52a648f5 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:40.580278 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 792/1579] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:21:40 2022] PUT /identity/v3/projects/5502e6bd5a2c4ab7b9b60df486fcd2d0/users/c0bdcca509694d1ab1a38a2a9796df6d/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:21:40.581026 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf9f46-39ad-4eb4-ad02-98eee26fd394 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:40.643216 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf9f46-39ad-4eb4-ad02-98eee26fd394 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:40.647752 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dabc2f3-5917-46d3-91fd-e3b87a9b968e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:40.648359 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 788/1580] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:21:40 2022] POST /identity/v3/users => generated 288 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:21:40.648588 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dabc2f3-5917-46d3-91fd-e3b87a9b968e admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:40.648895 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dabc2f3-5917-46d3-91fd-e3b87a9b968e admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:40.649065 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2623027-28b9-4f83-b076-815b52a648f5 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:40.649167 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dabc2f3-5917-46d3-91fd-e3b87a9b968e admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:40.650013 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dabc2f3-5917-46d3-91fd-e3b87a9b968e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:40.651701 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dabc2f3-5917-46d3-91fd-e3b87a9b968e admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:40.658995 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2623027-28b9-4f83-b076-815b52a648f5 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:40.665785 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 793/1581] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:21:40.665785 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dabc2f3-5917-46d3-91fd-e3b87a9b968e admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:40.666840 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c26e0a-956f-43f6-a822-5a0ea9f57bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:40.667524 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c26e0a-956f-43f6-a822-5a0ea9f57bb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:40.667806 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c26e0a-956f-43f6-a822-5a0ea9f57bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:40.668080 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c26e0a-956f-43f6-a822-5a0ea9f57bb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:40.668821 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c26e0a-956f-43f6-a822-5a0ea9f57bb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:40.670422 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c26e0a-956f-43f6-a822-5a0ea9f57bb3 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:40.677606 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dabc2f3-5917-46d3-91fd-e3b87a9b968e admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:40.681592 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 789/1582] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:21:40.682524 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c26e0a-956f-43f6-a822-5a0ea9f57bb3 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:40.686508 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8510d-8f87-4746-8041-d33f6209645e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:40.687726 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8510d-8f87-4746-8041-d33f6209645e admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:40.688129 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8510d-8f87-4746-8041-d33f6209645e admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:40.688433 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8510d-8f87-4746-8041-d33f6209645e admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:40.689274 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8510d-8f87-4746-8041-d33f6209645e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:40.691211 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8510d-8f87-4746-8041-d33f6209645e admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:40.693259 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c26e0a-956f-43f6-a822-5a0ea9f57bb3 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:40.697791 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b96ef-8d2a-49e3-bbe1-aa21eb78c6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:40.698438 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b96ef-8d2a-49e3-bbe1-aa21eb78c6a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:40.698721 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b96ef-8d2a-49e3-bbe1-aa21eb78c6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:40.698999 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b96ef-8d2a-49e3-bbe1-aa21eb78c6a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:40.699670 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b96ef-8d2a-49e3-bbe1-aa21eb78c6a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:40.701597 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b96ef-8d2a-49e3-bbe1-aa21eb78c6a8 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:40.767458 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 794/1583] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:21:40 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:21:40.768414 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8510d-8f87-4746-8041-d33f6209645e admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:40.778176 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8510d-8f87-4746-8041-d33f6209645e admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:40.783353 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d2580-5692-4cdc-a974-5f8109c4a72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:40.783986 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d2580-5692-4cdc-a974-5f8109c4a72b admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:40.784319 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d2580-5692-4cdc-a974-5f8109c4a72b admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:40.784590 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d2580-5692-4cdc-a974-5f8109c4a72b admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:40.785354 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09d2580-5692-4cdc-a974-5f8109c4a72b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:40.786968 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09d2580-5692-4cdc-a974-5f8109c4a72b admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:40.790925 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 790/1584] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:21:40 2022] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:21:40.790925 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b96ef-8d2a-49e3-bbe1-aa21eb78c6a8 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:40.799987 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 795/1585] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:21:40.799987 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80d270-1647-4ff7-8964-8a1790c13fa4 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:40.799987 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80d270-1647-4ff7-8964-8a1790c13fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:40.799987 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80d270-1647-4ff7-8964-8a1790c13fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:40.803853 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b96ef-8d2a-49e3-bbe1-aa21eb78c6a8 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:40.808884 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1284d2f-a42b-413a-a47b-36765c10925c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:40.809629 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1284d2f-a42b-413a-a47b-36765c10925c admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:40.809932 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1284d2f-a42b-413a-a47b-36765c10925c admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:40.810186 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1284d2f-a42b-413a-a47b-36765c10925c admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:40.810941 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1284d2f-a42b-413a-a47b-36765c10925c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:40.812713 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1284d2f-a42b-413a-a47b-36765c10925c admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:40.822888 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 791/1586] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:21:40.824192 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1284d2f-a42b-413a-a47b-36765c10925c admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:40.825017 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-ad80d270-1647-4ff7-8964-8a1790c13fa4 None None] MFA Rules not processed for user `c0bdcca509694d1ab1a38a2a9796df6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:21:40.826568 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-ad80d270-1647-4ff7-8964-8a1790c13fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:40.835502 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1284d2f-a42b-413a-a47b-36765c10925c admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:40.840761 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fabc192-c7a1-4576-a94a-00948f1bfb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:40.841407 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fabc192-c7a1-4576-a94a-00948f1bfb54 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:40.841694 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fabc192-c7a1-4576-a94a-00948f1bfb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:40.841972 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fabc192-c7a1-4576-a94a-00948f1bfb54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:40.842711 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fabc192-c7a1-4576-a94a-00948f1bfb54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:40.845195 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fabc192-c7a1-4576-a94a-00948f1bfb54 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:40.846392 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:21:40.855680 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 792/1587] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:21:40.856659 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fabc192-c7a1-4576-a94a-00948f1bfb54 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:40.867023 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fabc192-c7a1-4576-a94a-00948f1bfb54 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:40.871593 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288aaf8-2446-4f66-ace5-affb85b5a8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:40.872260 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288aaf8-2446-4f66-ace5-affb85b5a8d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:40.872540 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288aaf8-2446-4f66-ace5-affb85b5a8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:40.872808 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288aaf8-2446-4f66-ace5-affb85b5a8d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:40.873548 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e288aaf8-2446-4f66-ace5-affb85b5a8d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:40.875301 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e288aaf8-2446-4f66-ace5-affb85b5a8d0 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:40.885580 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 793/1588] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:21:40.886389 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288aaf8-2446-4f66-ace5-affb85b5a8d0 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:40.896222 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 796/1589] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:21:40 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:21:40.897068 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80d270-1647-4ff7-8964-8a1790c13fa4 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:40.903076 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288aaf8-2446-4f66-ace5-affb85b5a8d0 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:40.909335 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8367eff-caee-488e-a1da-61d3bc272f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:40.910121 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8367eff-caee-488e-a1da-61d3bc272f84 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:40.910507 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8367eff-caee-488e-a1da-61d3bc272f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:40.910942 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8367eff-caee-488e-a1da-61d3bc272f84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:40.911062 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80d270-1647-4ff7-8964-8a1790c13fa4 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:40.911853 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8367eff-caee-488e-a1da-61d3bc272f84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:40.913496 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8367eff-caee-488e-a1da-61d3bc272f84 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:40.915458 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d69d51-097a-442a-a8f8-58160d44c9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:40.916112 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d69d51-097a-442a-a8f8-58160d44c9f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:40.916418 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d69d51-097a-442a-a8f8-58160d44c9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:40.916692 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d69d51-097a-442a-a8f8-58160d44c9f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:40.917428 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d69d51-097a-442a-a8f8-58160d44c9f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:40.918991 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d69d51-097a-442a-a8f8-58160d44c9f3 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:40.924412 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 794/1590] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:21:40.925312 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8367eff-caee-488e-a1da-61d3bc272f84 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:40.931397 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:21:40.933053 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 797/1591] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:21:40.933999 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d69d51-097a-442a-a8f8-58160d44c9f3 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:40.935352 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8367eff-caee-488e-a1da-61d3bc272f84 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:40.940960 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f82380-c195-4962-9e84-e5a27099a430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:40.942490 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f82380-c195-4962-9e84-e5a27099a430 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:40.942490 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f82380-c195-4962-9e84-e5a27099a430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:40.942490 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f82380-c195-4962-9e84-e5a27099a430 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:40.942912 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f82380-c195-4962-9e84-e5a27099a430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:40.944542 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d69d51-097a-442a-a8f8-58160d44c9f3 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:40.944659 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f82380-c195-4962-9e84-e5a27099a430 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:40.949163 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d93e89-0a6b-4807-a1c9-b1337190f06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:40.949804 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d93e89-0a6b-4807-a1c9-b1337190f06b admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:40.950087 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d93e89-0a6b-4807-a1c9-b1337190f06b admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:40.950363 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d93e89-0a6b-4807-a1c9-b1337190f06b admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:40.951067 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d93e89-0a6b-4807-a1c9-b1337190f06b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:40.953240 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d93e89-0a6b-4807-a1c9-b1337190f06b admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:40.957428 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 795/1592] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:21:40.958330 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f82380-c195-4962-9e84-e5a27099a430 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:40.966643 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 798/1593] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:21:40.966643 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d93e89-0a6b-4807-a1c9-b1337190f06b admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:40.969747 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f82380-c195-4962-9e84-e5a27099a430 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:40.974772 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d93e89-0a6b-4807-a1c9-b1337190f06b admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:40.976995 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee25f4f7-8182-44cb-80cd-dc8512481a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:40.976995 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25f4f7-8182-44cb-80cd-dc8512481a47 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:40.976995 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25f4f7-8182-44cb-80cd-dc8512481a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:40.976995 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25f4f7-8182-44cb-80cd-dc8512481a47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:40.977405 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee25f4f7-8182-44cb-80cd-dc8512481a47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:40.978606 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee25f4f7-8182-44cb-80cd-dc8512481a47 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:40.979955 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af4836-2cf7-4960-a193-4379e165833c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:40.980689 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af4836-2cf7-4960-a193-4379e165833c admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:40.980971 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af4836-2cf7-4960-a193-4379e165833c admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:40.981244 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af4836-2cf7-4960-a193-4379e165833c admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:40.981953 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af4836-2cf7-4960-a193-4379e165833c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:40.983513 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af4836-2cf7-4960-a193-4379e165833c admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:40.989132 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 796/1594] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:21:40.990089 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee25f4f7-8182-44cb-80cd-dc8512481a47 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:40.995053 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 799/1595] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:21:40.995894 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af4836-2cf7-4960-a193-4379e165833c admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:41.003953 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee25f4f7-8182-44cb-80cd-dc8512481a47 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:41.009028 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ecfc32-7775-4d86-a840-e96b0fe85fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:41.009929 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ecfc32-7775-4d86-a840-e96b0fe85fc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:41.010214 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ecfc32-7775-4d86-a840-e96b0fe85fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:41.010491 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ecfc32-7775-4d86-a840-e96b0fe85fc5 admin admin] PATH_INFO: `/v3/projects/5a4dd3e8d45a4dee9be95d8326e00edf/users/7254adba100f4453b2b9a953990dbb41/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:41.026341 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ecfc32-7775-4d86-a840-e96b0fe85fc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a4dd3e8d45a4dee9be95d8326e00edf, user_id=7254adba100f4453b2b9a953990dbb41, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:41.027395 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: WARNING py.warnings [None req-c8ecfc32-7775-4d86-a840-e96b0fe85fc5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 13:21:41.027395 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: warnings.warn(msg) Jun 03 13:21:41.027395 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: Jun 03 13:21:41.029388 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ecfc32-7775-4d86-a840-e96b0fe85fc5 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:41.053830 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af4836-2cf7-4960-a193-4379e165833c admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:41.057656 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401683d-5787-4a06-9fbe-894c90352ec1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:41.058308 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401683d-5787-4a06-9fbe-894c90352ec1 service cinder] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:41.058626 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401683d-5787-4a06-9fbe-894c90352ec1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:41.058963 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401683d-5787-4a06-9fbe-894c90352ec1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:41.067874 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1401683d-5787-4a06-9fbe-894c90352ec1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:41.069386 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1401683d-5787-4a06-9fbe-894c90352ec1 service cinder] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:41.078730 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 800/1596] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:21:40 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:21:41.079488 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401683d-5787-4a06-9fbe-894c90352ec1 service cinder] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:41.089446 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401683d-5787-4a06-9fbe-894c90352ec1 service cinder] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:41.095083 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a2cbb6-b774-4667-86ba-31f2da795d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:41.095958 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2cbb6-b774-4667-86ba-31f2da795d8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:41.096276 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2cbb6-b774-4667-86ba-31f2da795d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:41.096554 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2cbb6-b774-4667-86ba-31f2da795d8f admin admin] PATH_INFO: `/v3/projects/ab17731336f54a7eb5dfd954ddc8e688/users/965645bc86f44cf38c5f571406722e32/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:41.111915 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a2cbb6-b774-4667-86ba-31f2da795d8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab17731336f54a7eb5dfd954ddc8e688, user_id=965645bc86f44cf38c5f571406722e32, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:41.114584 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a2cbb6-b774-4667-86ba-31f2da795d8f admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:41.118659 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 797/1597] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:21:40 2022] PUT /identity/v3/projects/5a4dd3e8d45a4dee9be95d8326e00edf/users/7254adba100f4453b2b9a953990dbb41/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:21:41.119575 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ecfc32-7775-4d86-a840-e96b0fe85fc5 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:41.182434 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ecfc32-7775-4d86-a840-e96b0fe85fc5 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:41.187642 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75337d56-bbd1-4425-bf9f-8173f6690807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:41.188429 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75337d56-bbd1-4425-bf9f-8173f6690807 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:41.188706 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75337d56-bbd1-4425-bf9f-8173f6690807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:41.188978 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75337d56-bbd1-4425-bf9f-8173f6690807 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:41.189706 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75337d56-bbd1-4425-bf9f-8173f6690807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:41.191299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75337d56-bbd1-4425-bf9f-8173f6690807 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:41.205399 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 798/1598] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:21:41.205399 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75337d56-bbd1-4425-bf9f-8173f6690807 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:41.212599 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 801/1599] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:21:41 2022] PUT /identity/v3/projects/ab17731336f54a7eb5dfd954ddc8e688/users/965645bc86f44cf38c5f571406722e32/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:21:41.215636 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75337d56-bbd1-4425-bf9f-8173f6690807 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:41.215758 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a2cbb6-b774-4667-86ba-31f2da795d8f admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:41.275541 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae54af-d50a-439a-aba8-f36871dff792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:41.276357 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae54af-d50a-439a-aba8-f36871dff792 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:41.276711 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae54af-d50a-439a-aba8-f36871dff792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:41.277046 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae54af-d50a-439a-aba8-f36871dff792 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:41.277838 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ae54af-d50a-439a-aba8-f36871dff792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:41.280098 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ae54af-d50a-439a-aba8-f36871dff792 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:41.289098 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a2cbb6-b774-4667-86ba-31f2da795d8f admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:41.290761 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 799/1600] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:21:41.291413 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae54af-d50a-439a-aba8-f36871dff792 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:41.300819 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c1132-42a3-4baa-83f0-9974c1444f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:41.301756 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c1132-42a3-4baa-83f0-9974c1444f98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:41.301981 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae54af-d50a-439a-aba8-f36871dff792 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:41.302092 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c1132-42a3-4baa-83f0-9974c1444f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:41.302320 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c1132-42a3-4baa-83f0-9974c1444f98 admin admin] PATH_INFO: `/v3/projects/422fdba5c8474b93b285700c07e9304c/users/308bdbe63af5415d8e817bd9ba2fad3e/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:41.307710 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c27e2d-b5c6-4b4c-b0af-35b9741b2b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:41.309045 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c27e2d-b5c6-4b4c-b0af-35b9741b2b0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:41.313098 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c27e2d-b5c6-4b4c-b0af-35b9741b2b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:41.313098 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c27e2d-b5c6-4b4c-b0af-35b9741b2b0e admin admin] PATH_INFO: `/v3/projects/8468b823dd4e408c98dc1eb01f3019c7/users/267a2b59a70245dfb7ec1b779f7fdd51/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:41.315162 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:21:41.321284 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c1132-42a3-4baa-83f0-9974c1444f98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=422fdba5c8474b93b285700c07e9304c, user_id=308bdbe63af5415d8e817bd9ba2fad3e, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:41.325653 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c1132-42a3-4baa-83f0-9974c1444f98 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:41.327686 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c27e2d-b5c6-4b4c-b0af-35b9741b2b0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8468b823dd4e408c98dc1eb01f3019c7, user_id=267a2b59a70245dfb7ec1b779f7fdd51, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:41.330559 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c27e2d-b5c6-4b4c-b0af-35b9741b2b0e admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:41.454529 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 802/1602] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:21:41 2022] PUT /identity/v3/projects/422fdba5c8474b93b285700c07e9304c/users/308bdbe63af5415d8e817bd9ba2fad3e/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:21:41.454748 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 800/1602] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:21:41 2022] PUT /identity/v3/projects/8468b823dd4e408c98dc1eb01f3019c7/users/267a2b59a70245dfb7ec1b779f7fdd51/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:21:41.455492 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c1132-42a3-4baa-83f0-9974c1444f98 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:41.456393 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72727cc4-03c5-415a-8603-a80630db2a53 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:41.456682 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72727cc4-03c5-415a-8603-a80630db2a53 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:41.456958 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72727cc4-03c5-415a-8603-a80630db2a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:41.479048 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-72727cc4-03c5-415a-8603-a80630db2a53 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:21:41.480394 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-72727cc4-03c5-415a-8603-a80630db2a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:41.503006 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:21:41.527745 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c1132-42a3-4baa-83f0-9974c1444f98 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:41.534395 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d820cbed-7450-4521-95e9-40facffc6ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:41.535626 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820cbed-7450-4521-95e9-40facffc6ae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:41.535626 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820cbed-7450-4521-95e9-40facffc6ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:41.536026 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820cbed-7450-4521-95e9-40facffc6ae2 admin admin] PATH_INFO: `/v3/projects/6d4f45d0a81a4dd3aab4f7531c859d3d/users/7d90fa0cecb84aa2b8064d0449560c3b/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:41.544469 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 801/1603] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:21:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:21:41.545539 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72727cc4-03c5-415a-8603-a80630db2a53 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:41.556355 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d820cbed-7450-4521-95e9-40facffc6ae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d4f45d0a81a4dd3aab4f7531c859d3d, user_id=7d90fa0cecb84aa2b8064d0449560c3b, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:41.557108 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72727cc4-03c5-415a-8603-a80630db2a53 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:41.559911 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d820cbed-7450-4521-95e9-40facffc6ae2 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:41.563882 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae66f67-6555-4c27-957b-d3a87c81d9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:41.565085 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae66f67-6555-4c27-957b-d3a87c81d9b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:41.565444 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae66f67-6555-4c27-957b-d3a87c81d9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:41.565785 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae66f67-6555-4c27-957b-d3a87c81d9b9 admin admin] PATH_INFO: `/v3/projects/a7dd0495bb884e57b5fe98c3cb6ba7a9/users/74a2bbfe916a4f2f971c3ea952860988/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:41.581845 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae66f67-6555-4c27-957b-d3a87c81d9b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7dd0495bb884e57b5fe98c3cb6ba7a9, user_id=74a2bbfe916a4f2f971c3ea952860988, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:41.584697 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae66f67-6555-4c27-957b-d3a87c81d9b9 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:41.630515 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 803/1604] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:21:41 2022] PUT /identity/v3/projects/6d4f45d0a81a4dd3aab4f7531c859d3d/users/7d90fa0cecb84aa2b8064d0449560c3b/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:21:41.631970 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58f2ce-883d-44aa-931d-cdd3a2679e84 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:41.632293 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58f2ce-883d-44aa-931d-cdd3a2679e84 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:41.632572 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58f2ce-883d-44aa-931d-cdd3a2679e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:41.648968 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-2e58f2ce-883d-44aa-931d-cdd3a2679e84 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:21:41.650171 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-2e58f2ce-883d-44aa-931d-cdd3a2679e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:41.659445 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 802/1605] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:21:41 2022] PUT /identity/v3/projects/a7dd0495bb884e57b5fe98c3cb6ba7a9/users/74a2bbfe916a4f2f971c3ea952860988/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:21:41.667388 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae66f67-6555-4c27-957b-d3a87c81d9b9 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:41.727314 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 804/1606] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:21:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:21:41.728713 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9700227-826b-4b6a-b528-434d989a7064 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:41.729004 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9700227-826b-4b6a-b528-434d989a7064 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:41.729286 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9700227-826b-4b6a-b528-434d989a7064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:41.729641 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae66f67-6555-4c27-957b-d3a87c81d9b9 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:41.735561 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc412d31-9743-4a36-ab3a-c01c95a301ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:41.736591 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc412d31-9743-4a36-ab3a-c01c95a301ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:41.736868 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc412d31-9743-4a36-ab3a-c01c95a301ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:41.737139 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc412d31-9743-4a36-ab3a-c01c95a301ae admin admin] PATH_INFO: `/v3/projects/f6909571f8274f4ebf822ce71cd43c2b/users/144789e582de45c280d03b92dee5692a/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:41.749031 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-f9700227-826b-4b6a-b528-434d989a7064 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:21:41.750650 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-f9700227-826b-4b6a-b528-434d989a7064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:41.752605 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc412d31-9743-4a36-ab3a-c01c95a301ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6909571f8274f4ebf822ce71cd43c2b, user_id=144789e582de45c280d03b92dee5692a, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:41.755267 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc412d31-9743-4a36-ab3a-c01c95a301ae admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:41.758246 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 805/1607] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:21:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:21:41.759473 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f33b32-cf73-48ba-b6ad-7feffd98cbce None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:41.759767 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f33b32-cf73-48ba-b6ad-7feffd98cbce None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:41.760046 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f33b32-cf73-48ba-b6ad-7feffd98cbce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:41.777518 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-66f33b32-cf73-48ba-b6ad-7feffd98cbce None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:21:41.778744 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-66f33b32-cf73-48ba-b6ad-7feffd98cbce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:41.787349 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 806/1608] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:21:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:21:41.787948 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f33b32-cf73-48ba-b6ad-7feffd98cbce None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:41.808559 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 803/1609] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:21:41 2022] PUT /identity/v3/projects/f6909571f8274f4ebf822ce71cd43c2b/users/144789e582de45c280d03b92dee5692a/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:21:41.814704 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b35805-e1f0-47ca-a36f-f84958e0537f None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:41.814704 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b35805-e1f0-47ca-a36f-f84958e0537f None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:41.814704 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b35805-e1f0-47ca-a36f-f84958e0537f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:41.838456 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-e6b35805-e1f0-47ca-a36f-f84958e0537f None None] MFA Rules not processed for user `7d90fa0cecb84aa2b8064d0449560c3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:21:41.839652 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-e6b35805-e1f0-47ca-a36f-f84958e0537f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:41.846447 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f33b32-cf73-48ba-b6ad-7feffd98cbce None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:41.858364 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:21:41.910527 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068478a-2eee-4bc9-8973-c701ee5731ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:41.915651 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068478a-2eee-4bc9-8973-c701ee5731ad service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:41.915815 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 804/1610] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:21:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:21:41.915921 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068478a-2eee-4bc9-8973-c701ee5731ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:41.915921 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068478a-2eee-4bc9-8973-c701ee5731ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:41.916111 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed833e-5473-4f51-a677-9895ba1beb88 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:41.916111 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed833e-5473-4f51-a677-9895ba1beb88 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:41.916111 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed833e-5473-4f51-a677-9895ba1beb88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:41.956264 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-25ed833e-5473-4f51-a677-9895ba1beb88 None None] MFA Rules not processed for user `74a2bbfe916a4f2f971c3ea952860988`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:21:41.957577 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-25ed833e-5473-4f51-a677-9895ba1beb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:41.962507 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:21:42.009354 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7068478a-2eee-4bc9-8973-c701ee5731ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:42.009354 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7068478a-2eee-4bc9-8973-c701ee5731ad service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:42.029211 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 807/1611] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:21:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:21:42.029211 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068478a-2eee-4bc9-8973-c701ee5731ad service neutron] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:42.035544 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068478a-2eee-4bc9-8973-c701ee5731ad service neutron] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:42.041076 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb826d72-5b32-4048-abe3-7a7064f4a863 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:42.041915 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb826d72-5b32-4048-abe3-7a7064f4a863 service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:42.042205 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb826d72-5b32-4048-abe3-7a7064f4a863 service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:42.042604 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb826d72-5b32-4048-abe3-7a7064f4a863 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:42.048972 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 805/1612] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:21:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:21:42.048972 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed833e-5473-4f51-a677-9895ba1beb88 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:42.067433 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed833e-5473-4f51-a677-9895ba1beb88 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:42.068550 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb826d72-5b32-4048-abe3-7a7064f4a863 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:42.070111 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb826d72-5b32-4048-abe3-7a7064f4a863 service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:42.072895 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df61e07-0110-4e4f-bf93-47843cf31e31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:42.073779 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df61e07-0110-4e4f-bf93-47843cf31e31 service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:42.074231 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df61e07-0110-4e4f-bf93-47843cf31e31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:42.074666 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df61e07-0110-4e4f-bf93-47843cf31e31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:42.085780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 808/1613] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:21:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:21:42.086983 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb826d72-5b32-4048-abe3-7a7064f4a863 service neutron] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:42.097568 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb826d72-5b32-4048-abe3-7a7064f4a863 service neutron] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:42.099472 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df61e07-0110-4e4f-bf93-47843cf31e31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:42.101362 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df61e07-0110-4e4f-bf93-47843cf31e31 service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:42.101901 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f98f57-a030-4dd6-87bf-6a0241441724 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:42.102797 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f98f57-a030-4dd6-87bf-6a0241441724 service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:42.103183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f98f57-a030-4dd6-87bf-6a0241441724 service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:42.103560 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f98f57-a030-4dd6-87bf-6a0241441724 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:42.114785 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 806/1614] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:21:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:21:42.115600 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f98f57-a030-4dd6-87bf-6a0241441724 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:42.116176 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c4551-acac-460c-a0c8-b43280fe97b8 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:42.116881 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c4551-acac-460c-a0c8-b43280fe97b8 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:42.117371 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c4551-acac-460c-a0c8-b43280fe97b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:42.118085 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f98f57-a030-4dd6-87bf-6a0241441724 service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:42.130504 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 809/1615] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:21:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:21:42.131843 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a06c8-2ca1-4a5d-85d1-48737a56301b None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:42.132822 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a06c8-2ca1-4a5d-85d1-48737a56301b None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:42.133384 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a06c8-2ca1-4a5d-85d1-48737a56301b None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:42.135211 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 810/1616] 10.222.0.61 () {54 vars in 961 bytes} [Fri Jun 3 13:21:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:21:42.136805 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbccfcca-0a2d-4b5f-8d13-d450cbfab4f3 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:42.137185 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbccfcca-0a2d-4b5f-8d13-d450cbfab4f3 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:42.137582 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbccfcca-0a2d-4b5f-8d13-d450cbfab4f3 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:42.139008 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-4a6c4551-acac-460c-a0c8-b43280fe97b8 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:21:42.139767 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 811/1617] 10.222.0.61 () {54 vars in 961 bytes} [Fri Jun 3 13:21:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:21:42.142323 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eafbf6-409d-477f-a41b-d5c7fd2b8e4c None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:42.142748 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eafbf6-409d-477f-a41b-d5c7fd2b8e4c None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:42.143135 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eafbf6-409d-477f-a41b-d5c7fd2b8e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:42.148351 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-4a6c4551-acac-460c-a0c8-b43280fe97b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:42.158341 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 807/1618] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:21:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:21:42.160629 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2afdd0-5844-4eb3-ab07-d60f66b5f584 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:42.160921 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2afdd0-5844-4eb3-ab07-d60f66b5f584 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:42.161198 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2afdd0-5844-4eb3-ab07-d60f66b5f584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:42.176209 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-65eafbf6-409d-477f-a41b-d5c7fd2b8e4c None None] MFA Rules not processed for user `066aaba3e9af4f85ab0cba89a3d32e34`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:21:42.177433 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-65eafbf6-409d-477f-a41b-d5c7fd2b8e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:42.184130 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-7b2afdd0-5844-4eb3-ab07-d60f66b5f584 None None] MFA Rules not processed for user `066aaba3e9af4f85ab0cba89a3d32e34`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:21:42.185382 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-7b2afdd0-5844-4eb3-ab07-d60f66b5f584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:42.277296 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 812/1619] 10.222.0.61 () {58 vars in 1058 bytes} [Fri Jun 3 13:21:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:21:42.278328 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eafbf6-409d-477f-a41b-d5c7fd2b8e4c None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:42.280447 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 808/1620] 10.222.0.61 () {58 vars in 1058 bytes} [Fri Jun 3 13:21:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:21:42.281661 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2afdd0-5844-4eb3-ab07-d60f66b5f584 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:42.301030 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eafbf6-409d-477f-a41b-d5c7fd2b8e4c None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:42.301189 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2afdd0-5844-4eb3-ab07-d60f66b5f584 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:42.301308 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131af9c8-6f5f-4909-8e86-57f47b300eae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:42.301308 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131af9c8-6f5f-4909-8e86-57f47b300eae service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:42.301308 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131af9c8-6f5f-4909-8e86-57f47b300eae service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:42.301308 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131af9c8-6f5f-4909-8e86-57f47b300eae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:42.301671 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43353fcc-4ca9-478c-b45d-52562c6a1e1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066aaba3e9af4f85ab0cba89a3d32e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:42.301671 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43353fcc-4ca9-478c-b45d-52562c6a1e1e service nova] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:42.301671 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43353fcc-4ca9-478c-b45d-52562c6a1e1e service nova] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:42.301671 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43353fcc-4ca9-478c-b45d-52562c6a1e1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:42.306083 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131af9c8-6f5f-4909-8e86-57f47b300eae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:42.308525 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131af9c8-6f5f-4909-8e86-57f47b300eae service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:42.308795 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43353fcc-4ca9-478c-b45d-52562c6a1e1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:42.310581 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43353fcc-4ca9-478c-b45d-52562c6a1e1e service nova] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:42.321614 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 809/1621] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:21:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:21:42.322458 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43353fcc-4ca9-478c-b45d-52562c6a1e1e service nova] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:42.328514 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 813/1622] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:21:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:21:42.334489 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43353fcc-4ca9-478c-b45d-52562c6a1e1e service nova] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:42.342190 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57e23ff-1d51-4edc-9bbb-cce86ffe3076 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066aaba3e9af4f85ab0cba89a3d32e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:42.342849 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e23ff-1d51-4edc-9bbb-cce86ffe3076 service nova] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:42.343312 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e23ff-1d51-4edc-9bbb-cce86ffe3076 service nova] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:42.343621 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e23ff-1d51-4edc-9bbb-cce86ffe3076 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:42.355205 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57e23ff-1d51-4edc-9bbb-cce86ffe3076 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:42.357257 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57e23ff-1d51-4edc-9bbb-cce86ffe3076 service nova] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:42.369213 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 810/1623] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:21:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:21:42.643841 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2804e-bad4-4669-9317-a5a4766ca3a0 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:42.643841 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2804e-bad4-4669-9317-a5a4766ca3a0 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:42.643841 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2804e-bad4-4669-9317-a5a4766ca3a0 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:42.643841 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 814/1624] 10.222.0.61 () {54 vars in 912 bytes} [Fri Jun 3 13:21:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:21:42.648955 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c72a9-2c6d-473d-8c9c-375cbeed297f None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:42.649256 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c72a9-2c6d-473d-8c9c-375cbeed297f None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:42.649533 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c72a9-2c6d-473d-8c9c-375cbeed297f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:42.692093 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-fc5c72a9-2c6d-473d-8c9c-375cbeed297f None None] MFA Rules not processed for user `066aaba3e9af4f85ab0cba89a3d32e34`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:21:42.694911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-fc5c72a9-2c6d-473d-8c9c-375cbeed297f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:42.711298 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd58670-14e9-4c96-955d-13142b564723 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:42.711594 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd58670-14e9-4c96-955d-13142b564723 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:42.711866 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd58670-14e9-4c96-955d-13142b564723 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:42.713555 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 815/1625] 10.222.0.61 () {54 vars in 912 bytes} [Fri Jun 3 13:21:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:21:42.719497 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719b684-18ff-4302-8f2e-36ac6f2d151d None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:42.719748 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719b684-18ff-4302-8f2e-36ac6f2d151d None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:42.720030 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719b684-18ff-4302-8f2e-36ac6f2d151d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:42.726472 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 811/1626] 10.222.0.61 () {58 vars in 1009 bytes} [Fri Jun 3 13:21:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:21:42.744834 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c72a9-2c6d-473d-8c9c-375cbeed297f None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:42.758681 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-9719b684-18ff-4302-8f2e-36ac6f2d151d None None] MFA Rules not processed for user `066aaba3e9af4f85ab0cba89a3d32e34`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:21:42.760919 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-9719b684-18ff-4302-8f2e-36ac6f2d151d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:42.780990 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 816/1627] 10.222.0.61 () {58 vars in 1009 bytes} [Fri Jun 3 13:21:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:21:42.797505 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719b684-18ff-4302-8f2e-36ac6f2d151d None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:42.813470 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:21:42.838793 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:21:42.850701 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c72a9-2c6d-473d-8c9c-375cbeed297f None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:42.854834 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc336e-ed65-426d-91e7-7da461af71b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:42.855590 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc336e-ed65-426d-91e7-7da461af71b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:42.856597 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc336e-ed65-426d-91e7-7da461af71b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:42.856958 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc336e-ed65-426d-91e7-7da461af71b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:42.869475 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cc336e-ed65-426d-91e7-7da461af71b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:42.875600 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cc336e-ed65-426d-91e7-7da461af71b2 service cinder] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:42.875751 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719b684-18ff-4302-8f2e-36ac6f2d151d None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:42.875751 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de89b7f1-1287-4b82-b39d-aa38da742864 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:42.876367 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89b7f1-1287-4b82-b39d-aa38da742864 service cinder] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:42.876667 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89b7f1-1287-4b82-b39d-aa38da742864 service cinder] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:42.876948 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89b7f1-1287-4b82-b39d-aa38da742864 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:42.884084 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 812/1628] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:21:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:21:42.894938 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de89b7f1-1287-4b82-b39d-aa38da742864 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:42.896919 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de89b7f1-1287-4b82-b39d-aa38da742864 service cinder] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:42.911465 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 817/1629] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:21:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:21:43.212726 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc336e-ed65-426d-91e7-7da461af71b2 service cinder] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:43.227671 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc336e-ed65-426d-91e7-7da461af71b2 service cinder] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:43.236549 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e4957-94fe-4c1c-9e62-db306d9bf8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:43.238708 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e4957-94fe-4c1c-9e62-db306d9bf8ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:43.239097 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e4957-94fe-4c1c-9e62-db306d9bf8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:43.239595 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e4957-94fe-4c1c-9e62-db306d9bf8ce admin admin] PATH_INFO: `/v3/users/7d90fa0cecb84aa2b8064d0449560c3b` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:43.241128 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e4957-94fe-4c1c-9e62-db306d9bf8ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d90fa0cecb84aa2b8064d0449560c3b)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:43.242578 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: WARNING py.warnings [None req-1d6e4957-94fe-4c1c-9e62-db306d9bf8ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 13:21:43.242578 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: warnings.warn(msg) Jun 03 13:21:43.242578 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: Jun 03 13:21:43.244389 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e4957-94fe-4c1c-9e62-db306d9bf8ce admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:43.526900 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-1d6e4957-94fe-4c1c-9e62-db306d9bf8ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d90fa0cecb84aa2b8064d0449560c3b'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:21:43.575057 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-1d6e4957-94fe-4c1c-9e62-db306d9bf8ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d90fa0cecb84aa2b8064d0449560c3b'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:21:43.576826 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-1d6e4957-94fe-4c1c-9e62-db306d9bf8ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d90fa0cecb84aa2b8064d0449560c3b'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:21:43.592555 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-1d6e4957-94fe-4c1c-9e62-db306d9bf8ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d90fa0cecb84aa2b8064d0449560c3b'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:21:43.594031 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-1d6e4957-94fe-4c1c-9e62-db306d9bf8ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d90fa0cecb84aa2b8064d0449560c3b'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:21:43.680893 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 813/1630] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:21:43 2022] DELETE /identity/v3/users/7d90fa0cecb84aa2b8064d0449560c3b => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:21:43.682115 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed113023-7d21-4688-9e91-5ee193cd8e54 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:43.682603 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed113023-7d21-4688-9e91-5ee193cd8e54 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:43.682704 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed113023-7d21-4688-9e91-5ee193cd8e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:43.735812 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-ed113023-7d21-4688-9e91-5ee193cd8e54 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:21:43.737251 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-ed113023-7d21-4688-9e91-5ee193cd8e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:43.850211 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 818/1631] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:21:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:21:43.871484 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e4957-94fe-4c1c-9e62-db306d9bf8ce admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:43.873348 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-1d6e4957-94fe-4c1c-9e62-db306d9bf8ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:43.941076 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e4957-94fe-4c1c-9e62-db306d9bf8ce admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:43.944691 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7a868a-cdc4-4ab4-8166-058f79c060f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:43.945364 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a868a-cdc4-4ab4-8166-058f79c060f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:43.945646 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a868a-cdc4-4ab4-8166-058f79c060f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:43.945918 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a868a-cdc4-4ab4-8166-058f79c060f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:43.956437 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7a868a-cdc4-4ab4-8166-058f79c060f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:43.957894 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7a868a-cdc4-4ab4-8166-058f79c060f7 service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:43.969637 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 814/1632] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:21:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:21:44.365820 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47e441-5038-4cd6-9111-8817416bcb0b None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:44.366413 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47e441-5038-4cd6-9111-8817416bcb0b None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:44.367099 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47e441-5038-4cd6-9111-8817416bcb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:44.423810 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-ce47e441-5038-4cd6-9111-8817416bcb0b None None] MFA Rules not processed for user `144789e582de45c280d03b92dee5692a`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:21:44.425658 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-ce47e441-5038-4cd6-9111-8817416bcb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:44.799090 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 819/1633] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:21:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:21:44.800738 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045f4ab-11bc-4e2a-9f5b-ab261cc745da None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:44.800738 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045f4ab-11bc-4e2a-9f5b-ab261cc745da None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:44.800738 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045f4ab-11bc-4e2a-9f5b-ab261cc745da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:44.800738 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-6045f4ab-11bc-4e2a-9f5b-ab261cc745da None None] MFA Rules not processed for user `144789e582de45c280d03b92dee5692a`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:21:44.800738 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-6045f4ab-11bc-4e2a-9f5b-ab261cc745da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:44.800738 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 815/1634] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:21:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:21:44.802412 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce47e441-5038-4cd6-9111-8817416bcb0b None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:44.802412 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-ce47e441-5038-4cd6-9111-8817416bcb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:44.802412 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:21:44.802412 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce47e441-5038-4cd6-9111-8817416bcb0b None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:44.803790 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a83db-fb09-4167-8b2d-264122da2e95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066aaba3e9af4f85ab0cba89a3d32e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:44.803790 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a83db-fb09-4167-8b2d-264122da2e95 service nova] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:44.803790 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a83db-fb09-4167-8b2d-264122da2e95 service nova] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:44.803790 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a83db-fb09-4167-8b2d-264122da2e95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:44.805324 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a83db-fb09-4167-8b2d-264122da2e95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:44.805324 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a83db-fb09-4167-8b2d-264122da2e95 service nova] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:44.806978 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 820/1635] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:21:44 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:21:44.954473 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045f4ab-11bc-4e2a-9f5b-ab261cc745da None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:44.956223 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-6045f4ab-11bc-4e2a-9f5b-ab261cc745da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:45.007565 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045f4ab-11bc-4e2a-9f5b-ab261cc745da None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:45.025751 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3e6c0-7b6a-4d75-abeb-25cc6eb01324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:45.027989 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3e6c0-7b6a-4d75-abeb-25cc6eb01324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:45.028330 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3e6c0-7b6a-4d75-abeb-25cc6eb01324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:45.028625 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3e6c0-7b6a-4d75-abeb-25cc6eb01324 admin admin] PATH_INFO: `/v3/projects/6d4f45d0a81a4dd3aab4f7531c859d3d` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:45.033483 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3e6c0-7b6a-4d75-abeb-25cc6eb01324 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d4f45d0a81a4dd3aab4f7531c859d3d)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:45.037590 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3e6c0-7b6a-4d75-abeb-25cc6eb01324 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:45.203094 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-50f3e6c0-7b6a-4d75-abeb-25cc6eb01324 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d4f45d0a81a4dd3aab4f7531c859d3d', 'request_id': 'req-50f3e6c0-7b6a-4d75-abeb-25cc6eb01324'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:21:45.204850 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:21:45.216314 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-50f3e6c0-7b6a-4d75-abeb-25cc6eb01324 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d4f45d0a81a4dd3aab4f7531c859d3d', 'request_id': 'req-50f3e6c0-7b6a-4d75-abeb-25cc6eb01324'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:21:45.231115 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-50f3e6c0-7b6a-4d75-abeb-25cc6eb01324 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d4f45d0a81a4dd3aab4f7531c859d3d', 'request_id': 'req-50f3e6c0-7b6a-4d75-abeb-25cc6eb01324'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:21:45.425207 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-50f3e6c0-7b6a-4d75-abeb-25cc6eb01324 admin admin] The token cache is being invalidate because project 6d4f45d0a81a4dd3aab4f7531c859d3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:21:45.427969 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-50f3e6c0-7b6a-4d75-abeb-25cc6eb01324 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:21:45.430348 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-50f3e6c0-7b6a-4d75-abeb-25cc6eb01324 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:21:45.440558 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 816/1636] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:21:44 2022] DELETE /identity/v3/projects/6d4f45d0a81a4dd3aab4f7531c859d3d => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:21:45.442521 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957344af-9952-4214-9e33-d1844080696a None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:45.442851 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957344af-9952-4214-9e33-d1844080696a None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:45.443309 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957344af-9952-4214-9e33-d1844080696a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:45.495732 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-957344af-9952-4214-9e33-d1844080696a None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:21:45.498292 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-957344af-9952-4214-9e33-d1844080696a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:45.648589 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 821/1637] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:21:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:21:45.650480 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53877c3-aeac-42f2-898e-7194b35f6505 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:45.650845 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53877c3-aeac-42f2-898e-7194b35f6505 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:45.651131 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53877c3-aeac-42f2-898e-7194b35f6505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:45.676351 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-b53877c3-aeac-42f2-898e-7194b35f6505 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:21:45.679094 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-b53877c3-aeac-42f2-898e-7194b35f6505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:45.713198 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 817/1638] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:21:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:21:45.719140 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957344af-9952-4214-9e33-d1844080696a None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:45.732878 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957344af-9952-4214-9e33-d1844080696a None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:45.741156 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccca87c-d5d7-455c-a68d-c29c36cb70b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:45.742374 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccca87c-d5d7-455c-a68d-c29c36cb70b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:45.743007 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccca87c-d5d7-455c-a68d-c29c36cb70b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:45.743453 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccca87c-d5d7-455c-a68d-c29c36cb70b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:45.744638 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccca87c-d5d7-455c-a68d-c29c36cb70b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:21:45.746136 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccca87c-d5d7-455c-a68d-c29c36cb70b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:45.747932 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccca87c-d5d7-455c-a68d-c29c36cb70b8 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:45.771551 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 822/1639] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:21:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:21:45.771711 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53877c3-aeac-42f2-898e-7194b35f6505 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:45.790229 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53877c3-aeac-42f2-898e-7194b35f6505 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:45.804815 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb8dae-ff0d-4bef-aba4-a1b1cc0a2e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:45.807319 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb8dae-ff0d-4bef-aba4-a1b1cc0a2e34 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:45.807639 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb8dae-ff0d-4bef-aba4-a1b1cc0a2e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:45.807920 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb8dae-ff0d-4bef-aba4-a1b1cc0a2e34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:45.815152 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb8dae-ff0d-4bef-aba4-a1b1cc0a2e34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:45.821109 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb8dae-ff0d-4bef-aba4-a1b1cc0a2e34 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:45.977739 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccca87c-d5d7-455c-a68d-c29c36cb70b8 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:45.979134 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 818/1640] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:21:45 2022] POST /identity/v3/projects => generated 371 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:21:46.002598 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccca87c-d5d7-455c-a68d-c29c36cb70b8 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:46.076509 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc44f2-8ab4-401b-b43d-2d74c059eda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:46.077988 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc44f2-8ab4-401b-b43d-2d74c059eda4 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:46.078683 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc44f2-8ab4-401b-b43d-2d74c059eda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:46.079183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc44f2-8ab4-401b-b43d-2d74c059eda4 admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:46.080195 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc44f2-8ab4-401b-b43d-2d74c059eda4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:46.082715 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc44f2-8ab4-401b-b43d-2d74c059eda4 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:46.160048 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de916d4-a4fa-44e2-a293-0dd603d1814d None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:46.160412 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de916d4-a4fa-44e2-a293-0dd603d1814d None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:46.160648 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de916d4-a4fa-44e2-a293-0dd603d1814d None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:46.162585 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 819/1641] 10.222.0.61 () {54 vars in 912 bytes} [Fri Jun 3 13:21:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:21:46.170293 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3baf57-ed19-49d2-8ccb-dbafb899a3a7 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:46.170592 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3baf57-ed19-49d2-8ccb-dbafb899a3a7 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:46.170880 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3baf57-ed19-49d2-8ccb-dbafb899a3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:46.189701 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 823/1642] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:21:45 2022] POST /identity/v3/users => generated 286 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:21:46.194168 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc44f2-8ab4-401b-b43d-2d74c059eda4 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:46.210680 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc44f2-8ab4-401b-b43d-2d74c059eda4 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:46.224466 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439a9c4-31c6-40e1-ab52-18de36c01e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:46.224466 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439a9c4-31c6-40e1-ab52-18de36c01e9c admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:46.224466 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439a9c4-31c6-40e1-ab52-18de36c01e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:46.224466 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439a9c4-31c6-40e1-ab52-18de36c01e9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:46.224807 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439a9c4-31c6-40e1-ab52-18de36c01e9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:46.224807 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439a9c4-31c6-40e1-ab52-18de36c01e9c admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:46.242985 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 824/1643] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:21:46.249087 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439a9c4-31c6-40e1-ab52-18de36c01e9c admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:46.250351 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-ab3baf57-ed19-49d2-8ccb-dbafb899a3a7 None None] MFA Rules not processed for user `bdb5b24bd01c405c93e32ab4b329bcf1`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:21:46.252556 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-ab3baf57-ed19-49d2-8ccb-dbafb899a3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:46.264556 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439a9c4-31c6-40e1-ab52-18de36c01e9c admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:46.274169 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c2a47-3f09-48a0-bfb3-fb65b15e8491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:46.275168 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c2a47-3f09-48a0-bfb3-fb65b15e8491 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:46.276463 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c2a47-3f09-48a0-bfb3-fb65b15e8491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:46.276906 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c2a47-3f09-48a0-bfb3-fb65b15e8491 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:46.281719 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c2a47-3f09-48a0-bfb3-fb65b15e8491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:46.281719 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c2a47-3f09-48a0-bfb3-fb65b15e8491 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:46.299439 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 825/1644] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:21:46.303200 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c2a47-3f09-48a0-bfb3-fb65b15e8491 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:46.326936 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c2a47-3f09-48a0-bfb3-fb65b15e8491 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:46.331185 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 820/1645] 10.222.0.61 () {58 vars in 1009 bytes} [Fri Jun 3 13:21:46 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:21:46.343777 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da33bf1d-399e-4600-bb86-3f81d9fae763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:46.344968 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da33bf1d-399e-4600-bb86-3f81d9fae763 admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:46.345251 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da33bf1d-399e-4600-bb86-3f81d9fae763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:46.345595 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da33bf1d-399e-4600-bb86-3f81d9fae763 admin admin] PATH_INFO: `/v3/projects/542f8c5303b84e719623bfc48613fa44/users/7e46a995080e479082b439cdec796fb1/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:46.347292 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3baf57-ed19-49d2-8ccb-dbafb899a3a7 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:46.351076 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-ab3baf57-ed19-49d2-8ccb-dbafb899a3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:46.366388 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3baf57-ed19-49d2-8ccb-dbafb899a3a7 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:46.372616 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70532793-cbd9-4478-8298-e734a316b405 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:46.373586 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70532793-cbd9-4478-8298-e734a316b405 service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:46.374066 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70532793-cbd9-4478-8298-e734a316b405 service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:46.374600 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70532793-cbd9-4478-8298-e734a316b405 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:46.386408 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70532793-cbd9-4478-8298-e734a316b405 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:46.387363 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da33bf1d-399e-4600-bb86-3f81d9fae763 admin admin] RBAC: Authorizing `identity:create_grant(project_id=542f8c5303b84e719623bfc48613fa44, user_id=7e46a995080e479082b439cdec796fb1, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:46.389812 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70532793-cbd9-4478-8298-e734a316b405 service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:46.392233 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da33bf1d-399e-4600-bb86-3f81d9fae763 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:46.408931 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 821/1646] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:21:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:21:46.526170 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:21:46.534238 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 826/1647] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:21:46 2022] PUT /identity/v3/projects/542f8c5303b84e719623bfc48613fa44/users/7e46a995080e479082b439cdec796fb1/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:21:46.560025 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7060d-afc2-411e-bdd3-a56094bd8ac1 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:46.560551 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7060d-afc2-411e-bdd3-a56094bd8ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:46.561942 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7060d-afc2-411e-bdd3-a56094bd8ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:46.626107 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-dfd7060d-afc2-411e-bdd3-a56094bd8ac1 None None] MFA Rules not processed for user `7e46a995080e479082b439cdec796fb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:21:46.629673 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-dfd7060d-afc2-411e-bdd3-a56094bd8ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:46.737520 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 822/1648] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:21:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:21:46.738537 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da33bf1d-399e-4600-bb86-3f81d9fae763 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:46.897127 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da33bf1d-399e-4600-bb86-3f81d9fae763 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:46.911545 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51908b-5127-4363-9e2c-534302acb366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:46.914268 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51908b-5127-4363-9e2c-534302acb366 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:46.914562 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51908b-5127-4363-9e2c-534302acb366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:46.914843 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51908b-5127-4363-9e2c-534302acb366 admin admin] PATH_INFO: `/v3/projects` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:46.915564 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51908b-5127-4363-9e2c-534302acb366 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:46.924876 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51908b-5127-4363-9e2c-534302acb366 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:47.039542 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 827/1649] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:21:46 2022] POST /identity/v3/projects => generated 371 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:21:47.041337 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7060d-afc2-411e-bdd3-a56094bd8ac1 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:47.056926 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7060d-afc2-411e-bdd3-a56094bd8ac1 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:47.081519 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:21:47.137067 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bb3e32-f85d-416b-a083-c69ba77bc11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:47.138022 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb3e32-f85d-416b-a083-c69ba77bc11b admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:47.138395 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb3e32-f85d-416b-a083-c69ba77bc11b admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:47.138730 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb3e32-f85d-416b-a083-c69ba77bc11b admin admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:47.139555 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bb3e32-f85d-416b-a083-c69ba77bc11b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:47.143028 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bb3e32-f85d-416b-a083-c69ba77bc11b admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:47.256612 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 823/1650] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:21:47 2022] POST /identity/v3/users => generated 292 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:21:47.260417 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51908b-5127-4363-9e2c-534302acb366 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:47.276064 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062ab1f-48e5-43b1-8ec2-338aac1c21b8 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:47.276388 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062ab1f-48e5-43b1-8ec2-338aac1c21b8 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:47.276666 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062ab1f-48e5-43b1-8ec2-338aac1c21b8 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:47.278516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51908b-5127-4363-9e2c-534302acb366 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:47.280493 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 824/1651] 10.222.0.61 () {54 vars in 960 bytes} [Fri Jun 3 13:21:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:21:47.285132 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8dd58-9c5b-4789-9f8e-6a860f8a39b4 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:47.285445 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8dd58-9c5b-4789-9f8e-6a860f8a39b4 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:47.285693 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8dd58-9c5b-4789-9f8e-6a860f8a39b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:47.289067 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f718c-636c-4ac6-98e8-7b666136c8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:47.290289 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f718c-636c-4ac6-98e8-7b666136c8de admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:47.290712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f718c-636c-4ac6-98e8-7b666136c8de admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:47.291125 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f718c-636c-4ac6-98e8-7b666136c8de admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:47.291992 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f718c-636c-4ac6-98e8-7b666136c8de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:47.293965 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f718c-636c-4ac6-98e8-7b666136c8de admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:47.311043 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 828/1652] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:21:47.315945 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f718c-636c-4ac6-98e8-7b666136c8de admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:47.328422 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f718c-636c-4ac6-98e8-7b666136c8de admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:47.339041 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd84353-6a68-4708-bf09-b30c46217d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:47.339999 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd84353-6a68-4708-bf09-b30c46217d5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:47.340554 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-c8d8dd58-9c5b-4789-9f8e-6a860f8a39b4 None None] MFA Rules not processed for user `a5c4ad16c9454b74ae8445b115cf0af4`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:21:47.341695 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd84353-6a68-4708-bf09-b30c46217d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:47.341975 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd84353-6a68-4708-bf09-b30c46217d5a admin admin] PATH_INFO: `/v3/projects/5325b483a8f64a9aac96e8cf2721b703/users/a51ece381ed7485b9859cade8d8eaacf/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:47.343134 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-c8d8dd58-9c5b-4789-9f8e-6a860f8a39b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:47.395103 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd84353-6a68-4708-bf09-b30c46217d5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5325b483a8f64a9aac96e8cf2721b703, user_id=a51ece381ed7485b9859cade8d8eaacf, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:47.397795 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd84353-6a68-4708-bf09-b30c46217d5a admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:47.492248 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 825/1653] 10.222.0.61 () {58 vars in 1057 bytes} [Fri Jun 3 13:21:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:21:47.503502 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8dd58-9c5b-4789-9f8e-6a860f8a39b4 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:47.516385 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 829/1654] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:21:47 2022] PUT /identity/v3/projects/5325b483a8f64a9aac96e8cf2721b703/users/a51ece381ed7485b9859cade8d8eaacf/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:21:47.519122 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd84353-6a68-4708-bf09-b30c46217d5a admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:47.525532 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8dd58-9c5b-4789-9f8e-6a860f8a39b4 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:47.657989 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd84353-6a68-4708-bf09-b30c46217d5a admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:47.665888 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef3521-faf2-469a-919f-c6480ce9a5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:47.667473 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef3521-faf2-469a-919f-c6480ce9a5c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:47.667904 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef3521-faf2-469a-919f-c6480ce9a5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:47.668976 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef3521-faf2-469a-919f-c6480ce9a5c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:47.670045 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ef3521-faf2-469a-919f-c6480ce9a5c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:47.678157 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ef3521-faf2-469a-919f-c6480ce9a5c2 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:47.696679 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 830/1655] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:21:47.703092 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef3521-faf2-469a-919f-c6480ce9a5c2 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:47.708398 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c15774-feea-4774-b531-5fcc9ab6ed24 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5c4ad16c9454b74ae8445b115cf0af4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:47.710756 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c15774-feea-4774-b531-5fcc9ab6ed24 service placement] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:47.711784 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c15774-feea-4774-b531-5fcc9ab6ed24 service placement] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:47.711784 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c15774-feea-4774-b531-5fcc9ab6ed24 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:47.724082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-e1c15774-feea-4774-b531-5fcc9ab6ed24 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:47.750361 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef3521-faf2-469a-919f-c6480ce9a5c2 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:47.770526 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c15774-feea-4774-b531-5fcc9ab6ed24 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:47.772631 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c15774-feea-4774-b531-5fcc9ab6ed24 service placement] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:47.775030 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58965af-c2aa-486a-b45a-7bad1747c235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:47.775955 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58965af-c2aa-486a-b45a-7bad1747c235 admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:47.776299 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58965af-c2aa-486a-b45a-7bad1747c235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:47.776580 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58965af-c2aa-486a-b45a-7bad1747c235 admin admin] PATH_INFO: `/v3/projects/5325b483a8f64a9aac96e8cf2721b703/users/a51ece381ed7485b9859cade8d8eaacf/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:47.779646 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58965af-c2aa-486a-b45a-7bad1747c235 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5325b483a8f64a9aac96e8cf2721b703, user_id=a51ece381ed7485b9859cade8d8eaacf, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:47.784672 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58965af-c2aa-486a-b45a-7bad1747c235 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:47.788082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 826/1656] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:21:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:21:47.809542 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 831/1657] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:21:47 2022] PUT /identity/v3/projects/5325b483a8f64a9aac96e8cf2721b703/users/a51ece381ed7485b9859cade8d8eaacf/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:21:47.815054 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431a18d-a828-4ec7-aee0-6f958f82d052 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:47.815546 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431a18d-a828-4ec7-aee0-6f958f82d052 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:47.816082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431a18d-a828-4ec7-aee0-6f958f82d052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:47.910164 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-3431a18d-a828-4ec7-aee0-6f958f82d052 None None] MFA Rules not processed for user `a51ece381ed7485b9859cade8d8eaacf`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:21:47.910661 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-3431a18d-a828-4ec7-aee0-6f958f82d052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:48.235306 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 827/1658] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:21:47 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:21:48.245768 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58965af-c2aa-486a-b45a-7bad1747c235 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:48.247521 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-a58965af-c2aa-486a-b45a-7bad1747c235 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:48.321986 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:21:48.382149 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58965af-c2aa-486a-b45a-7bad1747c235 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:48.391733 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ba7e2-8a15-42bd-91a3-9ae763e89062 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:48.392544 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ba7e2-8a15-42bd-91a3-9ae763e89062 service cinder] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:48.393032 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ba7e2-8a15-42bd-91a3-9ae763e89062 service cinder] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:48.393736 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ba7e2-8a15-42bd-91a3-9ae763e89062 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:48.415406 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ba7e2-8a15-42bd-91a3-9ae763e89062 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:48.417032 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ba7e2-8a15-42bd-91a3-9ae763e89062 service cinder] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:48.466587 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 832/1659] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:21:48 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 13:21:48.694473 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:21:48.778668 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431a18d-a828-4ec7-aee0-6f958f82d052 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:48.792905 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431a18d-a828-4ec7-aee0-6f958f82d052 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:48.800837 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4554cd27-1182-494c-9386-e6daf3446c43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:48.803655 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4554cd27-1182-494c-9386-e6daf3446c43 service cinder] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:48.803944 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4554cd27-1182-494c-9386-e6daf3446c43 service cinder] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:48.804337 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4554cd27-1182-494c-9386-e6daf3446c43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:48.969933 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4554cd27-1182-494c-9386-e6daf3446c43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:48.971770 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4554cd27-1182-494c-9386-e6daf3446c43 service cinder] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:49.007146 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 828/1660] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:21:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:21:54.287680 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b452f25-a7f5-4109-b008-c6a68b228665 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:54.288247 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b452f25-a7f5-4109-b008-c6a68b228665 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:54.288558 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b452f25-a7f5-4109-b008-c6a68b228665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:54.364692 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-4b452f25-a7f5-4109-b008-c6a68b228665 None None] MFA Rules not processed for user `06c55d0ea52f40ae9125d2efe1d159a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:21:54.368509 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-4b452f25-a7f5-4109-b008-c6a68b228665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:54.505315 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 833/1661] 10.222.0.61 () {58 vars in 1009 bytes} [Fri Jun 3 13:21:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:21:55.051215 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4554cd27-1182-494c-9386-e6daf3446c43 service cinder] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:55.053638 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-4554cd27-1182-494c-9386-e6daf3446c43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:55.156875 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fb908-68c2-48e5-b595-a2bb73dca16e None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:55.157499 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fb908-68c2-48e5-b595-a2bb73dca16e None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:55.157976 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fb908-68c2-48e5-b595-a2bb73dca16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:55.246961 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-328fb908-68c2-48e5-b595-a2bb73dca16e None None] MFA Rules not processed for user `7254adba100f4453b2b9a953990dbb41`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:21:55.249828 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-328fb908-68c2-48e5-b595-a2bb73dca16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:55.293483 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4554cd27-1182-494c-9386-e6daf3446c43 service cinder] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:55.302608 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d3b3c2-48b1-4ddd-8536-773d2895c5b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07ad3dd7477497ea25c2a01bff35712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:55.303801 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3b3c2-48b1-4ddd-8536-773d2895c5b1 service swift] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:55.304102 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3b3c2-48b1-4ddd-8536-773d2895c5b1 service swift] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:55.304596 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3b3c2-48b1-4ddd-8536-773d2895c5b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:55.338766 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d3b3c2-48b1-4ddd-8536-773d2895c5b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:55.340571 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d3b3c2-48b1-4ddd-8536-773d2895c5b1 service swift] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:55.363514 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 829/1662] 10.222.0.61 () {60 vars in 1384 bytes} [Fri Jun 3 13:21:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 13:21:55.486242 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d3b3c2-48b1-4ddd-8536-773d2895c5b1 service swift] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:55.487004 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 834/1663] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:21:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:21:55.511124 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-d9d3b3c2-48b1-4ddd-8536-773d2895c5b1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:55.661159 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:21:55.729208 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d3b3c2-48b1-4ddd-8536-773d2895c5b1 service swift] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:55.745383 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a440eaec-c060-4cfa-869f-f2a38e792fc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066aaba3e9af4f85ab0cba89a3d32e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:55.746336 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440eaec-c060-4cfa-869f-f2a38e792fc2 service nova] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:55.746817 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440eaec-c060-4cfa-869f-f2a38e792fc2 service nova] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:55.746922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440eaec-c060-4cfa-869f-f2a38e792fc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:55.767380 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a440eaec-c060-4cfa-869f-f2a38e792fc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:55.776890 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a440eaec-c060-4cfa-869f-f2a38e792fc2 service nova] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:55.810501 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 830/1664] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:21:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:21:56.402551 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fb908-68c2-48e5-b595-a2bb73dca16e None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:56.406212 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-328fb908-68c2-48e5-b595-a2bb73dca16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:56.721852 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fb908-68c2-48e5-b595-a2bb73dca16e None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:56.736664 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b27c7-c77a-4cc8-b419-83fc06d4e0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:56.738427 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b27c7-c77a-4cc8-b419-83fc06d4e0af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:56.738904 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b27c7-c77a-4cc8-b419-83fc06d4e0af admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:56.739344 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b27c7-c77a-4cc8-b419-83fc06d4e0af admin admin] PATH_INFO: `/v3/users/74a2bbfe916a4f2f971c3ea952860988` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:56.741526 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b27c7-c77a-4cc8-b419-83fc06d4e0af admin admin] RBAC: Authorizing `identity:delete_user(user_id=74a2bbfe916a4f2f971c3ea952860988)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:56.746966 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b27c7-c77a-4cc8-b419-83fc06d4e0af admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:56.798311 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:21:57.039544 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-658b27c7-c77a-4cc8-b419-83fc06d4e0af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74a2bbfe916a4f2f971c3ea952860988'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:21:57.100282 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-658b27c7-c77a-4cc8-b419-83fc06d4e0af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74a2bbfe916a4f2f971c3ea952860988'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:21:57.101526 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-658b27c7-c77a-4cc8-b419-83fc06d4e0af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74a2bbfe916a4f2f971c3ea952860988'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:21:57.126224 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-658b27c7-c77a-4cc8-b419-83fc06d4e0af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74a2bbfe916a4f2f971c3ea952860988'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:21:57.127000 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-658b27c7-c77a-4cc8-b419-83fc06d4e0af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74a2bbfe916a4f2f971c3ea952860988'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:21:57.585751 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 835/1665] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:21:56 2022] DELETE /identity/v3/users/74a2bbfe916a4f2f971c3ea952860988 => generated 0 bytes in 1184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:21:57.593105 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97367f-e9b2-41bc-b29d-2638f183b105 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:57.594005 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97367f-e9b2-41bc-b29d-2638f183b105 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:57.594485 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97367f-e9b2-41bc-b29d-2638f183b105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:57.662871 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-5b97367f-e9b2-41bc-b29d-2638f183b105 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:21:57.667016 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-5b97367f-e9b2-41bc-b29d-2638f183b105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:57.933755 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 831/1666] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:21:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:21:57.975565 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b27c7-c77a-4cc8-b419-83fc06d4e0af admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:57.977169 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-658b27c7-c77a-4cc8-b419-83fc06d4e0af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:58.172306 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b27c7-c77a-4cc8-b419-83fc06d4e0af admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:21:58.176499 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78546c11-587a-4e8f-8e0a-b278f5e13b16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:21:58.179712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78546c11-587a-4e8f-8e0a-b278f5e13b16 service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:58.179712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78546c11-587a-4e8f-8e0a-b278f5e13b16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:58.179712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78546c11-587a-4e8f-8e0a-b278f5e13b16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:58.190548 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78546c11-587a-4e8f-8e0a-b278f5e13b16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:21:58.192214 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78546c11-587a-4e8f-8e0a-b278f5e13b16 service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:21:58.207777 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 836/1667] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:21:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:21:59.743556 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df676c-8b5c-4e70-8b82-5ab64df11519 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:21:59.744566 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df676c-8b5c-4e70-8b82-5ab64df11519 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:21:59.745023 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df676c-8b5c-4e70-8b82-5ab64df11519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:21:59.827029 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-45df676c-8b5c-4e70-8b82-5ab64df11519 None None] MFA Rules not processed for user `965645bc86f44cf38c5f571406722e32`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:21:59.829196 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-45df676c-8b5c-4e70-8b82-5ab64df11519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:59.960821 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 832/1668] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:21:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:21:59.967076 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78546c11-587a-4e8f-8e0a-b278f5e13b16 service neutron] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:59.971639 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-78546c11-587a-4e8f-8e0a-b278f5e13b16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:21:59.988128 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df676c-8b5c-4e70-8b82-5ab64df11519 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:21:59.996167 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-45df676c-8b5c-4e70-8b82-5ab64df11519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:00.078310 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df676c-8b5c-4e70-8b82-5ab64df11519 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:00.084905 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78da119-86a3-4ff0-8545-d4c5b721c5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:00.085854 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78da119-86a3-4ff0-8545-d4c5b721c5e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:00.087002 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78da119-86a3-4ff0-8545-d4c5b721c5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:00.087002 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78da119-86a3-4ff0-8545-d4c5b721c5e6 admin admin] PATH_INFO: `/v3/projects/a7dd0495bb884e57b5fe98c3cb6ba7a9` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:00.088221 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78da119-86a3-4ff0-8545-d4c5b721c5e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7dd0495bb884e57b5fe98c3cb6ba7a9)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:00.090585 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78da119-86a3-4ff0-8545-d4c5b721c5e6 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:00.242172 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78546c11-587a-4e8f-8e0a-b278f5e13b16 service neutron] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:00.252881 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a5811-d158-4142-8c66-6b9b0fa791a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066aaba3e9af4f85ab0cba89a3d32e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:00.254013 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a5811-d158-4142-8c66-6b9b0fa791a3 service nova] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:00.254706 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a5811-d158-4142-8c66-6b9b0fa791a3 service nova] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:00.255254 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a5811-d158-4142-8c66-6b9b0fa791a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:00.284736 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a5811-d158-4142-8c66-6b9b0fa791a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:00.294475 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a5811-d158-4142-8c66-6b9b0fa791a3 service nova] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:00.328004 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 837/1669] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:21:59 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:22:00.339727 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b2675-d00b-440a-8f7e-561ad183437c None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:00.344233 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b2675-d00b-440a-8f7e-561ad183437c None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:00.344233 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b2675-d00b-440a-8f7e-561ad183437c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:00.417012 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-c78da119-86a3-4ff0-8545-d4c5b721c5e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7dd0495bb884e57b5fe98c3cb6ba7a9', 'request_id': 'req-c78da119-86a3-4ff0-8545-d4c5b721c5e6'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:00.438885 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-c78da119-86a3-4ff0-8545-d4c5b721c5e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7dd0495bb884e57b5fe98c3cb6ba7a9', 'request_id': 'req-c78da119-86a3-4ff0-8545-d4c5b721c5e6'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:00.448712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-212b2675-d00b-440a-8f7e-561ad183437c None None] MFA Rules not processed for user `267a2b59a70245dfb7ec1b779f7fdd51`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:00.453868 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-212b2675-d00b-440a-8f7e-561ad183437c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:00.455843 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:00.457483 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-c78da119-86a3-4ff0-8545-d4c5b721c5e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7dd0495bb884e57b5fe98c3cb6ba7a9', 'request_id': 'req-c78da119-86a3-4ff0-8545-d4c5b721c5e6'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:00.479612 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:00.604038 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-c78da119-86a3-4ff0-8545-d4c5b721c5e6 admin admin] The token cache is being invalidate because project a7dd0495bb884e57b5fe98c3cb6ba7a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:22:00.604544 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-c78da119-86a3-4ff0-8545-d4c5b721c5e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:00.605295 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-c78da119-86a3-4ff0-8545-d4c5b721c5e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:00.607345 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 833/1670] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:21:59 2022] DELETE /identity/v3/projects/a7dd0495bb884e57b5fe98c3cb6ba7a9 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:22:00.612074 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b95172-9601-46c5-b6a1-ea70139b4ff5 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:00.613322 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b95172-9601-46c5-b6a1-ea70139b4ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:00.614382 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b95172-9601-46c5-b6a1-ea70139b4ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:00.786002 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-99b95172-9601-46c5-b6a1-ea70139b4ff5 None None] MFA Rules not processed for user `308bdbe63af5415d8e817bd9ba2fad3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:00.790652 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-99b95172-9601-46c5-b6a1-ea70139b4ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:00.824770 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 838/1671] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 496 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:22:00.829595 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382bf87-a810-4bed-b975-ddb8b7684dae None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:00.830347 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382bf87-a810-4bed-b975-ddb8b7684dae None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:00.831330 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382bf87-a810-4bed-b975-ddb8b7684dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:00.917163 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-c382bf87-a810-4bed-b975-ddb8b7684dae None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:00.918693 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-c382bf87-a810-4bed-b975-ddb8b7684dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:01.039332 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 834/1672] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:22:01.039332 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b95172-9601-46c5-b6a1-ea70139b4ff5 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:01.039332 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-99b95172-9601-46c5-b6a1-ea70139b4ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:01.095949 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 839/1673] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:22:01.097293 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e092a-3db0-4e10-9175-f49aa5e9885f None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:01.097781 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e092a-3db0-4e10-9175-f49aa5e9885f None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:01.098688 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e092a-3db0-4e10-9175-f49aa5e9885f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:01.132126 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-1e7e092a-3db0-4e10-9175-f49aa5e9885f None None] MFA Rules not processed for user `308bdbe63af5415d8e817bd9ba2fad3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:01.134920 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-1e7e092a-3db0-4e10-9175-f49aa5e9885f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:01.146522 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 840/1674] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:22:01.146522 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e221fd-8267-40bf-abbd-161fd6e21dfd None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:01.146667 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e221fd-8267-40bf-abbd-161fd6e21dfd None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:01.148641 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e221fd-8267-40bf-abbd-161fd6e21dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:01.181396 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-f2e221fd-8267-40bf-abbd-161fd6e21dfd None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:01.183338 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-f2e221fd-8267-40bf-abbd-161fd6e21dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:01.204204 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 841/1675] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:22:01.206920 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e221fd-8267-40bf-abbd-161fd6e21dfd None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:01.209455 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b95172-9601-46c5-b6a1-ea70139b4ff5 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:01.218662 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e776530-6896-49f8-aae8-528675f5bb09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066aaba3e9af4f85ab0cba89a3d32e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:01.219496 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e776530-6896-49f8-aae8-528675f5bb09 service nova] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:01.223083 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e776530-6896-49f8-aae8-528675f5bb09 service nova] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:01.223083 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e776530-6896-49f8-aae8-528675f5bb09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:01.233343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e221fd-8267-40bf-abbd-161fd6e21dfd None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:01.249594 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e776530-6896-49f8-aae8-528675f5bb09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:01.252565 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e776530-6896-49f8-aae8-528675f5bb09 service nova] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:01.256560 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd183a7-de8b-4dd5-bf81-a9f9bc25fa75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:01.257250 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd183a7-de8b-4dd5-bf81-a9f9bc25fa75 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:01.257534 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd183a7-de8b-4dd5-bf81-a9f9bc25fa75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:01.257808 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd183a7-de8b-4dd5-bf81-a9f9bc25fa75 admin admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:01.258594 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd183a7-de8b-4dd5-bf81-a9f9bc25fa75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:22:01.258905 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd183a7-de8b-4dd5-bf81-a9f9bc25fa75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:01.260646 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd183a7-de8b-4dd5-bf81-a9f9bc25fa75 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:01.298015 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 835/1676] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:22:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:22:01.306690 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 842/1677] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:22:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:22:01.311379 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e776530-6896-49f8-aae8-528675f5bb09 service nova] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:01.327783 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e776530-6896-49f8-aae8-528675f5bb09 service nova] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:01.352511 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2126b6a-50d3-4752-bcea-b91f36258dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:01.354872 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2126b6a-50d3-4752-bcea-b91f36258dd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:01.359549 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2126b6a-50d3-4752-bcea-b91f36258dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:01.359549 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2126b6a-50d3-4752-bcea-b91f36258dd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:01.360333 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2126b6a-50d3-4752-bcea-b91f36258dd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:01.363554 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2126b6a-50d3-4752-bcea-b91f36258dd5 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:01.416257 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd183a7-de8b-4dd5-bf81-a9f9bc25fa75 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:01.418447 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-7fd183a7-de8b-4dd5-bf81-a9f9bc25fa75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:01.463097 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd183a7-de8b-4dd5-bf81-a9f9bc25fa75 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:01.482774 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1997ac-67e0-4589-ad78-9b7a0f58a5a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066aaba3e9af4f85ab0cba89a3d32e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:01.484006 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1997ac-67e0-4589-ad78-9b7a0f58a5a1 service nova] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:01.484398 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1997ac-67e0-4589-ad78-9b7a0f58a5a1 service nova] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:01.484970 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1997ac-67e0-4589-ad78-9b7a0f58a5a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:01.521966 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 836/1678] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:22:01 2022] POST /identity/v3/projects => generated 405 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:22:01.521966 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2126b6a-50d3-4752-bcea-b91f36258dd5 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:01.525939 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1997ac-67e0-4589-ad78-9b7a0f58a5a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:01.529687 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1997ac-67e0-4589-ad78-9b7a0f58a5a1 service nova] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:01.558107 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 843/1679] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:22:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:22:01.714018 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:01.770606 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2126b6a-50d3-4752-bcea-b91f36258dd5 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:01.797021 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f4501-f5e2-455e-8a16-4481d1ec9df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:01.799782 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f4501-f5e2-455e-8a16-4481d1ec9df4 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:01.800076 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f4501-f5e2-455e-8a16-4481d1ec9df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:01.800412 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f4501-f5e2-455e-8a16-4481d1ec9df4 admin admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:01.801147 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f4501-f5e2-455e-8a16-4481d1ec9df4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:01.805345 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f4501-f5e2-455e-8a16-4481d1ec9df4 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:01.908236 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 837/1680] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:22:01 2022] POST /identity/v3/users => generated 303 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:22:01.913823 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1997ac-67e0-4589-ad78-9b7a0f58a5a1 service nova] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:01.925416 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e7f64-2576-45b8-8bb3-bb904bb4fe7f None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:01.925970 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e7f64-2576-45b8-8bb3-bb904bb4fe7f None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:01.928613 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e7f64-2576-45b8-8bb3-bb904bb4fe7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:01.949411 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1997ac-67e0-4589-ad78-9b7a0f58a5a1 service nova] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:01.990091 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a5d1ab-942d-42ec-9c01-7d19521aba93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:01.990786 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5d1ab-942d-42ec-9c01-7d19521aba93 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:02.001808 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5d1ab-942d-42ec-9c01-7d19521aba93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:02.005443 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5d1ab-942d-42ec-9c01-7d19521aba93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:02.006310 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a5d1ab-942d-42ec-9c01-7d19521aba93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:02.016247 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a5d1ab-942d-42ec-9c01-7d19521aba93 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:02.040538 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-cd6e7f64-2576-45b8-8bb3-bb904bb4fe7f None None] MFA Rules not processed for user `bdb5b24bd01c405c93e32ab4b329bcf1`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:02.054672 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-cd6e7f64-2576-45b8-8bb3-bb904bb4fe7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:02.067155 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 844/1681] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:22:02.068653 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a5d1ab-942d-42ec-9c01-7d19521aba93 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:02.115182 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a5d1ab-942d-42ec-9c01-7d19521aba93 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:02.138609 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fbec40-6574-4069-b5b1-ea2a9acfe2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:02.143137 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbec40-6574-4069-b5b1-ea2a9acfe2d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:02.143424 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbec40-6574-4069-b5b1-ea2a9acfe2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:02.143708 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbec40-6574-4069-b5b1-ea2a9acfe2d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:02.147838 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fbec40-6574-4069-b5b1-ea2a9acfe2d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:02.157419 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fbec40-6574-4069-b5b1-ea2a9acfe2d7 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:02.206074 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 845/1682] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:22:02.211703 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fbec40-6574-4069-b5b1-ea2a9acfe2d7 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:02.260559 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fbec40-6574-4069-b5b1-ea2a9acfe2d7 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:02.285151 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a4468-b015-4986-b97e-b80aa078e9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:02.286085 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a4468-b015-4986-b97e-b80aa078e9e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:02.292574 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a4468-b015-4986-b97e-b80aa078e9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:02.294693 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a4468-b015-4986-b97e-b80aa078e9e0 admin admin] PATH_INFO: `/v3/projects/39f154f97b1940c19044489879c35bf4/users/e0d7c0480b7e48b48fa7e11adb2d8339/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:02.400596 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975a4468-b015-4986-b97e-b80aa078e9e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39f154f97b1940c19044489879c35bf4, user_id=e0d7c0480b7e48b48fa7e11adb2d8339, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:02.439322 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975a4468-b015-4986-b97e-b80aa078e9e0 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:02.463506 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 838/1683] 10.222.0.20 () {58 vars in 1015 bytes} [Fri Jun 3 13:22:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 540 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:22:02.530631 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e7f64-2576-45b8-8bb3-bb904bb4fe7f None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:02.530631 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-cd6e7f64-2576-45b8-8bb3-bb904bb4fe7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:02.550455 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e7f64-2576-45b8-8bb3-bb904bb4fe7f None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:02.584926 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a06144d-d93b-463a-8d43-cba667233e07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:02.585613 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06144d-d93b-463a-8d43-cba667233e07 service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:02.585898 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06144d-d93b-463a-8d43-cba667233e07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:02.586194 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06144d-d93b-463a-8d43-cba667233e07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:02.637302 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a06144d-d93b-463a-8d43-cba667233e07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:02.638876 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a06144d-d93b-463a-8d43-cba667233e07 service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:02.640924 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 846/1684] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:22:02 2022] PUT /identity/v3/projects/39f154f97b1940c19044489879c35bf4/users/e0d7c0480b7e48b48fa7e11adb2d8339/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:22:02.656546 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fc673-dc72-47f4-8424-84239704f9ca None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:02.657168 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fc673-dc72-47f4-8424-84239704f9ca None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:02.657755 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fc673-dc72-47f4-8424-84239704f9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:02.704621 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 839/1685] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:22:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:22:02.730638 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-f42fc673-dc72-47f4-8424-84239704f9ca None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:02.736998 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-f42fc673-dc72-47f4-8424-84239704f9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:02.838377 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:03.057011 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 847/1686] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:22:03.100642 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a06144d-d93b-463a-8d43-cba667233e07 service neutron] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:03.111929 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a06144d-d93b-463a-8d43-cba667233e07 service neutron] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:03.282124 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bac88b-0b58-4acf-8629-1db9ce644323 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:03.287140 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bac88b-0b58-4acf-8629-1db9ce644323 service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:03.287669 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bac88b-0b58-4acf-8629-1db9ce644323 service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:03.288053 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bac88b-0b58-4acf-8629-1db9ce644323 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:03.322686 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bac88b-0b58-4acf-8629-1db9ce644323 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:03.324615 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bac88b-0b58-4acf-8629-1db9ce644323 service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:03.344857 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 840/1687] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:22:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:22:04.427597 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42fc673-dc72-47f4-8424-84239704f9ca None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:04.444451 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-f42fc673-dc72-47f4-8424-84239704f9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:04.523179 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42fc673-dc72-47f4-8424-84239704f9ca None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:04.550849 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3d1ac-c03e-4322-bd16-281d62296ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:04.555234 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3d1ac-c03e-4322-bd16-281d62296ca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:04.555916 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3d1ac-c03e-4322-bd16-281d62296ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:04.557212 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3d1ac-c03e-4322-bd16-281d62296ca2 admin admin] PATH_INFO: `/v3/users/c0bdcca509694d1ab1a38a2a9796df6d` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:04.564819 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a3d1ac-c03e-4322-bd16-281d62296ca2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0bdcca509694d1ab1a38a2a9796df6d)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:04.572279 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a3d1ac-c03e-4322-bd16-281d62296ca2 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:04.729435 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafcf46-5d0f-4671-92b2-a90b0da362f0 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:04.729944 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafcf46-5d0f-4671-92b2-a90b0da362f0 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:04.730191 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafcf46-5d0f-4671-92b2-a90b0da362f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:04.785937 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-dfafcf46-5d0f-4671-92b2-a90b0da362f0 None None] MFA Rules not processed for user `308bdbe63af5415d8e817bd9ba2fad3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:04.788963 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-dfafcf46-5d0f-4671-92b2-a90b0da362f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:04.920711 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-16a3d1ac-c03e-4322-bd16-281d62296ca2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0bdcca509694d1ab1a38a2a9796df6d'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:04.992423 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-16a3d1ac-c03e-4322-bd16-281d62296ca2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0bdcca509694d1ab1a38a2a9796df6d'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:04.993717 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-16a3d1ac-c03e-4322-bd16-281d62296ca2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0bdcca509694d1ab1a38a2a9796df6d'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:05.025974 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-16a3d1ac-c03e-4322-bd16-281d62296ca2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0bdcca509694d1ab1a38a2a9796df6d'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:05.030652 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-16a3d1ac-c03e-4322-bd16-281d62296ca2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0bdcca509694d1ab1a38a2a9796df6d'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:05.032450 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 841/1688] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:22:05.171193 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 848/1689] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:22:04 2022] DELETE /identity/v3/users/c0bdcca509694d1ab1a38a2a9796df6d => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:22:05.176848 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d5635-8b93-4383-9ae6-ae871d75342f None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:05.177463 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d5635-8b93-4383-9ae6-ae871d75342f None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:05.177909 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d5635-8b93-4383-9ae6-ae871d75342f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:05.209208 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-a39d5635-8b93-4383-9ae6-ae871d75342f None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:05.213549 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-a39d5635-8b93-4383-9ae6-ae871d75342f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:05.236869 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:05.404037 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 842/1690] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:22:05.524204 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3d1ac-c03e-4322-bd16-281d62296ca2 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:05.526554 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-16a3d1ac-c03e-4322-bd16-281d62296ca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:05.755378 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3d1ac-c03e-4322-bd16-281d62296ca2 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:05.760536 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c54d9-323a-4009-9b0a-8989ee0d8553 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:05.761533 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c54d9-323a-4009-9b0a-8989ee0d8553 service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:05.762051 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c54d9-323a-4009-9b0a-8989ee0d8553 service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:05.762591 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c54d9-323a-4009-9b0a-8989ee0d8553 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:05.788559 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c54d9-323a-4009-9b0a-8989ee0d8553 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:05.790642 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c54d9-323a-4009-9b0a-8989ee0d8553 service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:05.814686 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 849/1691] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:22:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:22:08.044047 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9595f5-b514-49d1-a457-e56d76cc2cd1 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:08.044582 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9595f5-b514-49d1-a457-e56d76cc2cd1 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:08.044658 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9595f5-b514-49d1-a457-e56d76cc2cd1 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:08.047836 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 843/1692] 10.222.0.61 () {54 vars in 912 bytes} [Fri Jun 3 13:22:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:22:08.058037 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf7e54-1290-4d1b-a6d8-0c42d5ce7bfb None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:08.058588 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf7e54-1290-4d1b-a6d8-0c42d5ce7bfb None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:08.058588 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf7e54-1290-4d1b-a6d8-0c42d5ce7bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:08.106641 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-a8cf7e54-1290-4d1b-a6d8-0c42d5ce7bfb None None] MFA Rules not processed for user `bdb5b24bd01c405c93e32ab4b329bcf1`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:08.109454 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-a8cf7e54-1290-4d1b-a6d8-0c42d5ce7bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:08.138603 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 850/1693] 10.222.0.61 () {58 vars in 1009 bytes} [Fri Jun 3 13:22:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:22:08.239504 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9595f5-b514-49d1-a457-e56d76cc2cd1 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:08.257565 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9595f5-b514-49d1-a457-e56d76cc2cd1 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:08.266205 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1310eef-4cb7-443f-be0f-5d3765cbeb57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:08.267495 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1310eef-4cb7-443f-be0f-5d3765cbeb57 service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:08.267785 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1310eef-4cb7-443f-be0f-5d3765cbeb57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:08.268332 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1310eef-4cb7-443f-be0f-5d3765cbeb57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:08.288512 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1310eef-4cb7-443f-be0f-5d3765cbeb57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:08.290248 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1310eef-4cb7-443f-be0f-5d3765cbeb57 service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:08.317768 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 844/1694] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:22:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:22:08.353817 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514be628-a584-4a43-91d7-20de8f225d2c None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:08.354477 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514be628-a584-4a43-91d7-20de8f225d2c None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:08.356529 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514be628-a584-4a43-91d7-20de8f225d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:08.408249 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-514be628-a584-4a43-91d7-20de8f225d2c None None] MFA Rules not processed for user `7254adba100f4453b2b9a953990dbb41`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:08.413049 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-514be628-a584-4a43-91d7-20de8f225d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:08.521780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:08.624801 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 851/1695] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:22:09.819615 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1310eef-4cb7-443f-be0f-5d3765cbeb57 service neutron] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:09.821150 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-b1310eef-4cb7-443f-be0f-5d3765cbeb57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:09.862826 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1310eef-4cb7-443f-be0f-5d3765cbeb57 service neutron] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:09.878861 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8f0e2-74a8-4d43-91dd-60fcb0a13e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:09.880012 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8f0e2-74a8-4d43-91dd-60fcb0a13e2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:09.880623 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8f0e2-74a8-4d43-91dd-60fcb0a13e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:09.881055 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8f0e2-74a8-4d43-91dd-60fcb0a13e2c admin admin] PATH_INFO: `/v3/projects/5502e6bd5a2c4ab7b9b60df486fcd2d0` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:09.883134 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe8f0e2-74a8-4d43-91dd-60fcb0a13e2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5502e6bd5a2c4ab7b9b60df486fcd2d0)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:09.887732 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe8f0e2-74a8-4d43-91dd-60fcb0a13e2c admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:10.139266 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-8fe8f0e2-74a8-4d43-91dd-60fcb0a13e2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5502e6bd5a2c4ab7b9b60df486fcd2d0', 'request_id': 'req-8fe8f0e2-74a8-4d43-91dd-60fcb0a13e2c'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:10.186850 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-8fe8f0e2-74a8-4d43-91dd-60fcb0a13e2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5502e6bd5a2c4ab7b9b60df486fcd2d0', 'request_id': 'req-8fe8f0e2-74a8-4d43-91dd-60fcb0a13e2c'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:10.236560 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-8fe8f0e2-74a8-4d43-91dd-60fcb0a13e2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5502e6bd5a2c4ab7b9b60df486fcd2d0', 'request_id': 'req-8fe8f0e2-74a8-4d43-91dd-60fcb0a13e2c'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:10.339974 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-8fe8f0e2-74a8-4d43-91dd-60fcb0a13e2c admin admin] The token cache is being invalidate because project 5502e6bd5a2c4ab7b9b60df486fcd2d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:22:10.339974 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-8fe8f0e2-74a8-4d43-91dd-60fcb0a13e2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:10.341291 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-8fe8f0e2-74a8-4d43-91dd-60fcb0a13e2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:10.347510 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 845/1696] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:22:09 2022] DELETE /identity/v3/projects/5502e6bd5a2c4ab7b9b60df486fcd2d0 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:22:10.354476 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebb2e6-3d6e-4843-8040-50dcfd50fc54 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:10.355370 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebb2e6-3d6e-4843-8040-50dcfd50fc54 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:10.355805 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebb2e6-3d6e-4843-8040-50dcfd50fc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:10.426282 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-ecebb2e6-3d6e-4843-8040-50dcfd50fc54 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:10.437078 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-ecebb2e6-3d6e-4843-8040-50dcfd50fc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:10.667966 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d78a2-2f82-444e-9d85-6964194b68c2 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:10.668296 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d78a2-2f82-444e-9d85-6964194b68c2 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:10.668575 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d78a2-2f82-444e-9d85-6964194b68c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:10.684017 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 852/1697] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:22:10.738254 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-e48d78a2-2f82-444e-9d85-6964194b68c2 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:10.750339 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-e48d78a2-2f82-444e-9d85-6964194b68c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:10.800760 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecebb2e6-3d6e-4843-8040-50dcfd50fc54 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:10.818328 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecebb2e6-3d6e-4843-8040-50dcfd50fc54 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:10.820096 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 846/1698] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:22:10.838236 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aacef5d-6fb7-475d-9bfd-1ad69d95120f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:10.840755 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aacef5d-6fb7-475d-9bfd-1ad69d95120f admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:10.840755 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aacef5d-6fb7-475d-9bfd-1ad69d95120f admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:10.840755 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aacef5d-6fb7-475d-9bfd-1ad69d95120f admin admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:10.840755 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aacef5d-6fb7-475d-9bfd-1ad69d95120f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:22:10.840755 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aacef5d-6fb7-475d-9bfd-1ad69d95120f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:10.848234 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aacef5d-6fb7-475d-9bfd-1ad69d95120f admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:10.901973 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d78a2-2f82-444e-9d85-6964194b68c2 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:10.912700 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 853/1699] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:22:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:22:10.916546 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d78a2-2f82-444e-9d85-6964194b68c2 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:10.937685 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260b61b-966b-41bc-a8ef-7af36c630fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:10.938801 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260b61b-966b-41bc-a8ef-7af36c630fb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:10.939223 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260b61b-966b-41bc-a8ef-7af36c630fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:10.939633 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260b61b-966b-41bc-a8ef-7af36c630fb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:10.940497 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2260b61b-966b-41bc-a8ef-7af36c630fb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:10.948382 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2260b61b-966b-41bc-a8ef-7af36c630fb3 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:11.096978 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aacef5d-6fb7-475d-9bfd-1ad69d95120f admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:11.098053 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 847/1700] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:22:10 2022] POST /identity/v3/projects => generated 371 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:22:11.107855 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aacef5d-6fb7-475d-9bfd-1ad69d95120f admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:11.249188 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21c6aa-8876-482d-9d72-76f6a1f3cd5e None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:11.249886 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21c6aa-8876-482d-9d72-76f6a1f3cd5e None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:11.250741 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21c6aa-8876-482d-9d72-76f6a1f3cd5e None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:11.253236 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 848/1701] 10.222.0.61 () {54 vars in 921 bytes} [Fri Jun 3 13:22:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:22:11.304746 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541214f1-cc49-4142-b468-0154f6e28f83 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:11.305060 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541214f1-cc49-4142-b468-0154f6e28f83 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:11.305506 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541214f1-cc49-4142-b468-0154f6e28f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:11.365337 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-541214f1-cc49-4142-b468-0154f6e28f83 None None] MFA Rules not processed for user `267a2b59a70245dfb7ec1b779f7fdd51`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:11.382471 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-541214f1-cc49-4142-b468-0154f6e28f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:11.446965 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf00e35-708d-46e4-b065-9c1f3469ce5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:11.447707 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf00e35-708d-46e4-b065-9c1f3469ce5f admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:11.447989 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf00e35-708d-46e4-b065-9c1f3469ce5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:11.448346 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf00e35-708d-46e4-b065-9c1f3469ce5f admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:11.449052 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf00e35-708d-46e4-b065-9c1f3469ce5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:11.462436 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf00e35-708d-46e4-b065-9c1f3469ce5f admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:11.626249 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 854/1702] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:22:11 2022] POST /identity/v3/users => generated 286 bytes in 530 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:22:11.630887 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10edcc2-621e-40fc-a182-8074034dcd79 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:11.635865 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10edcc2-621e-40fc-a182-8074034dcd79 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:11.636994 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10edcc2-621e-40fc-a182-8074034dcd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:11.691972 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 849/1703] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:22:11.693817 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8c216-d390-4fa4-b186-1d265326d470 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:11.694278 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8c216-d390-4fa4-b186-1d265326d470 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:11.694715 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8c216-d390-4fa4-b186-1d265326d470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:11.710918 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:11.716484 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-d10edcc2-621e-40fc-a182-8074034dcd79 None None] MFA Rules not processed for user `965645bc86f44cf38c5f571406722e32`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:11.734457 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-d10edcc2-621e-40fc-a182-8074034dcd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:11.750291 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-aab8c216-d390-4fa4-b186-1d265326d470 None None] MFA Rules not processed for user `066aaba3e9af4f85ab0cba89a3d32e34`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:11.752798 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-aab8c216-d390-4fa4-b186-1d265326d470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:11.897424 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:11.946545 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 855/1704] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:22:11.949999 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10edcc2-621e-40fc-a182-8074034dcd79 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:11.993961 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10edcc2-621e-40fc-a182-8074034dcd79 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:12.016595 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958dcc1-e1eb-4204-8dc6-09b2ae36b413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:12.019627 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958dcc1-e1eb-4204-8dc6-09b2ae36b413 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:12.021271 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958dcc1-e1eb-4204-8dc6-09b2ae36b413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:12.021605 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958dcc1-e1eb-4204-8dc6-09b2ae36b413 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:12.027181 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c958dcc1-e1eb-4204-8dc6-09b2ae36b413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:12.034241 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c958dcc1-e1eb-4204-8dc6-09b2ae36b413 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:12.036845 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 850/1705] 10.222.0.61 () {58 vars in 1018 bytes} [Fri Jun 3 13:22:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:22:12.052931 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 856/1706] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:22:12.056723 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8c216-d390-4fa4-b186-1d265326d470 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:12.071775 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8c216-d390-4fa4-b186-1d265326d470 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:12.078821 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3853ce7e-d10c-41f6-8b9f-fed697e17c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:12.079656 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853ce7e-d10c-41f6-8b9f-fed697e17c6e admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:12.079998 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853ce7e-d10c-41f6-8b9f-fed697e17c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:12.084700 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853ce7e-d10c-41f6-8b9f-fed697e17c6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:12.084700 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3853ce7e-d10c-41f6-8b9f-fed697e17c6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:12.084700 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3853ce7e-d10c-41f6-8b9f-fed697e17c6e admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:12.112323 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 851/1707] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:22:12.120299 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958dcc1-e1eb-4204-8dc6-09b2ae36b413 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:12.133419 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958dcc1-e1eb-4204-8dc6-09b2ae36b413 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:12.147183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f977de-ee95-4847-b2ef-3f9b43340dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:12.150477 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f977de-ee95-4847-b2ef-3f9b43340dc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:12.150958 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f977de-ee95-4847-b2ef-3f9b43340dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:12.151654 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f977de-ee95-4847-b2ef-3f9b43340dc1 admin admin] PATH_INFO: `/v3/projects/a693ab1f45944c068b0a6cbf5732bcc1/users/1169fc2ba54f4d2d85121bc1a50f645e/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:12.213867 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f977de-ee95-4847-b2ef-3f9b43340dc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a693ab1f45944c068b0a6cbf5732bcc1, user_id=1169fc2ba54f4d2d85121bc1a50f645e, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:12.217580 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f977de-ee95-4847-b2ef-3f9b43340dc1 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:12.512853 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 857/1708] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:22:12 2022] PUT /identity/v3/projects/a693ab1f45944c068b0a6cbf5732bcc1/users/1169fc2ba54f4d2d85121bc1a50f645e/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:22:12.524186 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02a338-f4c3-4eec-8e78-7e2376fb7f52 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:12.524575 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02a338-f4c3-4eec-8e78-7e2376fb7f52 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:12.524926 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02a338-f4c3-4eec-8e78-7e2376fb7f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:12.571146 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-4d02a338-f4c3-4eec-8e78-7e2376fb7f52 None None] MFA Rules not processed for user `1169fc2ba54f4d2d85121bc1a50f645e`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:12.571146 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-4d02a338-f4c3-4eec-8e78-7e2376fb7f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:12.651969 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 852/1709] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:22:12.657136 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f977de-ee95-4847-b2ef-3f9b43340dc1 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:12.811063 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f977de-ee95-4847-b2ef-3f9b43340dc1 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:12.817496 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908b67a-1740-4195-b462-f3c8803b4da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:12.818212 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908b67a-1740-4195-b462-f3c8803b4da6 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:12.818543 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908b67a-1740-4195-b462-f3c8803b4da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:12.818895 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908b67a-1740-4195-b462-f3c8803b4da6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:12.819695 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d908b67a-1740-4195-b462-f3c8803b4da6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:12.827678 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d908b67a-1740-4195-b462-f3c8803b4da6 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:13.058841 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392bbfc6-5e9e-4523-8b0c-fe38cea3ebd6 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:13.059418 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392bbfc6-5e9e-4523-8b0c-fe38cea3ebd6 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:13.059418 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392bbfc6-5e9e-4523-8b0c-fe38cea3ebd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:13.179642 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-392bbfc6-5e9e-4523-8b0c-fe38cea3ebd6 None None] MFA Rules not processed for user `e0d7c0480b7e48b48fa7e11adb2d8339`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:13.180949 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-392bbfc6-5e9e-4523-8b0c-fe38cea3ebd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:13.387778 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 853/1710] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:13 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:22:13.391661 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392bbfc6-5e9e-4523-8b0c-fe38cea3ebd6 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:13.403828 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-392bbfc6-5e9e-4523-8b0c-fe38cea3ebd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:13.423499 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:13.433823 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392bbfc6-5e9e-4523-8b0c-fe38cea3ebd6 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:13.450304 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ce287-8701-4fb7-938b-d73419a799f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:13.450988 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ce287-8701-4fb7-938b-d73419a799f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:13.451319 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ce287-8701-4fb7-938b-d73419a799f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:13.451607 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ce287-8701-4fb7-938b-d73419a799f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:13.453147 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455ce287-8701-4fb7-938b-d73419a799f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:13.455970 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455ce287-8701-4fb7-938b-d73419a799f1 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:14.007714 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 858/1711] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:22:12 2022] POST /identity/v3/projects => generated 373 bytes in 1351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:22:14.012499 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908b67a-1740-4195-b462-f3c8803b4da6 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:14.073929 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908b67a-1740-4195-b462-f3c8803b4da6 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:14.079080 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a9dfa-1e7b-4d94-ab1f-181b17162dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:14.079747 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a9dfa-1e7b-4d94-ab1f-181b17162dcd admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:14.080028 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a9dfa-1e7b-4d94-ab1f-181b17162dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:14.080333 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a9dfa-1e7b-4d94-ab1f-181b17162dcd admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:14.081103 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a9dfa-1e7b-4d94-ab1f-181b17162dcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:14.082989 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a9dfa-1e7b-4d94-ab1f-181b17162dcd admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:14.194878 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 854/1712] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:22:13 2022] POST /identity/v3/projects => generated 405 bytes in 804 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:22:14.204059 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ce287-8701-4fb7-938b-d73419a799f1 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:14.299738 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ce287-8701-4fb7-938b-d73419a799f1 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:14.304911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361a13a-c010-44c2-ba47-32c56226830a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:14.305635 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361a13a-c010-44c2-ba47-32c56226830a admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:14.305925 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361a13a-c010-44c2-ba47-32c56226830a admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:14.306190 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361a13a-c010-44c2-ba47-32c56226830a admin admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:14.306876 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361a13a-c010-44c2-ba47-32c56226830a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:14.309254 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361a13a-c010-44c2-ba47-32c56226830a admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:14.313491 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 859/1713] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:22:14 2022] POST /identity/v3/users => generated 293 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:22:14.317556 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a9dfa-1e7b-4d94-ab1f-181b17162dcd admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:14.330104 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a9dfa-1e7b-4d94-ab1f-181b17162dcd admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:14.336246 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e29c06d-afef-4eb0-8a5c-fe6f875c2c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:14.336959 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29c06d-afef-4eb0-8a5c-fe6f875c2c31 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:14.337242 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29c06d-afef-4eb0-8a5c-fe6f875c2c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:14.337523 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29c06d-afef-4eb0-8a5c-fe6f875c2c31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:14.339073 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e29c06d-afef-4eb0-8a5c-fe6f875c2c31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:14.341164 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e29c06d-afef-4eb0-8a5c-fe6f875c2c31 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:14.389702 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 860/1714] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:22:14.390645 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e29c06d-afef-4eb0-8a5c-fe6f875c2c31 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:14.395996 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-6e29c06d-afef-4eb0-8a5c-fe6f875c2c31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:14.471450 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 855/1715] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:22:14 2022] POST /identity/v3/users => generated 309 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:22:14.471969 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361a13a-c010-44c2-ba47-32c56226830a admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:14.483768 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:14.502787 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361a13a-c010-44c2-ba47-32c56226830a admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:14.513906 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78647cbf-5dd4-411e-bc30-0c75cdb03847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:14.519151 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78647cbf-5dd4-411e-bc30-0c75cdb03847 admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:14.519151 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78647cbf-5dd4-411e-bc30-0c75cdb03847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:14.519151 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78647cbf-5dd4-411e-bc30-0c75cdb03847 admin admin] PATH_INFO: `/v3/projects/1f157b38bce046569daa676cced68966/users/536dec9b82144ab7be773998ec484fa8/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:14.536788 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e29c06d-afef-4eb0-8a5c-fe6f875c2c31 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:14.544086 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec89dec-5069-40c7-bd09-001c5b1c87b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066aaba3e9af4f85ab0cba89a3d32e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:14.547624 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec89dec-5069-40c7-bd09-001c5b1c87b4 service nova] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:14.547624 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec89dec-5069-40c7-bd09-001c5b1c87b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:14.547624 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec89dec-5069-40c7-bd09-001c5b1c87b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:14.547956 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78647cbf-5dd4-411e-bc30-0c75cdb03847 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f157b38bce046569daa676cced68966, user_id=536dec9b82144ab7be773998ec484fa8, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:14.550270 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78647cbf-5dd4-411e-bc30-0c75cdb03847 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:14.558113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec89dec-5069-40c7-bd09-001c5b1c87b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:14.560104 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec89dec-5069-40c7-bd09-001c5b1c87b4 service nova] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:14.573783 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 861/1716] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:22:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:22:14.578697 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec89dec-5069-40c7-bd09-001c5b1c87b4 service nova] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:14.587660 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec89dec-5069-40c7-bd09-001c5b1c87b4 service nova] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:14.593009 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e48f83-a90e-404b-8b3f-19177c3a5744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:14.593791 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e48f83-a90e-404b-8b3f-19177c3a5744 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:14.594171 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e48f83-a90e-404b-8b3f-19177c3a5744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:14.594587 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e48f83-a90e-404b-8b3f-19177c3a5744 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:14.602149 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e48f83-a90e-404b-8b3f-19177c3a5744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:14.608921 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e48f83-a90e-404b-8b3f-19177c3a5744 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:14.623643 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 862/1717] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:22:14.649579 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 856/1718] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:22:14 2022] PUT /identity/v3/projects/1f157b38bce046569daa676cced68966/users/536dec9b82144ab7be773998ec484fa8/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:22:14.650748 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e48f83-a90e-404b-8b3f-19177c3a5744 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:14.652190 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78647cbf-5dd4-411e-bc30-0c75cdb03847 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:14.682399 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e48f83-a90e-404b-8b3f-19177c3a5744 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:14.816913 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd424bc5-778e-4435-8e91-562d7ecf2a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:14.819286 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd424bc5-778e-4435-8e91-562d7ecf2a2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:14.823722 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd424bc5-778e-4435-8e91-562d7ecf2a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:14.823722 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd424bc5-778e-4435-8e91-562d7ecf2a2b admin admin] PATH_INFO: `/v3/projects/11550a07fd164b06b0f528f1a854e65e/users/7799553d33e64330a7c83dc62e67e124/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:14.860242 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78647cbf-5dd4-411e-bc30-0c75cdb03847 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:14.860580 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd424bc5-778e-4435-8e91-562d7ecf2a2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=11550a07fd164b06b0f528f1a854e65e, user_id=7799553d33e64330a7c83dc62e67e124, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:14.862679 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd424bc5-778e-4435-8e91-562d7ecf2a2b admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:14.863128 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc318795-fab8-48a4-948b-1458adcc7c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:14.865538 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc318795-fab8-48a4-948b-1458adcc7c1a admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:14.865826 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc318795-fab8-48a4-948b-1458adcc7c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:14.867664 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc318795-fab8-48a4-948b-1458adcc7c1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:14.868454 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc318795-fab8-48a4-948b-1458adcc7c1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:14.872472 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc318795-fab8-48a4-948b-1458adcc7c1a admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:14.911309 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 857/1719] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:22:14.912249 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc318795-fab8-48a4-948b-1458adcc7c1a admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:14.943014 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc318795-fab8-48a4-948b-1458adcc7c1a admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:14.948255 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1824b-a1c6-4025-8094-efc41a0cb402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:14.949408 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1824b-a1c6-4025-8094-efc41a0cb402 admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:14.949832 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1824b-a1c6-4025-8094-efc41a0cb402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:14.950255 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1824b-a1c6-4025-8094-efc41a0cb402 admin admin] PATH_INFO: `/v3/projects/1f157b38bce046569daa676cced68966/users/536dec9b82144ab7be773998ec484fa8/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:14.981381 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 863/1720] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:22:14 2022] PUT /identity/v3/projects/11550a07fd164b06b0f528f1a854e65e/users/7799553d33e64330a7c83dc62e67e124/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:22:14.982578 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd424bc5-778e-4435-8e91-562d7ecf2a2b admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:14.983751 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc1824b-a1c6-4025-8094-efc41a0cb402 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f157b38bce046569daa676cced68966, user_id=536dec9b82144ab7be773998ec484fa8, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:14.996859 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc1824b-a1c6-4025-8094-efc41a0cb402 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:15.042978 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 858/1721] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:22:14 2022] PUT /identity/v3/projects/1f157b38bce046569daa676cced68966/users/536dec9b82144ab7be773998ec484fa8/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:22:15.058498 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a91ba5-a277-46e9-913d-be1cc966639f None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:15.058797 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a91ba5-a277-46e9-913d-be1cc966639f None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:15.059081 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a91ba5-a277-46e9-913d-be1cc966639f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:15.112069 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-48a91ba5-a277-46e9-913d-be1cc966639f None None] MFA Rules not processed for user `536dec9b82144ab7be773998ec484fa8`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:15.113690 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-48a91ba5-a277-46e9-913d-be1cc966639f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:15.137311 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:15.146008 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd424bc5-778e-4435-8e91-562d7ecf2a2b admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:15.267784 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 859/1722] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:15 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:22:15.274353 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c42fa4-b985-4d1b-bd6d-590ab56e0779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:15.275126 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c42fa4-b985-4d1b-bd6d-590ab56e0779 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:15.275425 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c42fa4-b985-4d1b-bd6d-590ab56e0779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:15.275798 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c42fa4-b985-4d1b-bd6d-590ab56e0779 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:15.276692 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c42fa4-b985-4d1b-bd6d-590ab56e0779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:15.278423 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c42fa4-b985-4d1b-bd6d-590ab56e0779 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:15.280076 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a91ba5-a277-46e9-913d-be1cc966639f None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:15.282317 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-48a91ba5-a277-46e9-913d-be1cc966639f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:15.293233 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 864/1723] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:22:15.297828 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c42fa4-b985-4d1b-bd6d-590ab56e0779 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:15.313571 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c42fa4-b985-4d1b-bd6d-590ab56e0779 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:15.319045 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c7a8e-300a-4b27-91ad-65723116fab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:15.323719 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c7a8e-300a-4b27-91ad-65723116fab3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:15.323719 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c7a8e-300a-4b27-91ad-65723116fab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:15.323719 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c7a8e-300a-4b27-91ad-65723116fab3 admin admin] PATH_INFO: `/v3/projects/11550a07fd164b06b0f528f1a854e65e/users/7799553d33e64330a7c83dc62e67e124/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:15.323979 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929c7a8e-300a-4b27-91ad-65723116fab3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11550a07fd164b06b0f528f1a854e65e, user_id=7799553d33e64330a7c83dc62e67e124, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:15.327559 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929c7a8e-300a-4b27-91ad-65723116fab3 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:15.357722 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 865/1724] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:22:15 2022] PUT /identity/v3/projects/11550a07fd164b06b0f528f1a854e65e/users/7799553d33e64330a7c83dc62e67e124/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:22:15.386950 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a91ba5-a277-46e9-913d-be1cc966639f None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:15.504525 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f1ea00-fc91-4682-a5c9-8fc65e72656b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:15.506952 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1ea00-fc91-4682-a5c9-8fc65e72656b service cinder] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:15.506952 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1ea00-fc91-4682-a5c9-8fc65e72656b service cinder] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:15.506952 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1ea00-fc91-4682-a5c9-8fc65e72656b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:15.607533 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f1ea00-fc91-4682-a5c9-8fc65e72656b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:15.609983 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f1ea00-fc91-4682-a5c9-8fc65e72656b service cinder] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:15.651786 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 860/1725] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:22:15 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:22:16.315563 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:17.012421 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c7a8e-300a-4b27-91ad-65723116fab3 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:17.064021 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35c5c1-98db-4383-97fe-c6ec5b242cd4 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:17.064502 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35c5c1-98db-4383-97fe-c6ec5b242cd4 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:17.064727 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35c5c1-98db-4383-97fe-c6ec5b242cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:17.106505 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-cc35c5c1-98db-4383-97fe-c6ec5b242cd4 None None] MFA Rules not processed for user `7799553d33e64330a7c83dc62e67e124`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:17.107448 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-cc35c5c1-98db-4383-97fe-c6ec5b242cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:17.124824 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:17.148447 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c7a8e-300a-4b27-91ad-65723116fab3 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:17.155573 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e3f49-8ad9-4e97-ad90-85996dca1dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:17.157228 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e3f49-8ad9-4e97-ad90-85996dca1dc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:17.157663 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e3f49-8ad9-4e97-ad90-85996dca1dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:17.158115 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e3f49-8ad9-4e97-ad90-85996dca1dc8 admin admin] PATH_INFO: `/v3/users/1169fc2ba54f4d2d85121bc1a50f645e` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:17.159883 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e3f49-8ad9-4e97-ad90-85996dca1dc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1169fc2ba54f4d2d85121bc1a50f645e)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:17.162236 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e3f49-8ad9-4e97-ad90-85996dca1dc8 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:17.232485 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 861/1726] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:17 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:22:17.413900 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-b69e3f49-8ad9-4e97-ad90-85996dca1dc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1169fc2ba54f4d2d85121bc1a50f645e'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:17.435251 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-b69e3f49-8ad9-4e97-ad90-85996dca1dc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1169fc2ba54f4d2d85121bc1a50f645e'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:17.437335 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-b69e3f49-8ad9-4e97-ad90-85996dca1dc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1169fc2ba54f4d2d85121bc1a50f645e'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:17.445652 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-b69e3f49-8ad9-4e97-ad90-85996dca1dc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1169fc2ba54f4d2d85121bc1a50f645e'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:17.448681 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-b69e3f49-8ad9-4e97-ad90-85996dca1dc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1169fc2ba54f4d2d85121bc1a50f645e'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:17.532813 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 866/1727] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:22:17 2022] DELETE /identity/v3/users/1169fc2ba54f4d2d85121bc1a50f645e => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:22:17.537479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cc39a-cc3f-4553-8102-cbc979fb7aad None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:17.537869 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cc39a-cc3f-4553-8102-cbc979fb7aad None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:17.538235 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cc39a-cc3f-4553-8102-cbc979fb7aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:17.556120 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-a10cc39a-cc3f-4553-8102-cbc979fb7aad None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:17.571832 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-a10cc39a-cc3f-4553-8102-cbc979fb7aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:17.616177 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 862/1728] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:22:17.632584 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e3f49-8ad9-4e97-ad90-85996dca1dc8 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:17.634256 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-b69e3f49-8ad9-4e97-ad90-85996dca1dc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:17.693833 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e3f49-8ad9-4e97-ad90-85996dca1dc8 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:17.697509 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88228c3f-2f59-43a4-8026-fc96d16f66a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:17.698310 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88228c3f-2f59-43a4-8026-fc96d16f66a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:17.698528 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88228c3f-2f59-43a4-8026-fc96d16f66a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:17.698829 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88228c3f-2f59-43a4-8026-fc96d16f66a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:17.710008 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88228c3f-2f59-43a4-8026-fc96d16f66a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:17.711675 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88228c3f-2f59-43a4-8026-fc96d16f66a1 service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:17.719298 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:17.724617 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 867/1729] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:22:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:22:18.076411 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eca8a4-a22c-4ed7-87ac-e1aa606eb2be None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:18.077060 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eca8a4-a22c-4ed7-87ac-e1aa606eb2be None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:18.077060 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eca8a4-a22c-4ed7-87ac-e1aa606eb2be None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:18.079635 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 863/1730] 10.222.0.61 () {54 vars in 921 bytes} [Fri Jun 3 13:22:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:22:18.116806 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332d5eb-2d68-47d9-be8e-681e6d331d0c None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:18.117113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332d5eb-2d68-47d9-be8e-681e6d331d0c None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:18.117689 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332d5eb-2d68-47d9-be8e-681e6d331d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:18.142011 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-1332d5eb-2d68-47d9-be8e-681e6d331d0c None None] MFA Rules not processed for user `a5c4ad16c9454b74ae8445b115cf0af4`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:18.149602 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-1332d5eb-2d68-47d9-be8e-681e6d331d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:18.255729 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eca8a4-a22c-4ed7-87ac-e1aa606eb2be None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:18.261809 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-d8eca8a4-a22c-4ed7-87ac-e1aa606eb2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:18.262054 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 868/1731] 10.222.0.61 () {58 vars in 1018 bytes} [Fri Jun 3 13:22:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:22:18.274686 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332d5eb-2d68-47d9-be8e-681e6d331d0c None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:18.276931 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-1332d5eb-2d68-47d9-be8e-681e6d331d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:18.303260 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eca8a4-a22c-4ed7-87ac-e1aa606eb2be None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:18.304800 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332d5eb-2d68-47d9-be8e-681e6d331d0c None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:18.327272 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d7161-fd68-40b6-8f6a-46225df1dabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:18.328167 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d7161-fd68-40b6-8f6a-46225df1dabb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:18.331125 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d7161-fd68-40b6-8f6a-46225df1dabb admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:18.331539 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d7161-fd68-40b6-8f6a-46225df1dabb admin admin] PATH_INFO: `/v3/projects/a693ab1f45944c068b0a6cbf5732bcc1` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:18.339143 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d7161-fd68-40b6-8f6a-46225df1dabb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a693ab1f45944c068b0a6cbf5732bcc1)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:18.341644 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d7161-fd68-40b6-8f6a-46225df1dabb admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:18.347219 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b2d25f-dca6-47fd-bac1-842d836a0d54 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5c4ad16c9454b74ae8445b115cf0af4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:18.347914 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b2d25f-dca6-47fd-bac1-842d836a0d54 service placement] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:18.351187 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b2d25f-dca6-47fd-bac1-842d836a0d54 service placement] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:18.351665 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b2d25f-dca6-47fd-bac1-842d836a0d54 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:18.392516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b2d25f-dca6-47fd-bac1-842d836a0d54 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:18.394205 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b2d25f-dca6-47fd-bac1-842d836a0d54 service placement] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:18.408305 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 869/1732] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:22:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 13:22:18.541839 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-b31d7161-fd68-40b6-8f6a-46225df1dabb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a693ab1f45944c068b0a6cbf5732bcc1', 'request_id': 'req-b31d7161-fd68-40b6-8f6a-46225df1dabb'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:18.549442 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-b31d7161-fd68-40b6-8f6a-46225df1dabb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a693ab1f45944c068b0a6cbf5732bcc1', 'request_id': 'req-b31d7161-fd68-40b6-8f6a-46225df1dabb'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:18.556683 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-b31d7161-fd68-40b6-8f6a-46225df1dabb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a693ab1f45944c068b0a6cbf5732bcc1', 'request_id': 'req-b31d7161-fd68-40b6-8f6a-46225df1dabb'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:18.658395 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-b31d7161-fd68-40b6-8f6a-46225df1dabb admin admin] The token cache is being invalidate because project a693ab1f45944c068b0a6cbf5732bcc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:22:18.664513 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-b31d7161-fd68-40b6-8f6a-46225df1dabb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:18.665374 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-b31d7161-fd68-40b6-8f6a-46225df1dabb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:18.667385 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 864/1733] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:22:18 2022] DELETE /identity/v3/projects/a693ab1f45944c068b0a6cbf5732bcc1 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:22:18.672345 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b2d25f-dca6-47fd-bac1-842d836a0d54 service placement] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:18.690023 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b2d25f-dca6-47fd-bac1-842d836a0d54 service placement] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:18.827509 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337400fd-b587-45c4-996c-d43ae1b54733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:18.832651 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337400fd-b587-45c4-996c-d43ae1b54733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:18.832941 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337400fd-b587-45c4-996c-d43ae1b54733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:18.833390 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337400fd-b587-45c4-996c-d43ae1b54733 admin admin] PATH_INFO: `/v3/users/536dec9b82144ab7be773998ec484fa8` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:18.835355 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337400fd-b587-45c4-996c-d43ae1b54733 admin admin] RBAC: Authorizing `identity:delete_user(user_id=536dec9b82144ab7be773998ec484fa8)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:18.837538 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337400fd-b587-45c4-996c-d43ae1b54733 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:19.178611 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-337400fd-b587-45c4-996c-d43ae1b54733 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '536dec9b82144ab7be773998ec484fa8'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:19.203893 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-337400fd-b587-45c4-996c-d43ae1b54733 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '536dec9b82144ab7be773998ec484fa8'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:19.205856 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-337400fd-b587-45c4-996c-d43ae1b54733 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '536dec9b82144ab7be773998ec484fa8'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:19.216621 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-337400fd-b587-45c4-996c-d43ae1b54733 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '536dec9b82144ab7be773998ec484fa8'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:19.217492 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-337400fd-b587-45c4-996c-d43ae1b54733 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '536dec9b82144ab7be773998ec484fa8'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:19.308722 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 870/1734] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:22:18 2022] DELETE /identity/v3/users/536dec9b82144ab7be773998ec484fa8 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:22:19.435404 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:19.618122 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac8286-9111-4378-a10d-355e94c9ed60 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:19.618487 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac8286-9111-4378-a10d-355e94c9ed60 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:19.618487 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac8286-9111-4378-a10d-355e94c9ed60 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:19.619924 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 865/1735] 10.222.0.61 () {54 vars in 921 bytes} [Fri Jun 3 13:22:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:22:19.651448 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dfd710-38bc-4ff0-9574-4c4ecc5c716f None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:19.652210 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dfd710-38bc-4ff0-9574-4c4ecc5c716f None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:19.653078 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dfd710-38bc-4ff0-9574-4c4ecc5c716f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:19.676130 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-a4dfd710-38bc-4ff0-9574-4c4ecc5c716f None None] MFA Rules not processed for user `a5c4ad16c9454b74ae8445b115cf0af4`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:19.678265 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-a4dfd710-38bc-4ff0-9574-4c4ecc5c716f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:19.821485 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 871/1736] 10.222.0.61 () {58 vars in 1018 bytes} [Fri Jun 3 13:22:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:22:19.824051 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac8286-9111-4378-a10d-355e94c9ed60 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:19.828637 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-94ac8286-9111-4378-a10d-355e94c9ed60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:19.888501 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dfd710-38bc-4ff0-9574-4c4ecc5c716f None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:19.890970 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-a4dfd710-38bc-4ff0-9574-4c4ecc5c716f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:19.906601 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:19.911397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dfd710-38bc-4ff0-9574-4c4ecc5c716f None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:19.926745 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be525a7-6e21-40c8-b33d-b4d4beee2911 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5c4ad16c9454b74ae8445b115cf0af4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:19.927791 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be525a7-6e21-40c8-b33d-b4d4beee2911 service placement] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:19.928450 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be525a7-6e21-40c8-b33d-b4d4beee2911 service placement] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:19.928924 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be525a7-6e21-40c8-b33d-b4d4beee2911 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:19.949424 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be525a7-6e21-40c8-b33d-b4d4beee2911 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:19.952385 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be525a7-6e21-40c8-b33d-b4d4beee2911 service placement] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:19.962350 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac8286-9111-4378-a10d-355e94c9ed60 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:19.975463 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb6a75-abd3-4386-b6b2-d3dcc7ead617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:19.976705 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb6a75-abd3-4386-b6b2-d3dcc7ead617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:19.977714 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 872/1737] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:22:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:22:19.977986 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb6a75-abd3-4386-b6b2-d3dcc7ead617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:19.978400 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb6a75-abd3-4386-b6b2-d3dcc7ead617 admin admin] PATH_INFO: `/v3/users/e0d7c0480b7e48b48fa7e11adb2d8339` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:19.980095 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb6a75-abd3-4386-b6b2-d3dcc7ead617 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0d7c0480b7e48b48fa7e11adb2d8339)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:19.983836 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb6a75-abd3-4386-b6b2-d3dcc7ead617 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:20.181070 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be525a7-6e21-40c8-b33d-b4d4beee2911 service placement] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:20.186314 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-9be525a7-6e21-40c8-b33d-b4d4beee2911 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:20.205476 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be525a7-6e21-40c8-b33d-b4d4beee2911 service placement] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:20.211711 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43366934-def8-470c-a461-2a11c85e58e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:20.212873 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43366934-def8-470c-a461-2a11c85e58e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:20.213214 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43366934-def8-470c-a461-2a11c85e58e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:20.213609 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43366934-def8-470c-a461-2a11c85e58e8 admin admin] PATH_INFO: `/v3/projects/1f157b38bce046569daa676cced68966` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:20.214858 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43366934-def8-470c-a461-2a11c85e58e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f157b38bce046569daa676cced68966)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:20.220594 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: WARNING py.warnings [None req-43366934-def8-470c-a461-2a11c85e58e8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 13:22:20.220594 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: warnings.warn(msg) Jun 03 13:22:20.220594 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: Jun 03 13:22:20.220594 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43366934-def8-470c-a461-2a11c85e58e8 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:20.346043 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-19eb6a75-abd3-4386-b6b2-d3dcc7ead617 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0d7c0480b7e48b48fa7e11adb2d8339'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:20.390085 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-19eb6a75-abd3-4386-b6b2-d3dcc7ead617 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0d7c0480b7e48b48fa7e11adb2d8339'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:20.391396 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-19eb6a75-abd3-4386-b6b2-d3dcc7ead617 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0d7c0480b7e48b48fa7e11adb2d8339'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:20.415622 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-43366934-def8-470c-a461-2a11c85e58e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f157b38bce046569daa676cced68966', 'request_id': 'req-43366934-def8-470c-a461-2a11c85e58e8'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:20.417564 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-19eb6a75-abd3-4386-b6b2-d3dcc7ead617 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0d7c0480b7e48b48fa7e11adb2d8339'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:20.421751 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-19eb6a75-abd3-4386-b6b2-d3dcc7ead617 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0d7c0480b7e48b48fa7e11adb2d8339'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:20.520918 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-43366934-def8-470c-a461-2a11c85e58e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f157b38bce046569daa676cced68966', 'request_id': 'req-43366934-def8-470c-a461-2a11c85e58e8'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:20.533789 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-43366934-def8-470c-a461-2a11c85e58e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f157b38bce046569daa676cced68966', 'request_id': 'req-43366934-def8-470c-a461-2a11c85e58e8'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:20.558190 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-43366934-def8-470c-a461-2a11c85e58e8 admin admin] The token cache is being invalidate because project 1f157b38bce046569daa676cced68966 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:22:20.558690 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-43366934-def8-470c-a461-2a11c85e58e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:20.559424 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-43366934-def8-470c-a461-2a11c85e58e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:20.565896 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 873/1738] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:22:20 2022] DELETE /identity/v3/projects/1f157b38bce046569daa676cced68966 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:22:20.567769 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780eec7-3feb-4516-9a4d-b98cf14f16c2 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:20.567769 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780eec7-3feb-4516-9a4d-b98cf14f16c2 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:20.568107 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780eec7-3feb-4516-9a4d-b98cf14f16c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:20.589362 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-9780eec7-3feb-4516-9a4d-b98cf14f16c2 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:20.590981 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-9780eec7-3feb-4516-9a4d-b98cf14f16c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:20.615247 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 866/1739] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:22:19 2022] DELETE /identity/v3/users/e0d7c0480b7e48b48fa7e11adb2d8339 => generated 0 bytes in 789 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:22:20.701470 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:20.781981 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 874/1740] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:22:20.788590 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6573f12-64f2-49f0-827d-cfe65bce604c None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:20.789051 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6573f12-64f2-49f0-827d-cfe65bce604c None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:20.789151 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6573f12-64f2-49f0-827d-cfe65bce604c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:20.830956 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-c6573f12-64f2-49f0-827d-cfe65bce604c None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:20.832591 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-c6573f12-64f2-49f0-827d-cfe65bce604c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:21.017141 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 867/1741] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:22:21.026591 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780eec7-3feb-4516-9a4d-b98cf14f16c2 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:21.042208 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780eec7-3feb-4516-9a4d-b98cf14f16c2 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:21.061806 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7297524-1861-469a-9b99-71598598457e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:21.062563 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7297524-1861-469a-9b99-71598598457e admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:21.062914 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7297524-1861-469a-9b99-71598598457e admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:21.063299 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7297524-1861-469a-9b99-71598598457e admin admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:21.064092 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7297524-1861-469a-9b99-71598598457e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:22:21.064431 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7297524-1861-469a-9b99-71598598457e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:21.066048 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7297524-1861-469a-9b99-71598598457e admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:21.080791 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 875/1742] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:22:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:22:21.086092 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6573f12-64f2-49f0-827d-cfe65bce604c None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:21.095419 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6573f12-64f2-49f0-827d-cfe65bce604c None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:21.101212 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb4ff7-5b79-4c9d-bd44-c9d5665ac140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:21.102089 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb4ff7-5b79-4c9d-bd44-c9d5665ac140 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:21.102495 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb4ff7-5b79-4c9d-bd44-c9d5665ac140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:21.102924 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb4ff7-5b79-4c9d-bd44-c9d5665ac140 admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:21.103761 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb4ff7-5b79-4c9d-bd44-c9d5665ac140 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:21.105893 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb4ff7-5b79-4c9d-bd44-c9d5665ac140 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:21.256278 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 868/1743] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:22:21 2022] POST /identity/v3/projects => generated 365 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:22:21.260188 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7297524-1861-469a-9b99-71598598457e admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:21.273781 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7297524-1861-469a-9b99-71598598457e admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:21.372642 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e68bc-b723-4dcc-b34a-24f4ec1c5d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:21.374601 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e68bc-b723-4dcc-b34a-24f4ec1c5d82 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:21.374849 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e68bc-b723-4dcc-b34a-24f4ec1c5d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:21.376613 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e68bc-b723-4dcc-b34a-24f4ec1c5d82 admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:21.377052 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965e68bc-b723-4dcc-b34a-24f4ec1c5d82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:21.380112 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965e68bc-b723-4dcc-b34a-24f4ec1c5d82 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:21.481908 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 876/1744] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:22:21 2022] POST /identity/v3/users => generated 283 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:22:21.485711 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb4ff7-5b79-4c9d-bd44-c9d5665ac140 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:21.488808 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e68bc-b723-4dcc-b34a-24f4ec1c5d82 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:21.497764 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-965e68bc-b723-4dcc-b34a-24f4ec1c5d82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:21.522601 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb4ff7-5b79-4c9d-bd44-c9d5665ac140 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:21.535208 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd34de05-b87a-42ec-adfe-1602f1ea0e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:21.536446 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd34de05-b87a-42ec-adfe-1602f1ea0e73 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:21.536933 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd34de05-b87a-42ec-adfe-1602f1ea0e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:21.545945 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd34de05-b87a-42ec-adfe-1602f1ea0e73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:21.545945 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd34de05-b87a-42ec-adfe-1602f1ea0e73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:21.545945 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd34de05-b87a-42ec-adfe-1602f1ea0e73 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:21.546570 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e68bc-b723-4dcc-b34a-24f4ec1c5d82 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:21.563438 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33dd164-2090-4005-a544-50cd7ba4c2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:21.563898 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33dd164-2090-4005-a544-50cd7ba4c2e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:21.564926 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33dd164-2090-4005-a544-50cd7ba4c2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:21.565158 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33dd164-2090-4005-a544-50cd7ba4c2e9 admin admin] PATH_INFO: `/v3/projects/39f154f97b1940c19044489879c35bf4` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:21.568130 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33dd164-2090-4005-a544-50cd7ba4c2e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39f154f97b1940c19044489879c35bf4)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:21.571537 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33dd164-2090-4005-a544-50cd7ba4c2e9 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:21.574355 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 869/1745] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:22:21.575716 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd34de05-b87a-42ec-adfe-1602f1ea0e73 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:21.602859 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd34de05-b87a-42ec-adfe-1602f1ea0e73 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:21.609922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e9d66-42e9-4f4a-a77c-4305c7be5687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:21.610872 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e9d66-42e9-4f4a-a77c-4305c7be5687 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:21.611580 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e9d66-42e9-4f4a-a77c-4305c7be5687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:21.612665 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e9d66-42e9-4f4a-a77c-4305c7be5687 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:21.613438 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5e9d66-42e9-4f4a-a77c-4305c7be5687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:21.615411 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5e9d66-42e9-4f4a-a77c-4305c7be5687 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:21.648570 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 870/1746] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:22:21.649845 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e9d66-42e9-4f4a-a77c-4305c7be5687 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:21.660947 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:21.666879 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e9d66-42e9-4f4a-a77c-4305c7be5687 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:21.675727 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057dc6c4-00c7-4849-b289-0ce4ec4ff5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:21.677200 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057dc6c4-00c7-4849-b289-0ce4ec4ff5e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:21.677683 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057dc6c4-00c7-4849-b289-0ce4ec4ff5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:21.678157 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057dc6c4-00c7-4849-b289-0ce4ec4ff5e5 admin admin] PATH_INFO: `/v3/projects/db4114e716e749b1a8097c351721b35d/users/10742df2d30648faa3e0e4e19fdc9156/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:21.705144 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057dc6c4-00c7-4849-b289-0ce4ec4ff5e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db4114e716e749b1a8097c351721b35d, user_id=10742df2d30648faa3e0e4e19fdc9156, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:21.709486 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057dc6c4-00c7-4849-b289-0ce4ec4ff5e5 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:21.851972 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 871/1747] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:22:21 2022] PUT /identity/v3/projects/db4114e716e749b1a8097c351721b35d/users/10742df2d30648faa3e0e4e19fdc9156/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:22:21.854242 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab1c10-c736-467f-9136-c77416da2314 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:21.854700 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab1c10-c736-467f-9136-c77416da2314 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:21.855123 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab1c10-c736-467f-9136-c77416da2314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:21.874634 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-c33dd164-2090-4005-a544-50cd7ba4c2e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39f154f97b1940c19044489879c35bf4', 'request_id': 'req-c33dd164-2090-4005-a544-50cd7ba4c2e9'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:21.905924 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-cbab1c10-c736-467f-9136-c77416da2314 None None] MFA Rules not processed for user `10742df2d30648faa3e0e4e19fdc9156`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:21.907397 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-cbab1c10-c736-467f-9136-c77416da2314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:22.007462 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-c33dd164-2090-4005-a544-50cd7ba4c2e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39f154f97b1940c19044489879c35bf4', 'request_id': 'req-c33dd164-2090-4005-a544-50cd7ba4c2e9'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:22.021179 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-c33dd164-2090-4005-a544-50cd7ba4c2e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39f154f97b1940c19044489879c35bf4', 'request_id': 'req-c33dd164-2090-4005-a544-50cd7ba4c2e9'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:22.027677 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 872/1748] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:21 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:22:22.040037 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab1c10-c736-467f-9136-c77416da2314 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:22.058483 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-c33dd164-2090-4005-a544-50cd7ba4c2e9 admin admin] The token cache is being invalidate because project 39f154f97b1940c19044489879c35bf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:22:22.058801 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-c33dd164-2090-4005-a544-50cd7ba4c2e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:22.060475 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-c33dd164-2090-4005-a544-50cd7ba4c2e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:22.063257 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 877/1749] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:22:21 2022] DELETE /identity/v3/projects/39f154f97b1940c19044489879c35bf4 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:22:22.073044 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33dd164-2090-4005-a544-50cd7ba4c2e9 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:22.074543 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-c33dd164-2090-4005-a544-50cd7ba4c2e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:22.172891 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:22.179210 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab1c10-c736-467f-9136-c77416da2314 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:22.192291 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8631d7e-7b86-434f-8034-5e5780cc0598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:22.194412 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8631d7e-7b86-434f-8034-5e5780cc0598 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:22.194814 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8631d7e-7b86-434f-8034-5e5780cc0598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:22.195345 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8631d7e-7b86-434f-8034-5e5780cc0598 admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:22.198663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8631d7e-7b86-434f-8034-5e5780cc0598 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:22.203057 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8631d7e-7b86-434f-8034-5e5780cc0598 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:22.215471 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33dd164-2090-4005-a544-50cd7ba4c2e9 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:22.229801 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c21f5e-42f3-4eb9-b9c7-b3b7ca917bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:22.230970 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c21f5e-42f3-4eb9-b9c7-b3b7ca917bf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:22.231916 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c21f5e-42f3-4eb9-b9c7-b3b7ca917bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:22.232313 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c21f5e-42f3-4eb9-b9c7-b3b7ca917bf3 admin admin] PATH_INFO: `/v3/users/7799553d33e64330a7c83dc62e67e124` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:22.237666 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c21f5e-42f3-4eb9-b9c7-b3b7ca917bf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7799553d33e64330a7c83dc62e67e124)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:22.240714 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c21f5e-42f3-4eb9-b9c7-b3b7ca917bf3 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:22.323507 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 873/1750] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:22:22 2022] POST /identity/v3/projects => generated 365 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:22:22.323507 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d14d8b-0c4b-498e-9aab-efd4e4827a73 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:22.323507 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d14d8b-0c4b-498e-9aab-efd4e4827a73 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:22.323507 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d14d8b-0c4b-498e-9aab-efd4e4827a73 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:22.324955 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 874/1751] 10.222.0.61 () {54 vars in 921 bytes} [Fri Jun 3 13:22:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:22:22.324955 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d14d8b-0c4b-498e-9aab-efd4e4827a73 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:22.326723 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-59d14d8b-0c4b-498e-9aab-efd4e4827a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:22.433686 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d14d8b-0c4b-498e-9aab-efd4e4827a73 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:22.445686 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c972ccb-8687-4f44-b425-3f11ee7a1346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:22.445686 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c972ccb-8687-4f44-b425-3f11ee7a1346 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:22.445686 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c972ccb-8687-4f44-b425-3f11ee7a1346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:22.445686 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c972ccb-8687-4f44-b425-3f11ee7a1346 admin admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:22.446178 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c972ccb-8687-4f44-b425-3f11ee7a1346 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:22.446178 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c972ccb-8687-4f44-b425-3f11ee7a1346 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:22.514474 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-f3c21f5e-42f3-4eb9-b9c7-b3b7ca917bf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7799553d33e64330a7c83dc62e67e124'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:22.528661 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-f3c21f5e-42f3-4eb9-b9c7-b3b7ca917bf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7799553d33e64330a7c83dc62e67e124'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:22.532043 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-f3c21f5e-42f3-4eb9-b9c7-b3b7ca917bf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7799553d33e64330a7c83dc62e67e124'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:22.539594 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-f3c21f5e-42f3-4eb9-b9c7-b3b7ca917bf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7799553d33e64330a7c83dc62e67e124'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:22.540452 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-f3c21f5e-42f3-4eb9-b9c7-b3b7ca917bf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7799553d33e64330a7c83dc62e67e124'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:22.557744 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 875/1752] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:22:22 2022] POST /identity/v3/users => generated 289 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:22:22.557744 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f1881-8999-4590-a454-7a02b7d91d8e None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:22.557744 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f1881-8999-4590-a454-7a02b7d91d8e None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:22.557744 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f1881-8999-4590-a454-7a02b7d91d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:22.579280 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-0e9f1881-8999-4590-a454-7a02b7d91d8e None None] MFA Rules not processed for user `066aaba3e9af4f85ab0cba89a3d32e34`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:22.580555 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-0e9f1881-8999-4590-a454-7a02b7d91d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:22.648008 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 878/1753] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:22:22 2022] DELETE /identity/v3/users/7799553d33e64330a7c83dc62e67e124 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:22:22.648981 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c21f5e-42f3-4eb9-b9c7-b3b7ca917bf3 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:22.650366 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-f3c21f5e-42f3-4eb9-b9c7-b3b7ca917bf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:22.709440 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 876/1754] 10.222.0.61 () {58 vars in 1018 bytes} [Fri Jun 3 13:22:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:22:22.761854 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f1881-8999-4590-a454-7a02b7d91d8e None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:22.763523 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-0e9f1881-8999-4590-a454-7a02b7d91d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:22.784551 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f1881-8999-4590-a454-7a02b7d91d8e None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:22.792361 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c21f5e-42f3-4eb9-b9c7-b3b7ca917bf3 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:22.799728 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52796c17-f352-4705-815f-693f64e1c2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:22.800509 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52796c17-f352-4705-815f-693f64e1c2b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:22.800798 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52796c17-f352-4705-815f-693f64e1c2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:22.801078 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52796c17-f352-4705-815f-693f64e1c2b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:22.801816 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52796c17-f352-4705-815f-693f64e1c2b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:22.808318 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52796c17-f352-4705-815f-693f64e1c2b8 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:22.829342 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 879/1755] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:22:22.838339 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52796c17-f352-4705-815f-693f64e1c2b8 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:22.869871 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52796c17-f352-4705-815f-693f64e1c2b8 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:22.886422 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb7d4c-c6d8-414f-906d-423bf8c51e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:22.889643 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb7d4c-c6d8-414f-906d-423bf8c51e2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:22.891030 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb7d4c-c6d8-414f-906d-423bf8c51e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:22.892493 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb7d4c-c6d8-414f-906d-423bf8c51e2c admin admin] PATH_INFO: `/v3/projects/70682116527c421c8123f04f7ba73c5b/users/159836714f13436299a083613066f212/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:22.903365 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0904f-4088-4759-b1b9-de06a87d79c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066aaba3e9af4f85ab0cba89a3d32e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:22.905777 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0904f-4088-4759-b1b9-de06a87d79c4 service nova] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:22.908583 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0904f-4088-4759-b1b9-de06a87d79c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:22.909088 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0904f-4088-4759-b1b9-de06a87d79c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:22.929469 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b0904f-4088-4759-b1b9-de06a87d79c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:22.931800 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b0904f-4088-4759-b1b9-de06a87d79c4 service nova] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:22.935655 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb7d4c-c6d8-414f-906d-423bf8c51e2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=70682116527c421c8123f04f7ba73c5b, user_id=159836714f13436299a083613066f212, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:22.939099 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb7d4c-c6d8-414f-906d-423bf8c51e2c admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:22.956118 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 877/1756] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:22:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:22:23.091687 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 880/1757] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:22:22 2022] PUT /identity/v3/projects/70682116527c421c8123f04f7ba73c5b/users/159836714f13436299a083613066f212/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:22:23.091885 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0904f-4088-4759-b1b9-de06a87d79c4 service nova] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:23.105694 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0904f-4088-4759-b1b9-de06a87d79c4 service nova] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:23.136336 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb7d4c-c6d8-414f-906d-423bf8c51e2c admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:23.138937 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-fbeb7d4c-c6d8-414f-906d-423bf8c51e2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:23.180517 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:23.191027 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75156936-4a72-45d9-818a-fb0407a74ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:23.191815 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75156936-4a72-45d9-818a-fb0407a74ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:23.192467 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75156936-4a72-45d9-818a-fb0407a74ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:23.192467 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75156936-4a72-45d9-818a-fb0407a74ca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:23.193304 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75156936-4a72-45d9-818a-fb0407a74ca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:23.195028 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75156936-4a72-45d9-818a-fb0407a74ca8 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:23.208328 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 878/1758] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:22:23.210893 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75156936-4a72-45d9-818a-fb0407a74ca8 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:23.218123 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb7d4c-c6d8-414f-906d-423bf8c51e2c admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:23.222510 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75156936-4a72-45d9-818a-fb0407a74ca8 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:23.223396 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96956ce-749c-4d17-ba12-1b2b9d6bf41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:23.224347 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96956ce-749c-4d17-ba12-1b2b9d6bf41a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:23.224631 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96956ce-749c-4d17-ba12-1b2b9d6bf41a admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:23.224909 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96956ce-749c-4d17-ba12-1b2b9d6bf41a admin admin] PATH_INFO: `/v3/projects/11550a07fd164b06b0f528f1a854e65e` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:23.226166 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96956ce-749c-4d17-ba12-1b2b9d6bf41a admin admin] RBAC: Authorizing `identity:delete_project(project_id=11550a07fd164b06b0f528f1a854e65e)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:23.228013 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09963f-c939-4152-9c6e-49b4acefe7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:23.228267 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96956ce-749c-4d17-ba12-1b2b9d6bf41a admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:23.229049 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09963f-c939-4152-9c6e-49b4acefe7cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:23.229781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09963f-c939-4152-9c6e-49b4acefe7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:23.229781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09963f-c939-4152-9c6e-49b4acefe7cf admin admin] PATH_INFO: `/v3/projects/70682116527c421c8123f04f7ba73c5b/users/159836714f13436299a083613066f212/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:23.231785 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09963f-c939-4152-9c6e-49b4acefe7cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=70682116527c421c8123f04f7ba73c5b, user_id=159836714f13436299a083613066f212, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:23.235178 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09963f-c939-4152-9c6e-49b4acefe7cf admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:23.252194 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 879/1759] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:22:23 2022] PUT /identity/v3/projects/70682116527c421c8123f04f7ba73c5b/users/159836714f13436299a083613066f212/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:22:23.261731 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1f65a-0f7c-43e1-b0fb-fdf0af9c0327 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:23.262028 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1f65a-0f7c-43e1-b0fb-fdf0af9c0327 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:23.262306 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1f65a-0f7c-43e1-b0fb-fdf0af9c0327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:23.297159 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-d9f1f65a-0f7c-43e1-b0fb-fdf0af9c0327 None None] MFA Rules not processed for user `159836714f13436299a083613066f212`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:23.299053 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-d9f1f65a-0f7c-43e1-b0fb-fdf0af9c0327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:23.364012 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-a96956ce-749c-4d17-ba12-1b2b9d6bf41a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11550a07fd164b06b0f528f1a854e65e', 'request_id': 'req-a96956ce-749c-4d17-ba12-1b2b9d6bf41a'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:23.371760 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 880/1760] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:23 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:22:23.386555 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1f65a-0f7c-43e1-b0fb-fdf0af9c0327 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:23.388442 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-d9f1f65a-0f7c-43e1-b0fb-fdf0af9c0327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:23.448911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1f65a-0f7c-43e1-b0fb-fdf0af9c0327 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:23.453239 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-a96956ce-749c-4d17-ba12-1b2b9d6bf41a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11550a07fd164b06b0f528f1a854e65e', 'request_id': 'req-a96956ce-749c-4d17-ba12-1b2b9d6bf41a'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:23.462712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-a96956ce-749c-4d17-ba12-1b2b9d6bf41a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11550a07fd164b06b0f528f1a854e65e', 'request_id': 'req-a96956ce-749c-4d17-ba12-1b2b9d6bf41a'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:23.474682 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-a96956ce-749c-4d17-ba12-1b2b9d6bf41a admin admin] The token cache is being invalidate because project 11550a07fd164b06b0f528f1a854e65e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:22:23.474970 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-a96956ce-749c-4d17-ba12-1b2b9d6bf41a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:23.475652 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-a96956ce-749c-4d17-ba12-1b2b9d6bf41a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:23.477409 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 881/1761] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:22:23 2022] DELETE /identity/v3/projects/11550a07fd164b06b0f528f1a854e65e => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:22:23.482066 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e368c80-d386-4a77-b91c-61f25a250bad None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:23.482356 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e368c80-d386-4a77-b91c-61f25a250bad None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:23.482637 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e368c80-d386-4a77-b91c-61f25a250bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:23.505384 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-6e368c80-d386-4a77-b91c-61f25a250bad None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:23.506355 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6867ae-78d8-44d4-b8ba-319f783da326 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:23.506595 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-6e368c80-d386-4a77-b91c-61f25a250bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:23.507163 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6867ae-78d8-44d4-b8ba-319f783da326 service cinder] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:23.507516 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6867ae-78d8-44d4-b8ba-319f783da326 service cinder] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:23.507854 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6867ae-78d8-44d4-b8ba-319f783da326 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:23.510278 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-2c6867ae-78d8-44d4-b8ba-319f783da326 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:23.541758 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:23.583161 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 882/1762] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:22:23.590588 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30aa2d7-1f07-4426-863d-51572f46b18a None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:23.590874 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30aa2d7-1f07-4426-863d-51572f46b18a None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:23.591150 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30aa2d7-1f07-4426-863d-51572f46b18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:23.596182 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6867ae-78d8-44d4-b8ba-319f783da326 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:23.600269 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6867ae-78d8-44d4-b8ba-319f783da326 service cinder] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:23.609683 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 881/1763] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:22:23 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 13:22:23.616920 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-e30aa2d7-1f07-4426-863d-51572f46b18a None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:23.618679 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-e30aa2d7-1f07-4426-863d-51572f46b18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:23.631459 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 883/1764] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:22:23.635429 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6867ae-78d8-44d4-b8ba-319f783da326 service cinder] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:23.647984 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6867ae-78d8-44d4-b8ba-319f783da326 service cinder] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:23.652990 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64291772-4683-4fd5-937b-f79fdbfe0cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:23.653664 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64291772-4683-4fd5-937b-f79fdbfe0cee admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:23.653951 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64291772-4683-4fd5-937b-f79fdbfe0cee admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:23.654229 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64291772-4683-4fd5-937b-f79fdbfe0cee admin admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:23.655479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64291772-4683-4fd5-937b-f79fdbfe0cee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:22:23.655830 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64291772-4683-4fd5-937b-f79fdbfe0cee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:23.657525 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64291772-4683-4fd5-937b-f79fdbfe0cee admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:23.671154 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 882/1765] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:22:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:22:23.681048 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30aa2d7-1f07-4426-863d-51572f46b18a None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:23.692038 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30aa2d7-1f07-4426-863d-51572f46b18a None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:23.696969 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d6913c-1eb3-4718-8ad2-9c3f1f95b71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:23.697771 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6913c-1eb3-4718-8ad2-9c3f1f95b71a admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:23.698073 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6913c-1eb3-4718-8ad2-9c3f1f95b71a admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:23.698352 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6913c-1eb3-4718-8ad2-9c3f1f95b71a admin admin] PATH_INFO: `/v3/projects` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:23.699104 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d6913c-1eb3-4718-8ad2-9c3f1f95b71a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:23.701192 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d6913c-1eb3-4718-8ad2-9c3f1f95b71a admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:23.829835 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64291772-4683-4fd5-937b-f79fdbfe0cee admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:23.841820 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 884/1766] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:22:23 2022] POST /identity/v3/projects => generated 387 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:22:23.843480 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64291772-4683-4fd5-937b-f79fdbfe0cee admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:23.923702 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93abe3b-0ebd-4b15-8118-b20c79fbfb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:23.924863 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93abe3b-0ebd-4b15-8118-b20c79fbfb3f admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:23.925133 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93abe3b-0ebd-4b15-8118-b20c79fbfb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:23.925538 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93abe3b-0ebd-4b15-8118-b20c79fbfb3f admin admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:23.926254 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93abe3b-0ebd-4b15-8118-b20c79fbfb3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:23.928493 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93abe3b-0ebd-4b15-8118-b20c79fbfb3f admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:24.073168 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 883/1767] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:22:23 2022] POST /identity/v3/users => generated 294 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:22:24.077333 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d6913c-1eb3-4718-8ad2-9c3f1f95b71a admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:24.094611 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d6913c-1eb3-4718-8ad2-9c3f1f95b71a admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:24.106551 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf732f-5ef3-46b1-81e2-0d16a6f1199c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:24.107234 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf732f-5ef3-46b1-81e2-0d16a6f1199c admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:24.107513 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf732f-5ef3-46b1-81e2-0d16a6f1199c admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:24.107783 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf732f-5ef3-46b1-81e2-0d16a6f1199c admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:24.121223 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf732f-5ef3-46b1-81e2-0d16a6f1199c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:24.122741 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf732f-5ef3-46b1-81e2-0d16a6f1199c admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:24.160623 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 885/1768] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:22:24.163279 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93abe3b-0ebd-4b15-8118-b20c79fbfb3f admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:24.182935 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93abe3b-0ebd-4b15-8118-b20c79fbfb3f admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:24.191480 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c947752-43b7-4a9c-b962-c447cae92610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:24.193011 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c947752-43b7-4a9c-b962-c447cae92610 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:24.193011 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c947752-43b7-4a9c-b962-c447cae92610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:24.193260 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c947752-43b7-4a9c-b962-c447cae92610 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:24.194105 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c947752-43b7-4a9c-b962-c447cae92610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:24.196245 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c947752-43b7-4a9c-b962-c447cae92610 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:24.213141 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 884/1769] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:22:24.216991 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf732f-5ef3-46b1-81e2-0d16a6f1199c admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:24.231411 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf732f-5ef3-46b1-81e2-0d16a6f1199c admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:24.239723 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858600fd-45ed-4d9b-a216-4e3ae2927667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:24.241359 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858600fd-45ed-4d9b-a216-4e3ae2927667 admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:24.241787 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858600fd-45ed-4d9b-a216-4e3ae2927667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:24.242205 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858600fd-45ed-4d9b-a216-4e3ae2927667 admin admin] PATH_INFO: `/v3/projects/42b037e696104bbf84c4e1b72f01e14b/users/750dbae563b64a30a154c2ce3930df8c/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:24.243309 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:24.262192 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858600fd-45ed-4d9b-a216-4e3ae2927667 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42b037e696104bbf84c4e1b72f01e14b, user_id=750dbae563b64a30a154c2ce3930df8c, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:24.265986 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858600fd-45ed-4d9b-a216-4e3ae2927667 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:24.362698 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 886/1770] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:22:24 2022] PUT /identity/v3/projects/42b037e696104bbf84c4e1b72f01e14b/users/750dbae563b64a30a154c2ce3930df8c/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:22:24.374463 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317a112-2bd9-47a8-93c0-0fc848a44bbd None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:24.375505 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317a112-2bd9-47a8-93c0-0fc848a44bbd None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:24.379403 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317a112-2bd9-47a8-93c0-0fc848a44bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:24.425035 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-b317a112-2bd9-47a8-93c0-0fc848a44bbd None None] MFA Rules not processed for user `750dbae563b64a30a154c2ce3930df8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:24.428708 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-b317a112-2bd9-47a8-93c0-0fc848a44bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:24.590645 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 885/1771] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:22:24.608807 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858600fd-45ed-4d9b-a216-4e3ae2927667 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:24.698260 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858600fd-45ed-4d9b-a216-4e3ae2927667 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:24.705352 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c358a95-6745-4cbb-94df-4491408c1195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:24.706076 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c358a95-6745-4cbb-94df-4491408c1195 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:24.706360 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c358a95-6745-4cbb-94df-4491408c1195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:24.706688 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c358a95-6745-4cbb-94df-4491408c1195 admin admin] PATH_INFO: `/v3/projects` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:24.707384 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c358a95-6745-4cbb-94df-4491408c1195 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:24.709536 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c358a95-6745-4cbb-94df-4491408c1195 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:24.825566 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 887/1772] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:22:24 2022] POST /identity/v3/projects => generated 387 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:22:24.826404 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317a112-2bd9-47a8-93c0-0fc848a44bbd None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:24.840760 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317a112-2bd9-47a8-93c0-0fc848a44bbd None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:24.909898 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2a57a-d4ce-4768-807a-90c3431f3c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:24.910726 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2a57a-d4ce-4768-807a-90c3431f3c2d admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:24.911085 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2a57a-d4ce-4768-807a-90c3431f3c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:24.911432 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2a57a-d4ce-4768-807a-90c3431f3c2d admin admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:24.912437 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f2a57a-d4ce-4768-807a-90c3431f3c2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:24.915562 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f2a57a-d4ce-4768-807a-90c3431f3c2d admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:24.958072 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c358a95-6745-4cbb-94df-4491408c1195 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:24.960586 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-3c358a95-6745-4cbb-94df-4491408c1195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:24.979577 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c358a95-6745-4cbb-94df-4491408c1195 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:24.989969 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ef576-4769-4b8d-bcd8-aca55d4a3b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:24.989969 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ef576-4769-4b8d-bcd8-aca55d4a3b07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:24.989969 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ef576-4769-4b8d-bcd8-aca55d4a3b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:24.989969 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ef576-4769-4b8d-bcd8-aca55d4a3b07 admin admin] PATH_INFO: `/v3/users/10742df2d30648faa3e0e4e19fdc9156` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:24.991894 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9ef576-4769-4b8d-bcd8-aca55d4a3b07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10742df2d30648faa3e0e4e19fdc9156)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:24.995795 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9ef576-4769-4b8d-bcd8-aca55d4a3b07 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:25.017335 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 886/1773] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:22:24 2022] POST /identity/v3/users => generated 300 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:22:25.021098 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2a57a-d4ce-4768-807a-90c3431f3c2d admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:25.032196 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2a57a-d4ce-4768-807a-90c3431f3c2d admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:25.037141 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef079f5-8b77-46e4-a0eb-c210e9714d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:25.037820 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef079f5-8b77-46e4-a0eb-c210e9714d61 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:25.038120 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef079f5-8b77-46e4-a0eb-c210e9714d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:25.038388 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef079f5-8b77-46e4-a0eb-c210e9714d61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:25.039116 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef079f5-8b77-46e4-a0eb-c210e9714d61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:25.040811 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef079f5-8b77-46e4-a0eb-c210e9714d61 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:25.053161 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 887/1774] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:22:25.057332 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef079f5-8b77-46e4-a0eb-c210e9714d61 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:25.068031 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef079f5-8b77-46e4-a0eb-c210e9714d61 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:25.073025 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174bff3-e81a-4d3d-8fab-0f7781bca8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:25.074535 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174bff3-e81a-4d3d-8fab-0f7781bca8a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:25.074535 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174bff3-e81a-4d3d-8fab-0f7781bca8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:25.074535 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174bff3-e81a-4d3d-8fab-0f7781bca8a8 admin admin] PATH_INFO: `/v3/projects/42ccb73a5c9945f99312d2838f6f0f05/users/7f540aa907f946c8a84cfa9c0a4c829a/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:25.091169 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f174bff3-e81a-4d3d-8fab-0f7781bca8a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42ccb73a5c9945f99312d2838f6f0f05, user_id=7f540aa907f946c8a84cfa9c0a4c829a, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:25.094610 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f174bff3-e81a-4d3d-8fab-0f7781bca8a8 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:25.184796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 888/1775] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:22:25 2022] PUT /identity/v3/projects/42ccb73a5c9945f99312d2838f6f0f05/users/7f540aa907f946c8a84cfa9c0a4c829a/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:22:25.185487 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174bff3-e81a-4d3d-8fab-0f7781bca8a8 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:25.256635 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-fb9ef576-4769-4b8d-bcd8-aca55d4a3b07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10742df2d30648faa3e0e4e19fdc9156'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:25.303883 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-fb9ef576-4769-4b8d-bcd8-aca55d4a3b07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10742df2d30648faa3e0e4e19fdc9156'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:25.304922 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-fb9ef576-4769-4b8d-bcd8-aca55d4a3b07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10742df2d30648faa3e0e4e19fdc9156'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:25.326714 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:25.330168 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-fb9ef576-4769-4b8d-bcd8-aca55d4a3b07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10742df2d30648faa3e0e4e19fdc9156'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:25.339039 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-fb9ef576-4769-4b8d-bcd8-aca55d4a3b07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10742df2d30648faa3e0e4e19fdc9156'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:25.364693 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174bff3-e81a-4d3d-8fab-0f7781bca8a8 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:25.379238 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b8feb8-ad12-4881-abcc-114aaf6746de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:25.380086 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8feb8-ad12-4881-abcc-114aaf6746de admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:25.380402 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8feb8-ad12-4881-abcc-114aaf6746de admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:25.380678 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8feb8-ad12-4881-abcc-114aaf6746de admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:25.385038 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b8feb8-ad12-4881-abcc-114aaf6746de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:25.388224 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b8feb8-ad12-4881-abcc-114aaf6746de admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:25.407229 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 889/1776] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:22:25.410904 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b8feb8-ad12-4881-abcc-114aaf6746de admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:25.412910 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-47b8feb8-ad12-4881-abcc-114aaf6746de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:25.432619 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 888/1777] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:22:24 2022] DELETE /identity/v3/users/10742df2d30648faa3e0e4e19fdc9156 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:22:25.437559 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7488664-c458-40bf-9841-b931fd4f2ec4 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:25.439412 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7488664-c458-40bf-9841-b931fd4f2ec4 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:25.439973 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7488664-c458-40bf-9841-b931fd4f2ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:25.445475 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b8feb8-ad12-4881-abcc-114aaf6746de admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:25.492006 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-c7488664-c458-40bf-9841-b931fd4f2ec4 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:25.496037 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-c7488664-c458-40bf-9841-b931fd4f2ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:25.528416 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:25.593662 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a40d6-86a3-4b0a-96c6-835ce49e39e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:25.594640 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a40d6-86a3-4b0a-96c6-835ce49e39e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:25.596035 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a40d6-86a3-4b0a-96c6-835ce49e39e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:25.596357 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a40d6-86a3-4b0a-96c6-835ce49e39e5 admin admin] PATH_INFO: `/v3/projects/42ccb73a5c9945f99312d2838f6f0f05/users/7f540aa907f946c8a84cfa9c0a4c829a/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:25.606696 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174a40d6-86a3-4b0a-96c6-835ce49e39e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42ccb73a5c9945f99312d2838f6f0f05, user_id=7f540aa907f946c8a84cfa9c0a4c829a, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:25.609622 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174a40d6-86a3-4b0a-96c6-835ce49e39e5 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:25.632477 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 890/1778] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:22:25 2022] PUT /identity/v3/projects/42ccb73a5c9945f99312d2838f6f0f05/users/7f540aa907f946c8a84cfa9c0a4c829a/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:22:25.645594 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a095033-355e-461f-97b6-c47993a52f6a None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:25.645893 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a095033-355e-461f-97b6-c47993a52f6a None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:25.646163 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a095033-355e-461f-97b6-c47993a52f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:25.716409 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-0a095033-355e-461f-97b6-c47993a52f6a None None] MFA Rules not processed for user `7f540aa907f946c8a84cfa9c0a4c829a`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:25.719150 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-0a095033-355e-461f-97b6-c47993a52f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:25.768304 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 889/1779] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:22:25.791030 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7488664-c458-40bf-9841-b931fd4f2ec4 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:25.792847 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-c7488664-c458-40bf-9841-b931fd4f2ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:25.871393 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 891/1780] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:25 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:22:25.881599 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a095033-355e-461f-97b6-c47993a52f6a None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:25.884966 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-0a095033-355e-461f-97b6-c47993a52f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:25.957031 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7488664-c458-40bf-9841-b931fd4f2ec4 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:25.978436 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a095033-355e-461f-97b6-c47993a52f6a None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:25.993895 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af71ec8-d651-48e3-b401-e2d3524e085c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:25.994562 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af71ec8-d651-48e3-b401-e2d3524e085c service cinder] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:25.995785 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af71ec8-d651-48e3-b401-e2d3524e085c service cinder] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:25.996052 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af71ec8-d651-48e3-b401-e2d3524e085c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:26.017530 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af71ec8-d651-48e3-b401-e2d3524e085c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:26.018996 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af71ec8-d651-48e3-b401-e2d3524e085c service cinder] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:26.032779 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 892/1781] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:22:25 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 13:22:26.074800 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af71ec8-d651-48e3-b401-e2d3524e085c service cinder] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:26.093147 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef003d05-c2fe-4f83-9c7f-4e207a11842b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:26.094897 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef003d05-c2fe-4f83-9c7f-4e207a11842b service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:26.095576 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef003d05-c2fe-4f83-9c7f-4e207a11842b service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:26.096520 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef003d05-c2fe-4f83-9c7f-4e207a11842b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:26.190083 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af71ec8-d651-48e3-b401-e2d3524e085c service cinder] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:26.206711 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339af70-73d4-432d-8276-02fc76cf6dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:26.207612 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339af70-73d4-432d-8276-02fc76cf6dbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:26.207893 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339af70-73d4-432d-8276-02fc76cf6dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:26.209280 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339af70-73d4-432d-8276-02fc76cf6dbd admin admin] PATH_INFO: `/v3/users/750dbae563b64a30a154c2ce3930df8c` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:26.212477 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339af70-73d4-432d-8276-02fc76cf6dbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=750dbae563b64a30a154c2ce3930df8c)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:26.217750 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339af70-73d4-432d-8276-02fc76cf6dbd admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:26.245556 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef003d05-c2fe-4f83-9c7f-4e207a11842b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:26.247084 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef003d05-c2fe-4f83-9c7f-4e207a11842b service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:26.266257 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 890/1782] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:22:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:22:26.267675 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcbb10-45de-4539-9f64-4e6962d6df84 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:26.267992 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcbb10-45de-4539-9f64-4e6962d6df84 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:26.268895 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcbb10-45de-4539-9f64-4e6962d6df84 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:26.275161 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 891/1783] 10.222.0.61 () {54 vars in 921 bytes} [Fri Jun 3 13:22:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:22:26.380924 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db22aa-3056-42fe-b633-095227321a8f None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:26.381495 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db22aa-3056-42fe-b633-095227321a8f None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:26.382135 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db22aa-3056-42fe-b633-095227321a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:26.413984 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-b9db22aa-3056-42fe-b633-095227321a8f None None] MFA Rules not processed for user `066aaba3e9af4f85ab0cba89a3d32e34`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:26.415733 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-b9db22aa-3056-42fe-b633-095227321a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:26.511058 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-8339af70-73d4-432d-8276-02fc76cf6dbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '750dbae563b64a30a154c2ce3930df8c'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:26.535666 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 892/1784] 10.222.0.61 () {58 vars in 1018 bytes} [Fri Jun 3 13:22:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:22:26.556424 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-8339af70-73d4-432d-8276-02fc76cf6dbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '750dbae563b64a30a154c2ce3930df8c'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:26.558944 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-8339af70-73d4-432d-8276-02fc76cf6dbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '750dbae563b64a30a154c2ce3930df8c'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:26.573132 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-8339af70-73d4-432d-8276-02fc76cf6dbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '750dbae563b64a30a154c2ce3930df8c'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:26.573970 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-8339af70-73d4-432d-8276-02fc76cf6dbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '750dbae563b64a30a154c2ce3930df8c'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:26.676677 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 893/1785] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:22:26 2022] DELETE /identity/v3/users/750dbae563b64a30a154c2ce3930df8c => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:22:26.679049 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ec6d7-aef6-48f9-9afa-fb88d68ee2b8 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:26.679500 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ec6d7-aef6-48f9-9afa-fb88d68ee2b8 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:26.679854 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ec6d7-aef6-48f9-9afa-fb88d68ee2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:26.713739 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-521ec6d7-aef6-48f9-9afa-fb88d68ee2b8 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:26.721588 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-521ec6d7-aef6-48f9-9afa-fb88d68ee2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:26.890277 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 893/1786] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:22:26.905425 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339af70-73d4-432d-8276-02fc76cf6dbd admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:26.908348 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-8339af70-73d4-432d-8276-02fc76cf6dbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:26.939164 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:27.072646 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339af70-73d4-432d-8276-02fc76cf6dbd admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:27.080540 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c205b8-2d1e-4476-a0f6-186bc3211f46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:27.081579 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c205b8-2d1e-4476-a0f6-186bc3211f46 service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:27.082280 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c205b8-2d1e-4476-a0f6-186bc3211f46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:27.082989 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c205b8-2d1e-4476-a0f6-186bc3211f46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:27.095630 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c205b8-2d1e-4476-a0f6-186bc3211f46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:27.097417 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c205b8-2d1e-4476-a0f6-186bc3211f46 service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:27.113050 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 894/1787] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:22:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:22:27.241680 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ec6d7-aef6-48f9-9afa-fb88d68ee2b8 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:27.243385 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-521ec6d7-aef6-48f9-9afa-fb88d68ee2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:27.353720 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ec6d7-aef6-48f9-9afa-fb88d68ee2b8 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:27.362353 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc3b9e-1d46-4a17-ae33-a99ebdf9283b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066aaba3e9af4f85ab0cba89a3d32e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:27.363710 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc3b9e-1d46-4a17-ae33-a99ebdf9283b service nova] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:27.364136 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc3b9e-1d46-4a17-ae33-a99ebdf9283b service nova] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:27.364613 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc3b9e-1d46-4a17-ae33-a99ebdf9283b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:27.368017 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-86fc3b9e-1d46-4a17-ae33-a99ebdf9283b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:27.382864 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc3b9e-1d46-4a17-ae33-a99ebdf9283b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:27.385722 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc3b9e-1d46-4a17-ae33-a99ebdf9283b service nova] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:27.411794 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 894/1788] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:22:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:22:27.443051 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:27.625424 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c205b8-2d1e-4476-a0f6-186bc3211f46 service neutron] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:27.626967 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-f5c205b8-2d1e-4476-a0f6-186bc3211f46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:27.649717 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c205b8-2d1e-4476-a0f6-186bc3211f46 service neutron] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:27.665441 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4272641-aeee-4a93-9cde-6a7c792f8205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:27.666541 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4272641-aeee-4a93-9cde-6a7c792f8205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:27.666924 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4272641-aeee-4a93-9cde-6a7c792f8205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:27.667265 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4272641-aeee-4a93-9cde-6a7c792f8205 admin admin] PATH_INFO: `/v3/projects/db4114e716e749b1a8097c351721b35d` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:27.669216 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4272641-aeee-4a93-9cde-6a7c792f8205 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db4114e716e749b1a8097c351721b35d)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:27.671562 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4272641-aeee-4a93-9cde-6a7c792f8205 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:27.862842 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc3b9e-1d46-4a17-ae33-a99ebdf9283b service nova] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:27.864525 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-86fc3b9e-1d46-4a17-ae33-a99ebdf9283b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:27.877589 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-f4272641-aeee-4a93-9cde-6a7c792f8205 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db4114e716e749b1a8097c351721b35d', 'request_id': 'req-f4272641-aeee-4a93-9cde-6a7c792f8205'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:27.881474 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc3b9e-1d46-4a17-ae33-a99ebdf9283b service nova] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:27.897114 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-f4272641-aeee-4a93-9cde-6a7c792f8205 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db4114e716e749b1a8097c351721b35d', 'request_id': 'req-f4272641-aeee-4a93-9cde-6a7c792f8205'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:27.900043 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-f4272641-aeee-4a93-9cde-6a7c792f8205 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db4114e716e749b1a8097c351721b35d', 'request_id': 'req-f4272641-aeee-4a93-9cde-6a7c792f8205'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:27.953441 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75cf3e-1580-4d87-9ad6-f55a7c881d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:27.954388 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75cf3e-1580-4d87-9ad6-f55a7c881d90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:27.954767 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75cf3e-1580-4d87-9ad6-f55a7c881d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:27.955039 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75cf3e-1580-4d87-9ad6-f55a7c881d90 admin admin] PATH_INFO: `/v3/projects/42b037e696104bbf84c4e1b72f01e14b` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:27.956255 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f75cf3e-1580-4d87-9ad6-f55a7c881d90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42b037e696104bbf84c4e1b72f01e14b)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:27.958178 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f75cf3e-1580-4d87-9ad6-f55a7c881d90 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:27.996599 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-f4272641-aeee-4a93-9cde-6a7c792f8205 admin admin] The token cache is being invalidate because project db4114e716e749b1a8097c351721b35d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:22:27.996887 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-f4272641-aeee-4a93-9cde-6a7c792f8205 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:27.997531 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-f4272641-aeee-4a93-9cde-6a7c792f8205 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:27.999848 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 895/1789] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:22:27 2022] DELETE /identity/v3/projects/db4114e716e749b1a8097c351721b35d => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:22:28.003745 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4272641-aeee-4a93-9cde-6a7c792f8205 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:28.005232 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-f4272641-aeee-4a93-9cde-6a7c792f8205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:28.018609 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4272641-aeee-4a93-9cde-6a7c792f8205 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:28.023155 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c0d80-2383-4533-b5a0-084d443f255c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:28.024024 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c0d80-2383-4533-b5a0-084d443f255c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:28.024359 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c0d80-2383-4533-b5a0-084d443f255c admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:28.024620 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c0d80-2383-4533-b5a0-084d443f255c admin admin] PATH_INFO: `/v3/users/159836714f13436299a083613066f212` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:28.025799 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c0d80-2383-4533-b5a0-084d443f255c admin admin] RBAC: Authorizing `identity:delete_user(user_id=159836714f13436299a083613066f212)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:28.029027 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c0d80-2383-4533-b5a0-084d443f255c admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:28.066231 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-4f75cf3e-1580-4d87-9ad6-f55a7c881d90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42b037e696104bbf84c4e1b72f01e14b', 'request_id': 'req-4f75cf3e-1580-4d87-9ad6-f55a7c881d90'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:28.155585 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-4f75cf3e-1580-4d87-9ad6-f55a7c881d90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42b037e696104bbf84c4e1b72f01e14b', 'request_id': 'req-4f75cf3e-1580-4d87-9ad6-f55a7c881d90'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:28.161738 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-4f75cf3e-1580-4d87-9ad6-f55a7c881d90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42b037e696104bbf84c4e1b72f01e14b', 'request_id': 'req-4f75cf3e-1580-4d87-9ad6-f55a7c881d90'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:28.173547 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-4f75cf3e-1580-4d87-9ad6-f55a7c881d90 admin admin] The token cache is being invalidate because project 42b037e696104bbf84c4e1b72f01e14b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:22:28.173835 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-4f75cf3e-1580-4d87-9ad6-f55a7c881d90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:28.174473 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-4f75cf3e-1580-4d87-9ad6-f55a7c881d90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:28.176036 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 895/1790] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:22:27 2022] DELETE /identity/v3/projects/42b037e696104bbf84c4e1b72f01e14b => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:22:28.179843 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75cf3e-1580-4d87-9ad6-f55a7c881d90 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:28.181148 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-4f75cf3e-1580-4d87-9ad6-f55a7c881d90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:28.215424 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-599c0d80-2383-4533-b5a0-084d443f255c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '159836714f13436299a083613066f212'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:28.227760 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-599c0d80-2383-4533-b5a0-084d443f255c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '159836714f13436299a083613066f212'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:28.228468 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-599c0d80-2383-4533-b5a0-084d443f255c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '159836714f13436299a083613066f212'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:28.236205 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-599c0d80-2383-4533-b5a0-084d443f255c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '159836714f13436299a083613066f212'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:28.236884 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-599c0d80-2383-4533-b5a0-084d443f255c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '159836714f13436299a083613066f212'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:28.251499 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75cf3e-1580-4d87-9ad6-f55a7c881d90 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:28.256134 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3645840a-e437-4e6d-8649-8d770a734622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:28.257052 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645840a-e437-4e6d-8649-8d770a734622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:28.257336 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645840a-e437-4e6d-8649-8d770a734622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:28.257607 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645840a-e437-4e6d-8649-8d770a734622 admin admin] PATH_INFO: `/v3/users/7f540aa907f946c8a84cfa9c0a4c829a` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:28.258846 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3645840a-e437-4e6d-8649-8d770a734622 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f540aa907f946c8a84cfa9c0a4c829a)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:28.260821 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3645840a-e437-4e6d-8649-8d770a734622 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:28.316209 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 896/1791] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:22:28 2022] DELETE /identity/v3/users/159836714f13436299a083613066f212 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:22:28.441762 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-3645840a-e437-4e6d-8649-8d770a734622 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f540aa907f946c8a84cfa9c0a4c829a'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:28.457333 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-3645840a-e437-4e6d-8649-8d770a734622 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f540aa907f946c8a84cfa9c0a4c829a'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:28.458101 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-3645840a-e437-4e6d-8649-8d770a734622 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f540aa907f946c8a84cfa9c0a4c829a'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:28.465585 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-3645840a-e437-4e6d-8649-8d770a734622 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f540aa907f946c8a84cfa9c0a4c829a'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:28.466294 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-3645840a-e437-4e6d-8649-8d770a734622 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f540aa907f946c8a84cfa9c0a4c829a'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:28.546757 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 896/1792] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:22:28 2022] DELETE /identity/v3/users/7f540aa907f946c8a84cfa9c0a4c829a => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:22:28.762206 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:28.930464 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c0d80-2383-4533-b5a0-084d443f255c admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:28.932350 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-599c0d80-2383-4533-b5a0-084d443f255c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:29.040954 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c0d80-2383-4533-b5a0-084d443f255c admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:29.104101 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb105c2-b10e-4bae-9b8a-5509ded0125f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:29.105338 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb105c2-b10e-4bae-9b8a-5509ded0125f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:29.105338 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb105c2-b10e-4bae-9b8a-5509ded0125f admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:29.105591 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb105c2-b10e-4bae-9b8a-5509ded0125f admin admin] PATH_INFO: `/v3/projects/70682116527c421c8123f04f7ba73c5b` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:29.106819 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb105c2-b10e-4bae-9b8a-5509ded0125f admin admin] RBAC: Authorizing `identity:delete_project(project_id=70682116527c421c8123f04f7ba73c5b)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:29.109454 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb105c2-b10e-4bae-9b8a-5509ded0125f admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:29.228679 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-1bb105c2-b10e-4bae-9b8a-5509ded0125f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70682116527c421c8123f04f7ba73c5b', 'request_id': 'req-1bb105c2-b10e-4bae-9b8a-5509ded0125f'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:29.237405 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-1bb105c2-b10e-4bae-9b8a-5509ded0125f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70682116527c421c8123f04f7ba73c5b', 'request_id': 'req-1bb105c2-b10e-4bae-9b8a-5509ded0125f'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:29.246052 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-1bb105c2-b10e-4bae-9b8a-5509ded0125f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70682116527c421c8123f04f7ba73c5b', 'request_id': 'req-1bb105c2-b10e-4bae-9b8a-5509ded0125f'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:29.363994 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-1bb105c2-b10e-4bae-9b8a-5509ded0125f admin admin] The token cache is being invalidate because project 70682116527c421c8123f04f7ba73c5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:22:29.364387 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-1bb105c2-b10e-4bae-9b8a-5509ded0125f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:29.365254 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-1bb105c2-b10e-4bae-9b8a-5509ded0125f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:29.365549 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3645840a-e437-4e6d-8649-8d770a734622 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:29.367303 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-3645840a-e437-4e6d-8649-8d770a734622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:29.369440 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 897/1793] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:22:28 2022] DELETE /identity/v3/projects/70682116527c421c8123f04f7ba73c5b => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:22:29.374743 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf1dc1-e634-40ac-a866-4e7896c7b7a0 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:29.375364 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf1dc1-e634-40ac-a866-4e7896c7b7a0 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:29.376325 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf1dc1-e634-40ac-a866-4e7896c7b7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:29.392880 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3645840a-e437-4e6d-8649-8d770a734622 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:29.403359 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-eecf1dc1-e634-40ac-a866-4e7896c7b7a0 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:29.403359 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-eecf1dc1-e634-40ac-a866-4e7896c7b7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:29.461116 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9dd6b6-b457-4212-a079-5df598e072a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:29.462567 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9dd6b6-b457-4212-a079-5df598e072a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:29.463070 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9dd6b6-b457-4212-a079-5df598e072a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:29.463556 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9dd6b6-b457-4212-a079-5df598e072a2 admin admin] PATH_INFO: `/v3/projects/42ccb73a5c9945f99312d2838f6f0f05` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:29.464916 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9dd6b6-b457-4212-a079-5df598e072a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42ccb73a5c9945f99312d2838f6f0f05)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:29.466872 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9dd6b6-b457-4212-a079-5df598e072a2 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:29.483412 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 898/1794] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:22:29.485783 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86235692-9591-42db-b2d9-cbade3fc5981 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:29.486075 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86235692-9591-42db-b2d9-cbade3fc5981 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:29.486367 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86235692-9591-42db-b2d9-cbade3fc5981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:29.511060 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-86235692-9591-42db-b2d9-cbade3fc5981 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:29.512332 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-86235692-9591-42db-b2d9-cbade3fc5981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:29.525045 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 899/1795] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:22:29.529582 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86235692-9591-42db-b2d9-cbade3fc5981 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:29.539359 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86235692-9591-42db-b2d9-cbade3fc5981 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:29.544767 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd711271-d711-4848-bcdd-b33adcd5d923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:29.545596 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd711271-d711-4848-bcdd-b33adcd5d923 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:29.545881 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd711271-d711-4848-bcdd-b33adcd5d923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:29.546147 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd711271-d711-4848-bcdd-b33adcd5d923 admin admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:29.546862 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd711271-d711-4848-bcdd-b33adcd5d923 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:22:29.548404 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd711271-d711-4848-bcdd-b33adcd5d923 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:29.548970 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd711271-d711-4848-bcdd-b33adcd5d923 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:29.564756 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 900/1796] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:22:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:22:29.570991 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd711271-d711-4848-bcdd-b33adcd5d923 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:29.582780 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd711271-d711-4848-bcdd-b33adcd5d923 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:29.593648 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-5a9dd6b6-b457-4212-a079-5df598e072a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42ccb73a5c9945f99312d2838f6f0f05', 'request_id': 'req-5a9dd6b6-b457-4212-a079-5df598e072a2'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:29.646532 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26df48-061b-440d-aad3-fa14498268f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:29.647233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26df48-061b-440d-aad3-fa14498268f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:29.647514 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26df48-061b-440d-aad3-fa14498268f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:29.647829 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26df48-061b-440d-aad3-fa14498268f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:29.648589 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd26df48-061b-440d-aad3-fa14498268f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:29.650552 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd26df48-061b-440d-aad3-fa14498268f7 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:29.671345 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-5a9dd6b6-b457-4212-a079-5df598e072a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42ccb73a5c9945f99312d2838f6f0f05', 'request_id': 'req-5a9dd6b6-b457-4212-a079-5df598e072a2'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:29.678287 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-5a9dd6b6-b457-4212-a079-5df598e072a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42ccb73a5c9945f99312d2838f6f0f05', 'request_id': 'req-5a9dd6b6-b457-4212-a079-5df598e072a2'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:29.691274 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-5a9dd6b6-b457-4212-a079-5df598e072a2 admin admin] The token cache is being invalidate because project 42ccb73a5c9945f99312d2838f6f0f05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:22:29.691562 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-5a9dd6b6-b457-4212-a079-5df598e072a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:29.692346 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-5a9dd6b6-b457-4212-a079-5df598e072a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:29.693913 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 897/1797] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:22:29 2022] DELETE /identity/v3/projects/42ccb73a5c9945f99312d2838f6f0f05 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:22:29.698716 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d59389-61bc-4515-9b4f-91046f932fc9 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:29.698986 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d59389-61bc-4515-9b4f-91046f932fc9 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:29.699310 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d59389-61bc-4515-9b4f-91046f932fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:29.720780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-28d59389-61bc-4515-9b4f-91046f932fc9 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:29.722018 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-28d59389-61bc-4515-9b4f-91046f932fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:29.729903 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 898/1798] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:22:29.738182 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36c7a8-fbbc-40c1-a12f-5d80e4197ae0 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:29.738452 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36c7a8-fbbc-40c1-a12f-5d80e4197ae0 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:29.738755 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36c7a8-fbbc-40c1-a12f-5d80e4197ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:29.756310 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-de36c7a8-fbbc-40c1-a12f-5d80e4197ae0 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:29.757490 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-de36c7a8-fbbc-40c1-a12f-5d80e4197ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:29.765300 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 899/1799] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:22:29.769299 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de36c7a8-fbbc-40c1-a12f-5d80e4197ae0 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:29.778026 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de36c7a8-fbbc-40c1-a12f-5d80e4197ae0 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:29.781240 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 901/1800] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:22:29 2022] POST /identity/v3/projects => generated 379 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:22:29.783217 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dcc363-9ce5-4a14-b129-a23670110dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:29.783879 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dcc363-9ce5-4a14-b129-a23670110dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:29.784185 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dcc363-9ce5-4a14-b129-a23670110dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:29.784467 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dcc363-9ce5-4a14-b129-a23670110dc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:29.785189 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dcc363-9ce5-4a14-b129-a23670110dc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:22:29.785465 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26df48-061b-440d-aad3-fa14498268f7 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:29.785569 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dcc363-9ce5-4a14-b129-a23670110dc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:29.787079 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dcc363-9ce5-4a14-b129-a23670110dc2 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:29.787242 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-bd26df48-061b-440d-aad3-fa14498268f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:29.799574 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 900/1801] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:22:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:22:29.803869 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dcc363-9ce5-4a14-b129-a23670110dc2 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:29.814083 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dcc363-9ce5-4a14-b129-a23670110dc2 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:29.850840 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26df48-061b-440d-aad3-fa14498268f7 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:29.856309 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b585b6-b850-4246-9414-da4bc8bb9008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:29.856937 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b585b6-b850-4246-9414-da4bc8bb9008 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:29.857270 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b585b6-b850-4246-9414-da4bc8bb9008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:29.857546 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b585b6-b850-4246-9414-da4bc8bb9008 admin admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:29.858956 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b585b6-b850-4246-9414-da4bc8bb9008 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:29.860868 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b585b6-b850-4246-9414-da4bc8bb9008 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:29.873004 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2259ff-67bc-49e4-b28c-397b3ca13f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:29.873669 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2259ff-67bc-49e4-b28c-397b3ca13f14 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:29.873955 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2259ff-67bc-49e4-b28c-397b3ca13f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:29.874230 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2259ff-67bc-49e4-b28c-397b3ca13f14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:29.878101 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2259ff-67bc-49e4-b28c-397b3ca13f14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:29.878101 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2259ff-67bc-49e4-b28c-397b3ca13f14 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:30.025528 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 902/1802] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:22:29 2022] POST /identity/v3/users => generated 290 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:22:30.033830 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b585b6-b850-4246-9414-da4bc8bb9008 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:30.043692 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b585b6-b850-4246-9414-da4bc8bb9008 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:30.049522 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68050a35-22ac-4e31-8ac1-7cbfa4ffbc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:30.050254 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68050a35-22ac-4e31-8ac1-7cbfa4ffbc24 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:30.050606 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68050a35-22ac-4e31-8ac1-7cbfa4ffbc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:30.050952 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68050a35-22ac-4e31-8ac1-7cbfa4ffbc24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:30.051747 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68050a35-22ac-4e31-8ac1-7cbfa4ffbc24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:30.053451 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68050a35-22ac-4e31-8ac1-7cbfa4ffbc24 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:30.059440 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 901/1803] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:22:29 2022] POST /identity/v3/projects => generated 387 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:22:30.062947 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2259ff-67bc-49e4-b28c-397b3ca13f14 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:30.064315 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 903/1804] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:22:30.067953 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68050a35-22ac-4e31-8ac1-7cbfa4ffbc24 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:30.079159 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68050a35-22ac-4e31-8ac1-7cbfa4ffbc24 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:30.118166 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:30.134718 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2259ff-67bc-49e4-b28c-397b3ca13f14 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:30.140438 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34380a7b-e8b6-4d45-9519-63b0f9109962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:30.141166 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34380a7b-e8b6-4d45-9519-63b0f9109962 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:30.141537 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34380a7b-e8b6-4d45-9519-63b0f9109962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:30.141830 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34380a7b-e8b6-4d45-9519-63b0f9109962 admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:30.142694 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4dcd47-c4a7-44ae-b147-da5de436ae65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:30.142818 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34380a7b-e8b6-4d45-9519-63b0f9109962 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:30.143845 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4dcd47-c4a7-44ae-b147-da5de436ae65 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:30.144357 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4dcd47-c4a7-44ae-b147-da5de436ae65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:30.144813 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4dcd47-c4a7-44ae-b147-da5de436ae65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:30.144921 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34380a7b-e8b6-4d45-9519-63b0f9109962 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:30.145717 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4dcd47-c4a7-44ae-b147-da5de436ae65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:30.147561 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4dcd47-c4a7-44ae-b147-da5de436ae65 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:30.162997 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 904/1805] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:22:30.164089 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4dcd47-c4a7-44ae-b147-da5de436ae65 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:30.175842 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4dcd47-c4a7-44ae-b147-da5de436ae65 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:30.180876 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4ab54-f22a-47f3-b3da-12d1d4040036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:30.181779 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4ab54-f22a-47f3-b3da-12d1d4040036 admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:30.182065 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4ab54-f22a-47f3-b3da-12d1d4040036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:30.182342 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4ab54-f22a-47f3-b3da-12d1d4040036 admin admin] PATH_INFO: `/v3/projects/622c17c4188e4650a743cb53bc7eaf14/users/a611866c260d4e3597ad296e98601829/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:30.199920 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b4ab54-f22a-47f3-b3da-12d1d4040036 admin admin] RBAC: Authorizing `identity:create_grant(project_id=622c17c4188e4650a743cb53bc7eaf14, user_id=a611866c260d4e3597ad296e98601829, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:30.203616 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b4ab54-f22a-47f3-b3da-12d1d4040036 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:30.220592 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 902/1806] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:22:30 2022] POST /identity/v3/users => generated 294 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:22:30.223443 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34380a7b-e8b6-4d45-9519-63b0f9109962 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:30.233798 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34380a7b-e8b6-4d45-9519-63b0f9109962 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:30.238364 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66ce8f-1dd1-4f7e-b115-2926699bb302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:30.238987 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66ce8f-1dd1-4f7e-b115-2926699bb302 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:30.239268 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66ce8f-1dd1-4f7e-b115-2926699bb302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:30.239538 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66ce8f-1dd1-4f7e-b115-2926699bb302 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:30.240313 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a66ce8f-1dd1-4f7e-b115-2926699bb302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:30.241984 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a66ce8f-1dd1-4f7e-b115-2926699bb302 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:30.253045 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 903/1807] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:22:30.260359 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66ce8f-1dd1-4f7e-b115-2926699bb302 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:30.270031 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66ce8f-1dd1-4f7e-b115-2926699bb302 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:30.274546 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff46a8-f020-4de1-9dec-4172dacedd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:30.275240 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff46a8-f020-4de1-9dec-4172dacedd18 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:30.275521 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff46a8-f020-4de1-9dec-4172dacedd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:30.275794 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff46a8-f020-4de1-9dec-4172dacedd18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:30.276644 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff46a8-f020-4de1-9dec-4172dacedd18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:30.278209 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff46a8-f020-4de1-9dec-4172dacedd18 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:30.288955 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 904/1808] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:22:30.293162 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff46a8-f020-4de1-9dec-4172dacedd18 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:30.304524 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff46a8-f020-4de1-9dec-4172dacedd18 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:30.309456 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5b363-cb93-4233-9cdb-17b019ff5a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:30.310389 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5b363-cb93-4233-9cdb-17b019ff5a95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:30.310674 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5b363-cb93-4233-9cdb-17b019ff5a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:30.311618 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5b363-cb93-4233-9cdb-17b019ff5a95 admin admin] PATH_INFO: `/v3/projects/b62a3511df024e2bbab4309c4cddf18b/users/7a409fa1ced643079d7c2e61bc9d75b6/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:30.319424 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 905/1809] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:22:30 2022] PUT /identity/v3/projects/622c17c4188e4650a743cb53bc7eaf14/users/a611866c260d4e3597ad296e98601829/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:22:30.329020 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba5b363-cb93-4233-9cdb-17b019ff5a95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b62a3511df024e2bbab4309c4cddf18b, user_id=7a409fa1ced643079d7c2e61bc9d75b6, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:30.331947 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba5b363-cb93-4233-9cdb-17b019ff5a95 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:30.332498 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec3b11-5f6c-4619-89b7-bc0d191d1ecf None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:30.332908 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec3b11-5f6c-4619-89b7-bc0d191d1ecf None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:30.333284 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec3b11-5f6c-4619-89b7-bc0d191d1ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:30.348095 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:30.365281 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-65ec3b11-5f6c-4619-89b7-bc0d191d1ecf None None] MFA Rules not processed for user `a611866c260d4e3597ad296e98601829`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:30.366564 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-65ec3b11-5f6c-4619-89b7-bc0d191d1ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:30.414824 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 905/1810] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:22:30 2022] PUT /identity/v3/projects/b62a3511df024e2bbab4309c4cddf18b/users/7a409fa1ced643079d7c2e61bc9d75b6/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:22:30.429232 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd150665-850e-4720-bef8-b0f5b76c3dbb None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:30.429559 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd150665-850e-4720-bef8-b0f5b76c3dbb None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:30.430043 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd150665-850e-4720-bef8-b0f5b76c3dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:30.438569 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 906/1811] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:22:30.444729 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec3b11-5f6c-4619-89b7-bc0d191d1ecf None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:30.459025 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-dd150665-850e-4720-bef8-b0f5b76c3dbb None None] MFA Rules not processed for user `7a409fa1ced643079d7c2e61bc9d75b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:30.460283 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-dd150665-850e-4720-bef8-b0f5b76c3dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:30.518625 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec3b11-5f6c-4619-89b7-bc0d191d1ecf None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:30.532693 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 906/1812] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:22:30.536767 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd150665-850e-4720-bef8-b0f5b76c3dbb None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:30.582451 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94542fd-ff5c-40a8-8730-fae34ce0cd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:30.583111 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94542fd-ff5c-40a8-8730-fae34ce0cd2c admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:30.583533 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94542fd-ff5c-40a8-8730-fae34ce0cd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:30.583814 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94542fd-ff5c-40a8-8730-fae34ce0cd2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:30.584543 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94542fd-ff5c-40a8-8730-fae34ce0cd2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:30.586473 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94542fd-ff5c-40a8-8730-fae34ce0cd2c admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:30.589644 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:30.607544 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd150665-850e-4720-bef8-b0f5b76c3dbb None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:30.612516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b4526-1a52-4e70-8ac2-52e399543a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:30.613178 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b4526-1a52-4e70-8ac2-52e399543a5f admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:30.613464 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b4526-1a52-4e70-8ac2-52e399543a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:30.615926 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b4526-1a52-4e70-8ac2-52e399543a5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:30.615926 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b4526-1a52-4e70-8ac2-52e399543a5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:30.616351 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b4526-1a52-4e70-8ac2-52e399543a5f admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:30.675643 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 907/1813] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:22:30 2022] POST /identity/v3/projects => generated 381 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:22:30.679538 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94542fd-ff5c-40a8-8730-fae34ce0cd2c admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:30.700241 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 907/1814] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:22:30 2022] POST /identity/v3/projects => generated 387 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:22:30.706112 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b4526-1a52-4e70-8ac2-52e399543a5f admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:30.746670 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94542fd-ff5c-40a8-8730-fae34ce0cd2c admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:30.779983 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b4526-1a52-4e70-8ac2-52e399543a5f admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:30.785367 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84340eae-46fa-4392-8fc4-9bae43609bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:30.786198 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84340eae-46fa-4392-8fc4-9bae43609bb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:30.786592 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84340eae-46fa-4392-8fc4-9bae43609bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:30.786972 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84340eae-46fa-4392-8fc4-9bae43609bb4 admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:30.787770 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84340eae-46fa-4392-8fc4-9bae43609bb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:30.790262 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84340eae-46fa-4392-8fc4-9bae43609bb4 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:30.817696 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367e73b8-fa71-43e9-9e92-2faa74b7fb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:30.818759 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e73b8-fa71-43e9-9e92-2faa74b7fb95 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:30.819197 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e73b8-fa71-43e9-9e92-2faa74b7fb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:30.819539 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e73b8-fa71-43e9-9e92-2faa74b7fb95 admin admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:30.820346 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367e73b8-fa71-43e9-9e92-2faa74b7fb95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:30.822393 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367e73b8-fa71-43e9-9e92-2faa74b7fb95 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:30.883103 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 908/1815] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:22:30 2022] POST /identity/v3/users => generated 294 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:22:30.887043 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84340eae-46fa-4392-8fc4-9bae43609bb4 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:30.897521 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84340eae-46fa-4392-8fc4-9bae43609bb4 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:30.902495 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c219ab-6b1e-4aaa-884d-b27c67453c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:30.903204 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c219ab-6b1e-4aaa-884d-b27c67453c77 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:30.903834 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c219ab-6b1e-4aaa-884d-b27c67453c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:30.903834 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c219ab-6b1e-4aaa-884d-b27c67453c77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:30.904585 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c219ab-6b1e-4aaa-884d-b27c67453c77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:30.906707 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c219ab-6b1e-4aaa-884d-b27c67453c77 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:30.914868 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 908/1816] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:22:30 2022] POST /identity/v3/users => generated 297 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:22:30.918143 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 909/1817] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:22:30.925803 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c219ab-6b1e-4aaa-884d-b27c67453c77 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:30.926734 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367e73b8-fa71-43e9-9e92-2faa74b7fb95 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:30.937525 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c219ab-6b1e-4aaa-884d-b27c67453c77 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:30.938352 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367e73b8-fa71-43e9-9e92-2faa74b7fb95 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:30.942431 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada96d4-7c61-4190-be2b-d43bb028bdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:30.943099 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada96d4-7c61-4190-be2b-d43bb028bdb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:30.943386 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada96d4-7c61-4190-be2b-d43bb028bdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:30.943680 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada96d4-7c61-4190-be2b-d43bb028bdb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:30.944417 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada96d4-7c61-4190-be2b-d43bb028bdb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:30.946029 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada96d4-7c61-4190-be2b-d43bb028bdb6 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:30.948672 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df13d8-13bb-4052-b438-4c4f89de19ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:30.949349 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df13d8-13bb-4052-b438-4c4f89de19ea admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:30.949634 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df13d8-13bb-4052-b438-4c4f89de19ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:30.949910 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df13d8-13bb-4052-b438-4c4f89de19ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:30.950635 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df13d8-13bb-4052-b438-4c4f89de19ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:30.952398 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df13d8-13bb-4052-b438-4c4f89de19ea admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:30.958360 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 910/1818] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:22:30.962764 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada96d4-7c61-4190-be2b-d43bb028bdb6 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:30.965336 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 909/1819] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:22:30.974378 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada96d4-7c61-4190-be2b-d43bb028bdb6 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:30.975775 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df13d8-13bb-4052-b438-4c4f89de19ea admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:30.980268 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a51d94-0954-458f-9a74-c7c9fa8b7411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:30.980268 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a51d94-0954-458f-9a74-c7c9fa8b7411 admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:30.980268 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a51d94-0954-458f-9a74-c7c9fa8b7411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:30.980838 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a51d94-0954-458f-9a74-c7c9fa8b7411 admin admin] PATH_INFO: `/v3/projects/c7fed3d8462e4390a206ffdd3d7f05ef/users/5a5b2aa5b80b41baa6f425fbed54913f/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:30.986787 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df13d8-13bb-4052-b438-4c4f89de19ea admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:30.996600 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85e459-e9ce-448f-b412-bf4d685872d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:31.000652 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85e459-e9ce-448f-b412-bf4d685872d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:31.000652 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85e459-e9ce-448f-b412-bf4d685872d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:31.000652 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85e459-e9ce-448f-b412-bf4d685872d8 admin admin] PATH_INFO: `/v3/projects/05f2410ef50a45a2b1c91e414abf26bc/users/a445cb3f4a02450986e02b43bdd68ca3/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:31.010459 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a51d94-0954-458f-9a74-c7c9fa8b7411 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7fed3d8462e4390a206ffdd3d7f05ef, user_id=5a5b2aa5b80b41baa6f425fbed54913f, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:31.020981 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a51d94-0954-458f-9a74-c7c9fa8b7411 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:31.054275 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d85e459-e9ce-448f-b412-bf4d685872d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05f2410ef50a45a2b1c91e414abf26bc, user_id=a445cb3f4a02450986e02b43bdd68ca3, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:31.057160 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d85e459-e9ce-448f-b412-bf4d685872d8 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:31.108353 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 911/1820] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:22:30 2022] PUT /identity/v3/projects/c7fed3d8462e4390a206ffdd3d7f05ef/users/5a5b2aa5b80b41baa6f425fbed54913f/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:22:31.118738 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b926aa9-e897-4c7e-b564-6cd0a6543d30 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:31.119028 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b926aa9-e897-4c7e-b564-6cd0a6543d30 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:31.119311 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b926aa9-e897-4c7e-b564-6cd0a6543d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:31.130796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 910/1821] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:22:30 2022] PUT /identity/v3/projects/05f2410ef50a45a2b1c91e414abf26bc/users/a445cb3f4a02450986e02b43bdd68ca3/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:22:31.136868 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85e459-e9ce-448f-b412-bf4d685872d8 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:31.151667 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-0b926aa9-e897-4c7e-b564-6cd0a6543d30 None None] MFA Rules not processed for user `5a5b2aa5b80b41baa6f425fbed54913f`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:31.152891 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-0b926aa9-e897-4c7e-b564-6cd0a6543d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:31.222969 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85e459-e9ce-448f-b412-bf4d685872d8 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:31.227873 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000fa95b-4b40-457f-b6e6-92a36d18dafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:31.228596 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fa95b-4b40-457f-b6e6-92a36d18dafd admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:31.228851 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fa95b-4b40-457f-b6e6-92a36d18dafd admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:31.229128 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fa95b-4b40-457f-b6e6-92a36d18dafd admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:31.229875 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000fa95b-4b40-457f-b6e6-92a36d18dafd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:31.231419 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000fa95b-4b40-457f-b6e6-92a36d18dafd admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:31.256738 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 911/1822] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:22:31.258236 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 912/1823] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:22:31.265004 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b926aa9-e897-4c7e-b564-6cd0a6543d30 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:31.269901 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000fa95b-4b40-457f-b6e6-92a36d18dafd admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:31.278835 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:31.285599 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000fa95b-4b40-457f-b6e6-92a36d18dafd admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:31.288947 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b926aa9-e897-4c7e-b564-6cd0a6543d30 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:31.289341 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62491736-e53f-48da-8766-30d9fb663458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:31.290667 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62491736-e53f-48da-8766-30d9fb663458 admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:31.290957 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62491736-e53f-48da-8766-30d9fb663458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:31.291240 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62491736-e53f-48da-8766-30d9fb663458 admin admin] PATH_INFO: `/v3/projects/05f2410ef50a45a2b1c91e414abf26bc/users/a445cb3f4a02450986e02b43bdd68ca3/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:31.293885 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62491736-e53f-48da-8766-30d9fb663458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05f2410ef50a45a2b1c91e414abf26bc, user_id=a445cb3f4a02450986e02b43bdd68ca3, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:31.294960 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc61b28c-eeb3-41d4-94c9-9fdc29be75b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:31.296090 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61b28c-eeb3-41d4-94c9-9fdc29be75b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:31.296496 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61b28c-eeb3-41d4-94c9-9fdc29be75b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:31.297407 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61b28c-eeb3-41d4-94c9-9fdc29be75b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:31.298415 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc61b28c-eeb3-41d4-94c9-9fdc29be75b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:31.300456 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc61b28c-eeb3-41d4-94c9-9fdc29be75b2 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:31.300877 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62491736-e53f-48da-8766-30d9fb663458 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:31.313238 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 912/1824] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:22:31 2022] PUT /identity/v3/projects/05f2410ef50a45a2b1c91e414abf26bc/users/a445cb3f4a02450986e02b43bdd68ca3/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:22:31.325181 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a384cd-0fe7-410c-b173-6e3d567bfef4 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:31.326134 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a384cd-0fe7-410c-b173-6e3d567bfef4 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:31.326838 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a384cd-0fe7-410c-b173-6e3d567bfef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:31.360978 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-85a384cd-0fe7-410c-b173-6e3d567bfef4 None None] MFA Rules not processed for user `a445cb3f4a02450986e02b43bdd68ca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:31.362857 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-85a384cd-0fe7-410c-b173-6e3d567bfef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:31.397875 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 913/1825] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:22:31 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:22:31.402138 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc61b28c-eeb3-41d4-94c9-9fdc29be75b2 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:31.452217 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 913/1826] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:31 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:22:31.466357 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a384cd-0fe7-410c-b173-6e3d567bfef4 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:31.473086 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-85a384cd-0fe7-410c-b173-6e3d567bfef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:31.556824 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc61b28c-eeb3-41d4-94c9-9fdc29be75b2 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:31.565757 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e49ad1-b3a1-463e-a326-e7401527c221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:31.566453 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e49ad1-b3a1-463e-a326-e7401527c221 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:31.566762 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e49ad1-b3a1-463e-a326-e7401527c221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:31.567040 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e49ad1-b3a1-463e-a326-e7401527c221 admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:31.567739 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e49ad1-b3a1-463e-a326-e7401527c221 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:31.570944 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e49ad1-b3a1-463e-a326-e7401527c221 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:31.584686 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a384cd-0fe7-410c-b173-6e3d567bfef4 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:31.672343 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a995830-38a8-420e-8f3e-33edebdb17ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:31.673009 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a995830-38a8-420e-8f3e-33edebdb17ba service cinder] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:31.673306 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a995830-38a8-420e-8f3e-33edebdb17ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:31.673569 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a995830-38a8-420e-8f3e-33edebdb17ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:31.688882 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 914/1827] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:22:31 2022] POST /identity/v3/users => generated 299 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:22:31.692498 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e49ad1-b3a1-463e-a326-e7401527c221 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:31.708501 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e49ad1-b3a1-463e-a326-e7401527c221 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:31.726666 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd74bd-d4b0-4da6-94fd-558560619420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:31.727226 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd74bd-d4b0-4da6-94fd-558560619420 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:31.727508 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd74bd-d4b0-4da6-94fd-558560619420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:31.727784 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd74bd-d4b0-4da6-94fd-558560619420 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:31.728538 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd74bd-d4b0-4da6-94fd-558560619420 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:31.730319 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd74bd-d4b0-4da6-94fd-558560619420 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:31.753809 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 915/1828] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:22:31.758479 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd74bd-d4b0-4da6-94fd-558560619420 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:31.781134 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd74bd-d4b0-4da6-94fd-558560619420 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:31.794394 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5ff7c-91f2-4e38-a06d-8f62e9b8230b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:31.796453 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5ff7c-91f2-4e38-a06d-8f62e9b8230b admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:31.799108 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5ff7c-91f2-4e38-a06d-8f62e9b8230b admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:31.799455 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5ff7c-91f2-4e38-a06d-8f62e9b8230b admin admin] PATH_INFO: `/v3/projects/7d2d68f519a74e1d894dc44db13bbb9d/users/147b40dea3f34e93b7a88308e446ff4c/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:31.812767 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a995830-38a8-420e-8f3e-33edebdb17ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:31.814252 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a995830-38a8-420e-8f3e-33edebdb17ba service cinder] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:31.832341 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:31.837851 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5ff7c-91f2-4e38-a06d-8f62e9b8230b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d2d68f519a74e1d894dc44db13bbb9d, user_id=147b40dea3f34e93b7a88308e446ff4c, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:31.844085 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 914/1829] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:22:31 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:22:31.856812 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5ff7c-91f2-4e38-a06d-8f62e9b8230b admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:31.979993 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 916/1830] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:22:31 2022] PUT /identity/v3/projects/7d2d68f519a74e1d894dc44db13bbb9d/users/147b40dea3f34e93b7a88308e446ff4c/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:22:31.984214 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a995830-38a8-420e-8f3e-33edebdb17ba service cinder] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:31.997226 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a995830-38a8-420e-8f3e-33edebdb17ba service cinder] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:32.061599 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6051a8-f736-43d8-8f6f-43fedef6e172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:32.062339 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6051a8-f736-43d8-8f6f-43fedef6e172 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:32.062621 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6051a8-f736-43d8-8f6f-43fedef6e172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:32.062892 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6051a8-f736-43d8-8f6f-43fedef6e172 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:32.063703 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6051a8-f736-43d8-8f6f-43fedef6e172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:32.065718 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6051a8-f736-43d8-8f6f-43fedef6e172 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:32.081934 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 915/1831] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:22:32.087016 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5ff7c-91f2-4e38-a06d-8f62e9b8230b admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:32.100466 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5ff7c-91f2-4e38-a06d-8f62e9b8230b admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:32.105919 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42ccea-ae30-442a-868d-e58936ae57ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:32.107413 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42ccea-ae30-442a-868d-e58936ae57ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:32.107413 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42ccea-ae30-442a-868d-e58936ae57ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:32.107633 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42ccea-ae30-442a-868d-e58936ae57ac admin admin] PATH_INFO: `/v3/projects/7d2d68f519a74e1d894dc44db13bbb9d/users/147b40dea3f34e93b7a88308e446ff4c/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:32.111148 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b42ccea-ae30-442a-868d-e58936ae57ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d2d68f519a74e1d894dc44db13bbb9d, user_id=147b40dea3f34e93b7a88308e446ff4c, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:32.113961 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b42ccea-ae30-442a-868d-e58936ae57ac admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:32.126840 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 917/1832] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:22:32 2022] PUT /identity/v3/projects/7d2d68f519a74e1d894dc44db13bbb9d/users/147b40dea3f34e93b7a88308e446ff4c/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:22:32.151824 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587ffa4-8123-4622-be9a-69474184d792 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:32.152122 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587ffa4-8123-4622-be9a-69474184d792 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:32.152417 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587ffa4-8123-4622-be9a-69474184d792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:32.185545 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-8587ffa4-8123-4622-be9a-69474184d792 None None] MFA Rules not processed for user `147b40dea3f34e93b7a88308e446ff4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:32.187598 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-8587ffa4-8123-4622-be9a-69474184d792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:32.260184 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 916/1833] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:32 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:22:32.271666 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42ccea-ae30-442a-868d-e58936ae57ac admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:32.330357 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42ccea-ae30-442a-868d-e58936ae57ac admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:32.334109 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db494147-6948-4157-97c7-9d34784bfa91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:32.334757 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db494147-6948-4157-97c7-9d34784bfa91 service cinder] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:32.335040 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db494147-6948-4157-97c7-9d34784bfa91 service cinder] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:32.335314 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db494147-6948-4157-97c7-9d34784bfa91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:32.345388 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db494147-6948-4157-97c7-9d34784bfa91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:32.346994 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db494147-6948-4157-97c7-9d34784bfa91 service cinder] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:32.357094 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 918/1834] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:22:32 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:22:32.908535 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587ffa4-8123-4622-be9a-69474184d792 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:32.972364 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587ffa4-8123-4622-be9a-69474184d792 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:32.977219 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ac73a-be41-41f6-8d24-e15755e5a5a9 tempest-VolumeQuotaClassesTest-1394010048 tempest-VolumeQuotaClassesTest-1394010048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a445cb3f4a02450986e02b43bdd68ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05f2410ef50a45a2b1c91e414abf26bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:32.982963 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ac73a-be41-41f6-8d24-e15755e5a5a9 tempest-VolumeQuotaClassesTest-1394010048 tempest-VolumeQuotaClassesTest-1394010048-project-admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:32.982963 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ac73a-be41-41f6-8d24-e15755e5a5a9 tempest-VolumeQuotaClassesTest-1394010048 tempest-VolumeQuotaClassesTest-1394010048-project-admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:32.982963 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ac73a-be41-41f6-8d24-e15755e5a5a9 tempest-VolumeQuotaClassesTest-1394010048 tempest-VolumeQuotaClassesTest-1394010048-project-admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:32.982963 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58ac73a-be41-41f6-8d24-e15755e5a5a9 tempest-VolumeQuotaClassesTest-1394010048 tempest-VolumeQuotaClassesTest-1394010048-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:22:32.982963 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58ac73a-be41-41f6-8d24-e15755e5a5a9 tempest-VolumeQuotaClassesTest-1394010048 tempest-VolumeQuotaClassesTest-1394010048-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:32.983441 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58ac73a-be41-41f6-8d24-e15755e5a5a9 tempest-VolumeQuotaClassesTest-1394010048 tempest-VolumeQuotaClassesTest-1394010048-project-admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:32.996534 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 917/1835] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:22:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:22:33.001609 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db494147-6948-4157-97c7-9d34784bfa91 service cinder] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:33.013362 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db494147-6948-4157-97c7-9d34784bfa91 service cinder] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:33.018739 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6daff-7cbc-41fb-8d2d-b2f830d15cc7 tempest-VolumeQuotaClassesTest-1394010048 tempest-VolumeQuotaClassesTest-1394010048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a445cb3f4a02450986e02b43bdd68ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05f2410ef50a45a2b1c91e414abf26bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:33.019462 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6daff-7cbc-41fb-8d2d-b2f830d15cc7 tempest-VolumeQuotaClassesTest-1394010048 tempest-VolumeQuotaClassesTest-1394010048-project-admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:33.019752 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6daff-7cbc-41fb-8d2d-b2f830d15cc7 tempest-VolumeQuotaClassesTest-1394010048 tempest-VolumeQuotaClassesTest-1394010048-project-admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:33.020005 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6daff-7cbc-41fb-8d2d-b2f830d15cc7 tempest-VolumeQuotaClassesTest-1394010048 tempest-VolumeQuotaClassesTest-1394010048-project-admin] PATH_INFO: `/v3/projects` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:33.020725 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f6daff-7cbc-41fb-8d2d-b2f830d15cc7 tempest-VolumeQuotaClassesTest-1394010048 tempest-VolumeQuotaClassesTest-1394010048-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:33.022627 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f6daff-7cbc-41fb-8d2d-b2f830d15cc7 tempest-VolumeQuotaClassesTest-1394010048 tempest-VolumeQuotaClassesTest-1394010048-project-admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:33.140886 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 919/1836] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:22:33 2022] POST /identity/v3/projects => generated 354 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:22:33.144849 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ac73a-be41-41f6-8d24-e15755e5a5a9 tempest-VolumeQuotaClassesTest-1394010048 tempest-VolumeQuotaClassesTest-1394010048-project-admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:33.154895 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ac73a-be41-41f6-8d24-e15755e5a5a9 tempest-VolumeQuotaClassesTest-1394010048 tempest-VolumeQuotaClassesTest-1394010048-project-admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:33.211308 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a7673-e532-42cc-8af3-f643ab6bf115 tempest-VolumeQuotaClassesTest-1394010048 tempest-VolumeQuotaClassesTest-1394010048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a445cb3f4a02450986e02b43bdd68ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05f2410ef50a45a2b1c91e414abf26bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:33.211972 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a7673-e532-42cc-8af3-f643ab6bf115 tempest-VolumeQuotaClassesTest-1394010048 tempest-VolumeQuotaClassesTest-1394010048-project-admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:33.212284 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a7673-e532-42cc-8af3-f643ab6bf115 tempest-VolumeQuotaClassesTest-1394010048 tempest-VolumeQuotaClassesTest-1394010048-project-admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:33.212558 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a7673-e532-42cc-8af3-f643ab6bf115 tempest-VolumeQuotaClassesTest-1394010048 tempest-VolumeQuotaClassesTest-1394010048-project-admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:33.213306 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a7673-e532-42cc-8af3-f643ab6bf115 tempest-VolumeQuotaClassesTest-1394010048 tempest-VolumeQuotaClassesTest-1394010048-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:22:33.213610 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a7673-e532-42cc-8af3-f643ab6bf115 tempest-VolumeQuotaClassesTest-1394010048 tempest-VolumeQuotaClassesTest-1394010048-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:33.215247 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a7673-e532-42cc-8af3-f643ab6bf115 tempest-VolumeQuotaClassesTest-1394010048 tempest-VolumeQuotaClassesTest-1394010048-project-admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:33.230146 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 918/1837] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:22:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:22:33.274605 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6daff-7cbc-41fb-8d2d-b2f830d15cc7 tempest-VolumeQuotaClassesTest-1394010048 tempest-VolumeQuotaClassesTest-1394010048-project-admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:33.285677 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6daff-7cbc-41fb-8d2d-b2f830d15cc7 tempest-VolumeQuotaClassesTest-1394010048 tempest-VolumeQuotaClassesTest-1394010048-project-admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:33.291150 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811293df-2a58-4887-a33a-7d95d2e1b10c tempest-VolumeQuotaClassesTest-1394010048 tempest-VolumeQuotaClassesTest-1394010048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a445cb3f4a02450986e02b43bdd68ca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05f2410ef50a45a2b1c91e414abf26bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:33.292012 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811293df-2a58-4887-a33a-7d95d2e1b10c tempest-VolumeQuotaClassesTest-1394010048 tempest-VolumeQuotaClassesTest-1394010048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:33.292332 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811293df-2a58-4887-a33a-7d95d2e1b10c tempest-VolumeQuotaClassesTest-1394010048 tempest-VolumeQuotaClassesTest-1394010048-project-admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:33.292613 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811293df-2a58-4887-a33a-7d95d2e1b10c tempest-VolumeQuotaClassesTest-1394010048 tempest-VolumeQuotaClassesTest-1394010048-project-admin] PATH_INFO: `/v3/projects/ddd56b78c47342a9ba83bc9f20d79f0c` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:33.293784 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811293df-2a58-4887-a33a-7d95d2e1b10c tempest-VolumeQuotaClassesTest-1394010048 tempest-VolumeQuotaClassesTest-1394010048-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ddd56b78c47342a9ba83bc9f20d79f0c)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:33.296686 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811293df-2a58-4887-a33a-7d95d2e1b10c tempest-VolumeQuotaClassesTest-1394010048 tempest-VolumeQuotaClassesTest-1394010048-project-admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:33.392649 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:33.429306 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-811293df-2a58-4887-a33a-7d95d2e1b10c tempest-VolumeQuotaClassesTest-1394010048 tempest-VolumeQuotaClassesTest-1394010048-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddd56b78c47342a9ba83bc9f20d79f0c', 'request_id': 'req-811293df-2a58-4887-a33a-7d95d2e1b10c'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:33.516497 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-811293df-2a58-4887-a33a-7d95d2e1b10c tempest-VolumeQuotaClassesTest-1394010048 tempest-VolumeQuotaClassesTest-1394010048-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddd56b78c47342a9ba83bc9f20d79f0c', 'request_id': 'req-811293df-2a58-4887-a33a-7d95d2e1b10c'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:33.522488 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-811293df-2a58-4887-a33a-7d95d2e1b10c tempest-VolumeQuotaClassesTest-1394010048 tempest-VolumeQuotaClassesTest-1394010048-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddd56b78c47342a9ba83bc9f20d79f0c', 'request_id': 'req-811293df-2a58-4887-a33a-7d95d2e1b10c'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:33.535049 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-811293df-2a58-4887-a33a-7d95d2e1b10c tempest-VolumeQuotaClassesTest-1394010048 tempest-VolumeQuotaClassesTest-1394010048-project-admin] The token cache is being invalidate because project ddd56b78c47342a9ba83bc9f20d79f0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:22:33.535337 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-811293df-2a58-4887-a33a-7d95d2e1b10c tempest-VolumeQuotaClassesTest-1394010048 tempest-VolumeQuotaClassesTest-1394010048-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:33.536067 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-811293df-2a58-4887-a33a-7d95d2e1b10c tempest-VolumeQuotaClassesTest-1394010048 tempest-VolumeQuotaClassesTest-1394010048-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:33.537751 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 920/1838] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:22:33 2022] DELETE /identity/v3/projects/ddd56b78c47342a9ba83bc9f20d79f0c => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:22:33.602445 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:34.165930 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a7673-e532-42cc-8af3-f643ab6bf115 tempest-VolumeQuotaClassesTest-1394010048 tempest-VolumeQuotaClassesTest-1394010048-project-admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:34.168776 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-205a7673-e532-42cc-8af3-f643ab6bf115 tempest-VolumeQuotaClassesTest-1394010048 tempest-VolumeQuotaClassesTest-1394010048-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:34.235318 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a7673-e532-42cc-8af3-f643ab6bf115 tempest-VolumeQuotaClassesTest-1394010048 tempest-VolumeQuotaClassesTest-1394010048-project-admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:34.295091 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2360f-5528-4895-b004-172a0674af1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:34.296107 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2360f-5528-4895-b004-172a0674af1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:34.296410 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2360f-5528-4895-b004-172a0674af1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:34.296682 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2360f-5528-4895-b004-172a0674af1c admin admin] PATH_INFO: `/v3/users/a611866c260d4e3597ad296e98601829` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:34.297893 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2360f-5528-4895-b004-172a0674af1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a611866c260d4e3597ad296e98601829)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:34.299912 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2360f-5528-4895-b004-172a0674af1c admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:34.448015 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:34.513542 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-72b2360f-5528-4895-b004-172a0674af1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a611866c260d4e3597ad296e98601829'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:34.526770 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-72b2360f-5528-4895-b004-172a0674af1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a611866c260d4e3597ad296e98601829'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:34.527446 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-72b2360f-5528-4895-b004-172a0674af1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a611866c260d4e3597ad296e98601829'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:34.529478 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:34.534994 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-72b2360f-5528-4895-b004-172a0674af1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a611866c260d4e3597ad296e98601829'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:34.535743 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-72b2360f-5528-4895-b004-172a0674af1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a611866c260d4e3597ad296e98601829'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:34.608462 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 919/1839] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:22:34 2022] DELETE /identity/v3/users/a611866c260d4e3597ad296e98601829 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:22:34.613065 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0287a6c-829c-4c6a-aeaa-b3691412d8ef None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:34.613383 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0287a6c-829c-4c6a-aeaa-b3691412d8ef None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:34.613683 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0287a6c-829c-4c6a-aeaa-b3691412d8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:34.631740 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-c0287a6c-829c-4c6a-aeaa-b3691412d8ef None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:34.632961 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-c0287a6c-829c-4c6a-aeaa-b3691412d8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:34.693906 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 921/1840] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:22:34.703927 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2360f-5528-4895-b004-172a0674af1c admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:34.705581 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-72b2360f-5528-4895-b004-172a0674af1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:34.765435 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2360f-5528-4895-b004-172a0674af1c admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:34.769299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348066ba-d25c-42d9-b2f1-7f3ac67a97a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:34.770077 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348066ba-d25c-42d9-b2f1-7f3ac67a97a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:34.770363 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348066ba-d25c-42d9-b2f1-7f3ac67a97a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:34.770642 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348066ba-d25c-42d9-b2f1-7f3ac67a97a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:34.781388 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348066ba-d25c-42d9-b2f1-7f3ac67a97a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:34.782869 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348066ba-d25c-42d9-b2f1-7f3ac67a97a9 service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:34.793032 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 920/1841] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:22:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:22:34.905968 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:34.977559 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:35.097255 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:35.120512 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:35.134623 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0287a6c-829c-4c6a-aeaa-b3691412d8ef None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:35.135930 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-c0287a6c-829c-4c6a-aeaa-b3691412d8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:35.196182 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0287a6c-829c-4c6a-aeaa-b3691412d8ef None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:35.199734 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3687f2-7991-4323-b70b-4d597f5c4083 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:35.200417 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3687f2-7991-4323-b70b-4d597f5c4083 service cinder] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:35.200745 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3687f2-7991-4323-b70b-4d597f5c4083 service cinder] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:35.201021 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3687f2-7991-4323-b70b-4d597f5c4083 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:35.203532 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-5f3687f2-7991-4323-b70b-4d597f5c4083 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:35.245874 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:35.264209 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3687f2-7991-4323-b70b-4d597f5c4083 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:35.266313 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3687f2-7991-4323-b70b-4d597f5c4083 service cinder] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:35.275825 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 922/1842] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:22:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:22:35.277969 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:35.281588 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348066ba-d25c-42d9-b2f1-7f3ac67a97a9 service neutron] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:35.284738 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-348066ba-d25c-42d9-b2f1-7f3ac67a97a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:35.306963 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348066ba-d25c-42d9-b2f1-7f3ac67a97a9 service neutron] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:35.317905 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c9599-101a-4639-a87d-0003fa98c60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:35.319316 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c9599-101a-4639-a87d-0003fa98c60f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:35.320027 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c9599-101a-4639-a87d-0003fa98c60f admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:35.320738 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c9599-101a-4639-a87d-0003fa98c60f admin admin] PATH_INFO: `/v3/projects/622c17c4188e4650a743cb53bc7eaf14` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:35.322969 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c9599-101a-4639-a87d-0003fa98c60f admin admin] RBAC: Authorizing `identity:delete_project(project_id=622c17c4188e4650a743cb53bc7eaf14)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:35.328460 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c9599-101a-4639-a87d-0003fa98c60f admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:35.379486 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:35.465451 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-4e8c9599-101a-4639-a87d-0003fa98c60f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '622c17c4188e4650a743cb53bc7eaf14', 'request_id': 'req-4e8c9599-101a-4639-a87d-0003fa98c60f'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:35.471592 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-4e8c9599-101a-4639-a87d-0003fa98c60f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '622c17c4188e4650a743cb53bc7eaf14', 'request_id': 'req-4e8c9599-101a-4639-a87d-0003fa98c60f'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:35.477002 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-4e8c9599-101a-4639-a87d-0003fa98c60f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '622c17c4188e4650a743cb53bc7eaf14', 'request_id': 'req-4e8c9599-101a-4639-a87d-0003fa98c60f'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:35.595833 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-4e8c9599-101a-4639-a87d-0003fa98c60f admin admin] The token cache is being invalidate because project 622c17c4188e4650a743cb53bc7eaf14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:22:35.596096 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-4e8c9599-101a-4639-a87d-0003fa98c60f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:35.596773 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-4e8c9599-101a-4639-a87d-0003fa98c60f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:35.598323 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 921/1843] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:22:35 2022] DELETE /identity/v3/projects/622c17c4188e4650a743cb53bc7eaf14 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:22:35.602418 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3687f2-7991-4323-b70b-4d597f5c4083 service cinder] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:35.613937 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:35.614327 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3687f2-7991-4323-b70b-4d597f5c4083 service cinder] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:35.675907 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779909c-e1f1-4760-8003-f80b08f28d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:35.676824 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779909c-e1f1-4760-8003-f80b08f28d86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:35.677109 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779909c-e1f1-4760-8003-f80b08f28d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:35.677383 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779909c-e1f1-4760-8003-f80b08f28d86 admin admin] PATH_INFO: `/v3/users/a445cb3f4a02450986e02b43bdd68ca3` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:35.678563 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7779909c-e1f1-4760-8003-f80b08f28d86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a445cb3f4a02450986e02b43bdd68ca3)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:35.680507 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7779909c-e1f1-4760-8003-f80b08f28d86 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:35.777319 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:35.851635 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-7779909c-e1f1-4760-8003-f80b08f28d86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a445cb3f4a02450986e02b43bdd68ca3'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:35.866431 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-7779909c-e1f1-4760-8003-f80b08f28d86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a445cb3f4a02450986e02b43bdd68ca3'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:35.867998 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-7779909c-e1f1-4760-8003-f80b08f28d86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a445cb3f4a02450986e02b43bdd68ca3'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:35.878257 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-7779909c-e1f1-4760-8003-f80b08f28d86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a445cb3f4a02450986e02b43bdd68ca3'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:35.878979 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-7779909c-e1f1-4760-8003-f80b08f28d86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a445cb3f4a02450986e02b43bdd68ca3'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:36.013605 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 923/1844] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:22:35 2022] DELETE /identity/v3/users/a445cb3f4a02450986e02b43bdd68ca3 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:22:36.435791 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c9599-101a-4639-a87d-0003fa98c60f admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:36.438275 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-4e8c9599-101a-4639-a87d-0003fa98c60f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:36.458340 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c9599-101a-4639-a87d-0003fa98c60f admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:36.519869 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf4a39-178c-4b95-bad3-abb8b8a76af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:36.520839 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf4a39-178c-4b95-bad3-abb8b8a76af7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:36.521122 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf4a39-178c-4b95-bad3-abb8b8a76af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:36.521395 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf4a39-178c-4b95-bad3-abb8b8a76af7 admin admin] PATH_INFO: `/v3/projects/05f2410ef50a45a2b1c91e414abf26bc` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:36.522603 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cf4a39-178c-4b95-bad3-abb8b8a76af7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05f2410ef50a45a2b1c91e414abf26bc)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:36.524581 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cf4a39-178c-4b95-bad3-abb8b8a76af7 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:36.629052 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-93cf4a39-178c-4b95-bad3-abb8b8a76af7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05f2410ef50a45a2b1c91e414abf26bc', 'request_id': 'req-93cf4a39-178c-4b95-bad3-abb8b8a76af7'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:36.635208 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-93cf4a39-178c-4b95-bad3-abb8b8a76af7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05f2410ef50a45a2b1c91e414abf26bc', 'request_id': 'req-93cf4a39-178c-4b95-bad3-abb8b8a76af7'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:36.641474 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-93cf4a39-178c-4b95-bad3-abb8b8a76af7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05f2410ef50a45a2b1c91e414abf26bc', 'request_id': 'req-93cf4a39-178c-4b95-bad3-abb8b8a76af7'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:36.702619 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-93cf4a39-178c-4b95-bad3-abb8b8a76af7 admin admin] The token cache is being invalidate because project 05f2410ef50a45a2b1c91e414abf26bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:22:36.703049 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-93cf4a39-178c-4b95-bad3-abb8b8a76af7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:36.703658 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-93cf4a39-178c-4b95-bad3-abb8b8a76af7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:36.705242 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 922/1845] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:22:36 2022] DELETE /identity/v3/projects/05f2410ef50a45a2b1c91e414abf26bc => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:22:36.710198 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5acb9e-1ec8-4632-9113-50425308e4a9 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:36.710683 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5acb9e-1ec8-4632-9113-50425308e4a9 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:36.710773 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5acb9e-1ec8-4632-9113-50425308e4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:36.729894 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-fc5acb9e-1ec8-4632-9113-50425308e4a9 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:36.731220 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-fc5acb9e-1ec8-4632-9113-50425308e4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:36.796501 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 924/1846] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:22:36.804558 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef210ab-40a0-42fb-8d52-057a6a0617ab None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:36.804848 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef210ab-40a0-42fb-8d52-057a6a0617ab None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:36.805149 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef210ab-40a0-42fb-8d52-057a6a0617ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:36.824921 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-eef210ab-40a0-42fb-8d52-057a6a0617ab None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:36.826439 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-eef210ab-40a0-42fb-8d52-057a6a0617ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:36.834680 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 923/1847] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:22:36.839012 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5acb9e-1ec8-4632-9113-50425308e4a9 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:36.848644 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5acb9e-1ec8-4632-9113-50425308e4a9 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:36.853334 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a5267-8f71-4ef0-8217-9804fbe119ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:36.853991 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a5267-8f71-4ef0-8217-9804fbe119ae admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:36.854274 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a5267-8f71-4ef0-8217-9804fbe119ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:36.854553 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a5267-8f71-4ef0-8217-9804fbe119ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:36.855285 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a5267-8f71-4ef0-8217-9804fbe119ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:22:36.855593 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a5267-8f71-4ef0-8217-9804fbe119ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:36.857208 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a5267-8f71-4ef0-8217-9804fbe119ae admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:36.864798 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:36.870459 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 925/1848] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:22:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:22:36.875592 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef210ab-40a0-42fb-8d52-057a6a0617ab None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:36.884886 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef210ab-40a0-42fb-8d52-057a6a0617ab None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:36.890243 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38669d4-2555-49b4-9273-a051da3ef7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:36.890893 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38669d4-2555-49b4-9273-a051da3ef7f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:36.891175 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38669d4-2555-49b4-9273-a051da3ef7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:36.891446 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38669d4-2555-49b4-9273-a051da3ef7f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:36.892191 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38669d4-2555-49b4-9273-a051da3ef7f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:36.894084 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38669d4-2555-49b4-9273-a051da3ef7f6 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:37.012406 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 924/1849] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:22:36 2022] POST /identity/v3/projects => generated 379 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:22:37.016622 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a5267-8f71-4ef0-8217-9804fbe119ae admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:37.026999 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a5267-8f71-4ef0-8217-9804fbe119ae admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:37.085728 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ffcd5f-b672-464a-b5b1-d1a08d6e007c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:37.086412 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffcd5f-b672-464a-b5b1-d1a08d6e007c admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:37.086691 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffcd5f-b672-464a-b5b1-d1a08d6e007c admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:37.086965 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffcd5f-b672-464a-b5b1-d1a08d6e007c admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:37.087648 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ffcd5f-b672-464a-b5b1-d1a08d6e007c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:37.089707 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ffcd5f-b672-464a-b5b1-d1a08d6e007c admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:37.175316 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 926/1850] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:22:37 2022] POST /identity/v3/users => generated 290 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:22:37.179301 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38669d4-2555-49b4-9273-a051da3ef7f6 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:37.190901 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38669d4-2555-49b4-9273-a051da3ef7f6 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:37.195395 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c134e-64a5-4ddc-b444-0e77741254a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:37.196045 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c134e-64a5-4ddc-b444-0e77741254a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:37.196366 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c134e-64a5-4ddc-b444-0e77741254a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:37.196642 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c134e-64a5-4ddc-b444-0e77741254a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:37.197352 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c134e-64a5-4ddc-b444-0e77741254a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:37.198950 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c134e-64a5-4ddc-b444-0e77741254a7 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:37.209706 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 925/1851] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:22:37.213684 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ffcd5f-b672-464a-b5b1-d1a08d6e007c admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:37.224465 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ffcd5f-b672-464a-b5b1-d1a08d6e007c admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:37.229146 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84761465-73f2-4b1b-aa2b-3ff1006bb1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:37.229798 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84761465-73f2-4b1b-aa2b-3ff1006bb1d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:37.230077 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84761465-73f2-4b1b-aa2b-3ff1006bb1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:37.230350 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84761465-73f2-4b1b-aa2b-3ff1006bb1d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:37.231062 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84761465-73f2-4b1b-aa2b-3ff1006bb1d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:37.232663 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84761465-73f2-4b1b-aa2b-3ff1006bb1d0 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:37.243820 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 927/1852] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:22:37.247809 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c134e-64a5-4ddc-b444-0e77741254a7 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:37.254307 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:37.258059 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c134e-64a5-4ddc-b444-0e77741254a7 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:37.262656 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712c6b2-2f8a-4223-b7ea-dbc902e29bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:37.263530 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712c6b2-2f8a-4223-b7ea-dbc902e29bf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:37.263819 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712c6b2-2f8a-4223-b7ea-dbc902e29bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:37.264099 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712c6b2-2f8a-4223-b7ea-dbc902e29bf9 admin admin] PATH_INFO: `/v3/projects/a31c69304ecd4650897cb0b1dea3d8e4/users/a50da7ec2e9443e599135c091a681e55/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:37.278275 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4712c6b2-2f8a-4223-b7ea-dbc902e29bf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a31c69304ecd4650897cb0b1dea3d8e4, user_id=a50da7ec2e9443e599135c091a681e55, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:37.282255 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4712c6b2-2f8a-4223-b7ea-dbc902e29bf9 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:37.367393 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 926/1853] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:22:37 2022] PUT /identity/v3/projects/a31c69304ecd4650897cb0b1dea3d8e4/users/a50da7ec2e9443e599135c091a681e55/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:22:37.378915 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd2e2c-16fb-4505-9cc8-e011444ab21e None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:37.379214 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd2e2c-16fb-4505-9cc8-e011444ab21e None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:37.379494 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd2e2c-16fb-4505-9cc8-e011444ab21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:37.410417 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-85dd2e2c-16fb-4505-9cc8-e011444ab21e None None] MFA Rules not processed for user `a50da7ec2e9443e599135c091a681e55`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:37.411680 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-85dd2e2c-16fb-4505-9cc8-e011444ab21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:37.513580 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 928/1854] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:22:37.519160 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712c6b2-2f8a-4223-b7ea-dbc902e29bf9 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:37.589481 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712c6b2-2f8a-4223-b7ea-dbc902e29bf9 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:37.594442 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff2fc6-09bf-4cd9-bcc0-24c3cedd198c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:37.595102 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff2fc6-09bf-4cd9-bcc0-24c3cedd198c admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:37.595384 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff2fc6-09bf-4cd9-bcc0-24c3cedd198c admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:37.595654 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff2fc6-09bf-4cd9-bcc0-24c3cedd198c admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:37.596412 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ff2fc6-09bf-4cd9-bcc0-24c3cedd198c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:37.598384 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ff2fc6-09bf-4cd9-bcc0-24c3cedd198c admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:37.698714 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 927/1855] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:22:37 2022] POST /identity/v3/projects => generated 377 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:22:37.700418 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd2e2c-16fb-4505-9cc8-e011444ab21e None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:37.712014 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd2e2c-16fb-4505-9cc8-e011444ab21e None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:37.771172 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1488f81-bc71-4b86-acc4-7ccbea9c01c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:37.771838 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1488f81-bc71-4b86-acc4-7ccbea9c01c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:37.772119 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1488f81-bc71-4b86-acc4-7ccbea9c01c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:37.772424 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1488f81-bc71-4b86-acc4-7ccbea9c01c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:37.773096 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1488f81-bc71-4b86-acc4-7ccbea9c01c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:37.774984 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1488f81-bc71-4b86-acc4-7ccbea9c01c6 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:37.785576 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:37.922323 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 929/1856] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:22:37 2022] POST /identity/v3/users => generated 289 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:22:37.926180 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff2fc6-09bf-4cd9-bcc0-24c3cedd198c admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:37.937753 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff2fc6-09bf-4cd9-bcc0-24c3cedd198c admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:37.942619 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22b249-1c69-42cf-9d5b-e1e1e6ac26d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:37.943313 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22b249-1c69-42cf-9d5b-e1e1e6ac26d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:37.943716 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22b249-1c69-42cf-9d5b-e1e1e6ac26d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:37.943866 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22b249-1c69-42cf-9d5b-e1e1e6ac26d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:37.944629 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f22b249-1c69-42cf-9d5b-e1e1e6ac26d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:37.946243 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f22b249-1c69-42cf-9d5b-e1e1e6ac26d0 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:37.958735 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 928/1857] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:22:37.962591 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1488f81-bc71-4b86-acc4-7ccbea9c01c6 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:37.973136 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1488f81-bc71-4b86-acc4-7ccbea9c01c6 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:37.978112 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca66c9fe-6135-4e84-bff3-0300f76cd9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:37.978905 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66c9fe-6135-4e84-bff3-0300f76cd9b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:37.979130 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66c9fe-6135-4e84-bff3-0300f76cd9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:37.979399 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66c9fe-6135-4e84-bff3-0300f76cd9b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:37.980118 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca66c9fe-6135-4e84-bff3-0300f76cd9b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:37.981742 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca66c9fe-6135-4e84-bff3-0300f76cd9b5 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:37.996111 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 930/1858] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:22:37.997457 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22b249-1c69-42cf-9d5b-e1e1e6ac26d0 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:38.010926 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22b249-1c69-42cf-9d5b-e1e1e6ac26d0 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:38.016625 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f96b41-dd92-49f7-8a53-1925d43f08b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:38.017623 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f96b41-dd92-49f7-8a53-1925d43f08b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:38.019094 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f96b41-dd92-49f7-8a53-1925d43f08b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:38.019094 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f96b41-dd92-49f7-8a53-1925d43f08b5 admin admin] PATH_INFO: `/v3/projects/025d7acacdf34856a89ef587f6cd0c8e/users/dbf1333eb2ba4d058ebff23af85d03a7/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:38.035771 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f96b41-dd92-49f7-8a53-1925d43f08b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=025d7acacdf34856a89ef587f6cd0c8e, user_id=dbf1333eb2ba4d058ebff23af85d03a7, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:38.038703 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f96b41-dd92-49f7-8a53-1925d43f08b5 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:38.112302 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 929/1859] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:22:37 2022] PUT /identity/v3/projects/025d7acacdf34856a89ef587f6cd0c8e/users/dbf1333eb2ba4d058ebff23af85d03a7/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:22:38.123549 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5596b1-62b9-4e4a-9257-b66fd3174809 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:38.124235 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5596b1-62b9-4e4a-9257-b66fd3174809 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:38.124522 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5596b1-62b9-4e4a-9257-b66fd3174809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:38.153633 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-0e5596b1-62b9-4e4a-9257-b66fd3174809 None None] MFA Rules not processed for user `dbf1333eb2ba4d058ebff23af85d03a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:38.155776 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-0e5596b1-62b9-4e4a-9257-b66fd3174809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:38.232768 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 931/1860] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:22:38.236081 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f96b41-dd92-49f7-8a53-1925d43f08b5 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:38.303050 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f96b41-dd92-49f7-8a53-1925d43f08b5 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:38.307849 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c589399-9914-4d7b-9cfa-1fabe102c823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:38.308552 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c589399-9914-4d7b-9cfa-1fabe102c823 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:38.308841 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c589399-9914-4d7b-9cfa-1fabe102c823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:38.309131 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c589399-9914-4d7b-9cfa-1fabe102c823 admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:38.309822 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c589399-9914-4d7b-9cfa-1fabe102c823 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:38.312285 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c589399-9914-4d7b-9cfa-1fabe102c823 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:38.414780 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 930/1861] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:22:38 2022] POST /identity/v3/projects => generated 379 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:22:38.419215 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5596b1-62b9-4e4a-9257-b66fd3174809 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:38.430121 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5596b1-62b9-4e4a-9257-b66fd3174809 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:38.486743 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a4c2a-b3c9-4e6c-927b-743b62700f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:38.487334 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a4c2a-b3c9-4e6c-927b-743b62700f76 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:38.487615 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a4c2a-b3c9-4e6c-927b-743b62700f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:38.487889 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a4c2a-b3c9-4e6c-927b-743b62700f76 admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:38.488704 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a4c2a-b3c9-4e6c-927b-743b62700f76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:38.490616 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a4c2a-b3c9-4e6c-927b-743b62700f76 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:38.562931 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 932/1862] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:22:38 2022] POST /identity/v3/users => generated 296 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:22:38.566916 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c589399-9914-4d7b-9cfa-1fabe102c823 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:38.588048 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c589399-9914-4d7b-9cfa-1fabe102c823 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:38.601260 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0419733-7dc0-4b26-9225-7fb6c789ec86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:38.602380 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0419733-7dc0-4b26-9225-7fb6c789ec86 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:38.602740 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0419733-7dc0-4b26-9225-7fb6c789ec86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:38.603234 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0419733-7dc0-4b26-9225-7fb6c789ec86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:38.604020 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0419733-7dc0-4b26-9225-7fb6c789ec86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:38.606103 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0419733-7dc0-4b26-9225-7fb6c789ec86 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:38.619157 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 931/1863] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:22:38.623724 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a4c2a-b3c9-4e6c-927b-743b62700f76 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:38.635621 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a4c2a-b3c9-4e6c-927b-743b62700f76 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:38.641072 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2f419b-8ef4-494d-bade-a5531f1b953d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:38.642013 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f419b-8ef4-494d-bade-a5531f1b953d admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:38.642353 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f419b-8ef4-494d-bade-a5531f1b953d admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:38.642631 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f419b-8ef4-494d-bade-a5531f1b953d admin admin] PATH_INFO: `/v3/projects/e67b4ad986d542e9814dc73586a01b74/users/3af0c0c8493949ec808a9e7fe0b45702/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:38.658946 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2f419b-8ef4-494d-bade-a5531f1b953d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e67b4ad986d542e9814dc73586a01b74, user_id=3af0c0c8493949ec808a9e7fe0b45702, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:38.661836 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2f419b-8ef4-494d-bade-a5531f1b953d admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:38.774181 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 933/1864] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:22:38 2022] PUT /identity/v3/projects/e67b4ad986d542e9814dc73586a01b74/users/3af0c0c8493949ec808a9e7fe0b45702/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:22:38.785796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0419733-7dc0-4b26-9225-7fb6c789ec86 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:38.792186 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:38.796818 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0419733-7dc0-4b26-9225-7fb6c789ec86 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:38.860947 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d26b3-68ed-42a5-a1b9-5e3c5aca576b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:38.861936 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d26b3-68ed-42a5-a1b9-5e3c5aca576b admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:38.862224 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d26b3-68ed-42a5-a1b9-5e3c5aca576b admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:38.862499 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d26b3-68ed-42a5-a1b9-5e3c5aca576b admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:38.863422 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d26b3-68ed-42a5-a1b9-5e3c5aca576b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:38.865188 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d26b3-68ed-42a5-a1b9-5e3c5aca576b admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:38.876708 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 932/1865] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:22:38.881113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2f419b-8ef4-494d-bade-a5531f1b953d admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:38.894371 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2f419b-8ef4-494d-bade-a5531f1b953d admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:38.899366 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86669fb7-d7ae-4039-b76e-b0fa27645581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:38.900306 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86669fb7-d7ae-4039-b76e-b0fa27645581 admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:38.900587 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86669fb7-d7ae-4039-b76e-b0fa27645581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:38.900859 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86669fb7-d7ae-4039-b76e-b0fa27645581 admin admin] PATH_INFO: `/v3/projects/e67b4ad986d542e9814dc73586a01b74/users/3af0c0c8493949ec808a9e7fe0b45702/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:38.903487 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86669fb7-d7ae-4039-b76e-b0fa27645581 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e67b4ad986d542e9814dc73586a01b74, user_id=3af0c0c8493949ec808a9e7fe0b45702, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:38.906637 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86669fb7-d7ae-4039-b76e-b0fa27645581 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:38.917659 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 934/1866] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:22:38 2022] PUT /identity/v3/projects/e67b4ad986d542e9814dc73586a01b74/users/3af0c0c8493949ec808a9e7fe0b45702/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:22:38.929647 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf4b9e-1703-4c2d-87fa-c155b15c8376 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:38.930023 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf4b9e-1703-4c2d-87fa-c155b15c8376 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:38.930391 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf4b9e-1703-4c2d-87fa-c155b15c8376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:38.958430 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-5caf4b9e-1703-4c2d-87fa-c155b15c8376 None None] MFA Rules not processed for user `3af0c0c8493949ec808a9e7fe0b45702`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:38.959642 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-5caf4b9e-1703-4c2d-87fa-c155b15c8376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:39.032497 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 933/1867] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:38 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:22:39.043871 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86669fb7-d7ae-4039-b76e-b0fa27645581 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:39.046130 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-86669fb7-d7ae-4039-b76e-b0fa27645581 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:39.082227 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:39.105480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86669fb7-d7ae-4039-b76e-b0fa27645581 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:39.110312 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c57c5-03a2-49a6-8757-24c60472b301 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:39.111117 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c57c5-03a2-49a6-8757-24c60472b301 service cinder] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:39.111290 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c57c5-03a2-49a6-8757-24c60472b301 service cinder] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:39.111568 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c57c5-03a2-49a6-8757-24c60472b301 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:39.121816 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c57c5-03a2-49a6-8757-24c60472b301 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:39.123285 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c57c5-03a2-49a6-8757-24c60472b301 service cinder] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:39.139777 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 935/1868] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:22:39 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:22:39.232378 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf4b9e-1703-4c2d-87fa-c155b15c8376 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:39.235541 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-5caf4b9e-1703-4c2d-87fa-c155b15c8376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:39.247826 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf4b9e-1703-4c2d-87fa-c155b15c8376 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:39.252419 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded6e34-1e2c-41da-9b6a-8dfbfb741a3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:39.253065 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded6e34-1e2c-41da-9b6a-8dfbfb741a3d service cinder] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:39.253349 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded6e34-1e2c-41da-9b6a-8dfbfb741a3d service cinder] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:39.253633 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded6e34-1e2c-41da-9b6a-8dfbfb741a3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:39.313137 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ded6e34-1e2c-41da-9b6a-8dfbfb741a3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:39.314621 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ded6e34-1e2c-41da-9b6a-8dfbfb741a3d service cinder] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:39.324100 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 934/1869] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:22:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:22:42.437415 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c57c5-03a2-49a6-8757-24c60472b301 service cinder] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:42.448255 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c57c5-03a2-49a6-8757-24c60472b301 service cinder] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:42.452579 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2485cf0-905f-43bb-8b85-e575da3ab6ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:42.453604 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2485cf0-905f-43bb-8b85-e575da3ab6ee service cinder] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:42.453898 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2485cf0-905f-43bb-8b85-e575da3ab6ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:42.454177 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2485cf0-905f-43bb-8b85-e575da3ab6ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:42.455999 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-f2485cf0-905f-43bb-8b85-e575da3ab6ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:42.525130 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2485cf0-905f-43bb-8b85-e575da3ab6ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:42.526779 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2485cf0-905f-43bb-8b85-e575da3ab6ee service cinder] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:42.536554 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 936/1870] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:22:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:22:45.473755 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded6e34-1e2c-41da-9b6a-8dfbfb741a3d service cinder] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:45.502056 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:45.537230 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded6e34-1e2c-41da-9b6a-8dfbfb741a3d service cinder] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:45.541867 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc2fad-bb13-4f3e-9b37-4f83caf2d822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:45.542740 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc2fad-bb13-4f3e-9b37-4f83caf2d822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:45.543044 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc2fad-bb13-4f3e-9b37-4f83caf2d822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:45.543311 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc2fad-bb13-4f3e-9b37-4f83caf2d822 admin admin] PATH_INFO: `/v3/users/a50da7ec2e9443e599135c091a681e55` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:45.544510 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc2fad-bb13-4f3e-9b37-4f83caf2d822 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a50da7ec2e9443e599135c091a681e55)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:45.546475 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc2fad-bb13-4f3e-9b37-4f83caf2d822 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:45.784750 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-cfbc2fad-bb13-4f3e-9b37-4f83caf2d822 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a50da7ec2e9443e599135c091a681e55'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:45.807916 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-cfbc2fad-bb13-4f3e-9b37-4f83caf2d822 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a50da7ec2e9443e599135c091a681e55'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:45.809777 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-cfbc2fad-bb13-4f3e-9b37-4f83caf2d822 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a50da7ec2e9443e599135c091a681e55'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:45.818733 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-cfbc2fad-bb13-4f3e-9b37-4f83caf2d822 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a50da7ec2e9443e599135c091a681e55'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:45.819617 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-cfbc2fad-bb13-4f3e-9b37-4f83caf2d822 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a50da7ec2e9443e599135c091a681e55'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:45.913166 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 935/1871] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:22:45 2022] DELETE /identity/v3/users/a50da7ec2e9443e599135c091a681e55 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:22:45.915296 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d132904-8eab-4485-ae2c-48ddbca4910d None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:45.916513 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d132904-8eab-4485-ae2c-48ddbca4910d None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:45.916799 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d132904-8eab-4485-ae2c-48ddbca4910d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:45.937977 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-1d132904-8eab-4485-ae2c-48ddbca4910d None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:45.939648 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-1d132904-8eab-4485-ae2c-48ddbca4910d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:46.022945 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 937/1872] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:22:46.032998 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc2fad-bb13-4f3e-9b37-4f83caf2d822 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:46.034487 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-cfbc2fad-bb13-4f3e-9b37-4f83caf2d822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:46.104882 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc2fad-bb13-4f3e-9b37-4f83caf2d822 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:46.110427 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc67b35-61f4-465f-8c19-f9b7cf0c088d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:46.110427 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc67b35-61f4-465f-8c19-f9b7cf0c088d service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:46.110427 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc67b35-61f4-465f-8c19-f9b7cf0c088d service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:46.110789 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc67b35-61f4-465f-8c19-f9b7cf0c088d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:46.120426 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc67b35-61f4-465f-8c19-f9b7cf0c088d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:46.121987 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc67b35-61f4-465f-8c19-f9b7cf0c088d service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:46.132897 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 936/1873] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:22:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:22:46.913338 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d132904-8eab-4485-ae2c-48ddbca4910d None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:46.915751 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-1d132904-8eab-4485-ae2c-48ddbca4910d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:46.933774 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d132904-8eab-4485-ae2c-48ddbca4910d None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:46.935611 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227787a-1fc7-451c-b3e3-a5a084e4f9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:46.936650 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227787a-1fc7-451c-b3e3-a5a084e4f9d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:46.937539 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227787a-1fc7-451c-b3e3-a5a084e4f9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:46.937905 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227787a-1fc7-451c-b3e3-a5a084e4f9d8 admin admin] PATH_INFO: `/v3/projects/a31c69304ecd4650897cb0b1dea3d8e4` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:46.939226 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e227787a-1fc7-451c-b3e3-a5a084e4f9d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a31c69304ecd4650897cb0b1dea3d8e4)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:46.941366 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e227787a-1fc7-451c-b3e3-a5a084e4f9d8 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:47.071413 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-e227787a-1fc7-451c-b3e3-a5a084e4f9d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a31c69304ecd4650897cb0b1dea3d8e4', 'request_id': 'req-e227787a-1fc7-451c-b3e3-a5a084e4f9d8'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:47.140424 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-e227787a-1fc7-451c-b3e3-a5a084e4f9d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a31c69304ecd4650897cb0b1dea3d8e4', 'request_id': 'req-e227787a-1fc7-451c-b3e3-a5a084e4f9d8'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:47.151267 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:47.152871 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-e227787a-1fc7-451c-b3e3-a5a084e4f9d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a31c69304ecd4650897cb0b1dea3d8e4', 'request_id': 'req-e227787a-1fc7-451c-b3e3-a5a084e4f9d8'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:47.179555 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-e227787a-1fc7-451c-b3e3-a5a084e4f9d8 admin admin] The token cache is being invalidate because project a31c69304ecd4650897cb0b1dea3d8e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:22:47.179834 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-e227787a-1fc7-451c-b3e3-a5a084e4f9d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:47.181603 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-e227787a-1fc7-451c-b3e3-a5a084e4f9d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:47.184050 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 938/1874] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:22:46 2022] DELETE /identity/v3/projects/a31c69304ecd4650897cb0b1dea3d8e4 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:22:47.189373 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc67b35-61f4-465f-8c19-f9b7cf0c088d service neutron] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:47.205230 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc67b35-61f4-465f-8c19-f9b7cf0c088d service neutron] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:47.320895 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:47.344749 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e315a9c-1fce-48e4-ad33-23aea6ebce2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:47.344749 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e315a9c-1fce-48e4-ad33-23aea6ebce2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:47.344749 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e315a9c-1fce-48e4-ad33-23aea6ebce2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:47.349653 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e315a9c-1fce-48e4-ad33-23aea6ebce2c admin admin] PATH_INFO: `/v3/users/dbf1333eb2ba4d058ebff23af85d03a7` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:47.352687 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e315a9c-1fce-48e4-ad33-23aea6ebce2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbf1333eb2ba4d058ebff23af85d03a7)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:47.357926 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e315a9c-1fce-48e4-ad33-23aea6ebce2c admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:47.633819 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-6e315a9c-1fce-48e4-ad33-23aea6ebce2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbf1333eb2ba4d058ebff23af85d03a7'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:47.650581 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-6e315a9c-1fce-48e4-ad33-23aea6ebce2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbf1333eb2ba4d058ebff23af85d03a7'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:47.651657 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-6e315a9c-1fce-48e4-ad33-23aea6ebce2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbf1333eb2ba4d058ebff23af85d03a7'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:47.660534 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-6e315a9c-1fce-48e4-ad33-23aea6ebce2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbf1333eb2ba4d058ebff23af85d03a7'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:47.661233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-6e315a9c-1fce-48e4-ad33-23aea6ebce2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbf1333eb2ba4d058ebff23af85d03a7'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:47.735275 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 937/1875] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:22:47 2022] DELETE /identity/v3/users/dbf1333eb2ba4d058ebff23af85d03a7 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:22:47.944585 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227787a-1fc7-451c-b3e3-a5a084e4f9d8 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:47.946578 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-e227787a-1fc7-451c-b3e3-a5a084e4f9d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:47.960935 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227787a-1fc7-451c-b3e3-a5a084e4f9d8 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:48.045588 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7a46c-1ba5-4af6-a705-b6cd95781d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:48.046550 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7a46c-1ba5-4af6-a705-b6cd95781d53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:48.046857 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7a46c-1ba5-4af6-a705-b6cd95781d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:48.047217 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7a46c-1ba5-4af6-a705-b6cd95781d53 admin admin] PATH_INFO: `/v3/users/7a409fa1ced643079d7c2e61bc9d75b6` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:48.048459 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f7a46c-1ba5-4af6-a705-b6cd95781d53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a409fa1ced643079d7c2e61bc9d75b6)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:48.050457 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f7a46c-1ba5-4af6-a705-b6cd95781d53 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:48.282738 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-39f7a46c-1ba5-4af6-a705-b6cd95781d53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a409fa1ced643079d7c2e61bc9d75b6'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:48.306856 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-39f7a46c-1ba5-4af6-a705-b6cd95781d53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a409fa1ced643079d7c2e61bc9d75b6'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:48.309575 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-39f7a46c-1ba5-4af6-a705-b6cd95781d53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a409fa1ced643079d7c2e61bc9d75b6'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:48.332190 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-39f7a46c-1ba5-4af6-a705-b6cd95781d53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a409fa1ced643079d7c2e61bc9d75b6'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:48.333637 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-39f7a46c-1ba5-4af6-a705-b6cd95781d53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a409fa1ced643079d7c2e61bc9d75b6'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:48.401352 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e315a9c-1fce-48e4-ad33-23aea6ebce2c admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:48.403645 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-6e315a9c-1fce-48e4-ad33-23aea6ebce2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:48.426547 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 939/1876] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:22:47 2022] DELETE /identity/v3/users/7a409fa1ced643079d7c2e61bc9d75b6 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:22:48.428267 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e315a9c-1fce-48e4-ad33-23aea6ebce2c admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:48.431471 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480fd73-4dbe-44d0-9bb5-3f43fe471561 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:48.431833 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480fd73-4dbe-44d0-9bb5-3f43fe471561 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:48.432206 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480fd73-4dbe-44d0-9bb5-3f43fe471561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:48.451427 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-3480fd73-4dbe-44d0-9bb5-3f43fe471561 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:48.452976 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-3480fd73-4dbe-44d0-9bb5-3f43fe471561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:48.550492 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663c207-2e36-4ebf-b547-a482e109b2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:48.551627 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663c207-2e36-4ebf-b547-a482e109b2ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:48.551909 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663c207-2e36-4ebf-b547-a482e109b2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:48.552659 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663c207-2e36-4ebf-b547-a482e109b2ec admin admin] PATH_INFO: `/v3/projects/025d7acacdf34856a89ef587f6cd0c8e` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:48.555992 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8663c207-2e36-4ebf-b547-a482e109b2ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=025d7acacdf34856a89ef587f6cd0c8e)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:48.557973 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8663c207-2e36-4ebf-b547-a482e109b2ec admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:48.587156 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 940/1877] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:22:48.600916 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480fd73-4dbe-44d0-9bb5-3f43fe471561 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:48.602543 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-3480fd73-4dbe-44d0-9bb5-3f43fe471561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:48.620529 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:48.676762 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480fd73-4dbe-44d0-9bb5-3f43fe471561 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:48.680938 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e1731-2c9c-486e-9dbb-ec2c941474d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:48.681599 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e1731-2c9c-486e-9dbb-ec2c941474d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:48.683987 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e1731-2c9c-486e-9dbb-ec2c941474d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:48.683987 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e1731-2c9c-486e-9dbb-ec2c941474d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:48.693833 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e1731-2c9c-486e-9dbb-ec2c941474d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:48.695353 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e1731-2c9c-486e-9dbb-ec2c941474d2 service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:48.697980 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-8663c207-2e36-4ebf-b547-a482e109b2ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '025d7acacdf34856a89ef587f6cd0c8e', 'request_id': 'req-8663c207-2e36-4ebf-b547-a482e109b2ec'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:48.705813 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-8663c207-2e36-4ebf-b547-a482e109b2ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '025d7acacdf34856a89ef587f6cd0c8e', 'request_id': 'req-8663c207-2e36-4ebf-b547-a482e109b2ec'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:48.708426 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 941/1878] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:22:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:22:48.713369 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-8663c207-2e36-4ebf-b547-a482e109b2ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '025d7acacdf34856a89ef587f6cd0c8e', 'request_id': 'req-8663c207-2e36-4ebf-b547-a482e109b2ec'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:48.717262 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:48.818320 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-8663c207-2e36-4ebf-b547-a482e109b2ec admin admin] The token cache is being invalidate because project 025d7acacdf34856a89ef587f6cd0c8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:22:48.818656 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-8663c207-2e36-4ebf-b547-a482e109b2ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:48.820070 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-8663c207-2e36-4ebf-b547-a482e109b2ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:48.821956 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 938/1879] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:22:48 2022] DELETE /identity/v3/projects/025d7acacdf34856a89ef587f6cd0c8e => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:22:48.825991 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e1731-2c9c-486e-9dbb-ec2c941474d2 service neutron] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:48.827631 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-035e1731-2c9c-486e-9dbb-ec2c941474d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:48.841639 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e1731-2c9c-486e-9dbb-ec2c941474d2 service neutron] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:48.900068 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac36804-2b7f-404f-9764-2e229e76b0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:48.900988 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac36804-2b7f-404f-9764-2e229e76b0eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:48.901268 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac36804-2b7f-404f-9764-2e229e76b0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:48.902164 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac36804-2b7f-404f-9764-2e229e76b0eb admin admin] PATH_INFO: `/v3/users/3af0c0c8493949ec808a9e7fe0b45702` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:48.902816 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac36804-2b7f-404f-9764-2e229e76b0eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3af0c0c8493949ec808a9e7fe0b45702)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:48.905057 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac36804-2b7f-404f-9764-2e229e76b0eb admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:49.196263 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-dac36804-2b7f-404f-9764-2e229e76b0eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3af0c0c8493949ec808a9e7fe0b45702'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:49.214109 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-dac36804-2b7f-404f-9764-2e229e76b0eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3af0c0c8493949ec808a9e7fe0b45702'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:49.217146 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-dac36804-2b7f-404f-9764-2e229e76b0eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3af0c0c8493949ec808a9e7fe0b45702'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:49.246534 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-dac36804-2b7f-404f-9764-2e229e76b0eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3af0c0c8493949ec808a9e7fe0b45702'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:49.247977 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-dac36804-2b7f-404f-9764-2e229e76b0eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3af0c0c8493949ec808a9e7fe0b45702'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:49.323482 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663c207-2e36-4ebf-b547-a482e109b2ec admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:49.324922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-8663c207-2e36-4ebf-b547-a482e109b2ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:49.340368 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663c207-2e36-4ebf-b547-a482e109b2ec admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:49.346023 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc61d92-85e5-4206-8690-dbb81341d61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:49.347096 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc61d92-85e5-4206-8690-dbb81341d61e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:49.347381 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc61d92-85e5-4206-8690-dbb81341d61e admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:49.347656 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc61d92-85e5-4206-8690-dbb81341d61e admin admin] PATH_INFO: `/v3/projects/b62a3511df024e2bbab4309c4cddf18b` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:49.354371 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc61d92-85e5-4206-8690-dbb81341d61e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b62a3511df024e2bbab4309c4cddf18b)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:49.354371 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc61d92-85e5-4206-8690-dbb81341d61e admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:49.354929 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 942/1880] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:22:48 2022] DELETE /identity/v3/users/3af0c0c8493949ec808a9e7fe0b45702 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:22:49.459494 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-0cc61d92-85e5-4206-8690-dbb81341d61e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b62a3511df024e2bbab4309c4cddf18b', 'request_id': 'req-0cc61d92-85e5-4206-8690-dbb81341d61e'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:49.466897 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-0cc61d92-85e5-4206-8690-dbb81341d61e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b62a3511df024e2bbab4309c4cddf18b', 'request_id': 'req-0cc61d92-85e5-4206-8690-dbb81341d61e'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:49.473419 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-0cc61d92-85e5-4206-8690-dbb81341d61e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b62a3511df024e2bbab4309c4cddf18b', 'request_id': 'req-0cc61d92-85e5-4206-8690-dbb81341d61e'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:49.571560 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-0cc61d92-85e5-4206-8690-dbb81341d61e admin admin] The token cache is being invalidate because project b62a3511df024e2bbab4309c4cddf18b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:22:49.571812 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-0cc61d92-85e5-4206-8690-dbb81341d61e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:49.573201 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-0cc61d92-85e5-4206-8690-dbb81341d61e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:49.577803 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 939/1881] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:22:49 2022] DELETE /identity/v3/projects/b62a3511df024e2bbab4309c4cddf18b => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:22:49.583010 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac36804-2b7f-404f-9764-2e229e76b0eb admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:49.584739 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-dac36804-2b7f-404f-9764-2e229e76b0eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:49.621388 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:49.650369 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac36804-2b7f-404f-9764-2e229e76b0eb admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:49.714247 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e55cb8-838c-4dcc-ad6b-6447222d584f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:49.715304 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e55cb8-838c-4dcc-ad6b-6447222d584f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:49.715654 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e55cb8-838c-4dcc-ad6b-6447222d584f admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:49.715999 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e55cb8-838c-4dcc-ad6b-6447222d584f admin admin] PATH_INFO: `/v3/users/5a5b2aa5b80b41baa6f425fbed54913f` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:49.717314 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e55cb8-838c-4dcc-ad6b-6447222d584f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a5b2aa5b80b41baa6f425fbed54913f)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:49.719472 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e55cb8-838c-4dcc-ad6b-6447222d584f admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:49.778250 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc61d92-85e5-4206-8690-dbb81341d61e admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:49.781823 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-0cc61d92-85e5-4206-8690-dbb81341d61e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:49.794527 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc61d92-85e5-4206-8690-dbb81341d61e admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:49.801239 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b376f1dc-e8ea-4b08-8cf8-d7115aeddbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:49.802271 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b376f1dc-e8ea-4b08-8cf8-d7115aeddbb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:49.802642 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b376f1dc-e8ea-4b08-8cf8-d7115aeddbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:49.802990 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b376f1dc-e8ea-4b08-8cf8-d7115aeddbb9 admin admin] PATH_INFO: `/v3/projects/e67b4ad986d542e9814dc73586a01b74` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:49.804550 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b376f1dc-e8ea-4b08-8cf8-d7115aeddbb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e67b4ad986d542e9814dc73586a01b74)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:49.806619 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b376f1dc-e8ea-4b08-8cf8-d7115aeddbb9 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:49.935586 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-37e55cb8-838c-4dcc-ad6b-6447222d584f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a5b2aa5b80b41baa6f425fbed54913f'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:49.941349 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-b376f1dc-e8ea-4b08-8cf8-d7115aeddbb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e67b4ad986d542e9814dc73586a01b74', 'request_id': 'req-b376f1dc-e8ea-4b08-8cf8-d7115aeddbb9'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:49.958394 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-b376f1dc-e8ea-4b08-8cf8-d7115aeddbb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e67b4ad986d542e9814dc73586a01b74', 'request_id': 'req-b376f1dc-e8ea-4b08-8cf8-d7115aeddbb9'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:49.958512 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-37e55cb8-838c-4dcc-ad6b-6447222d584f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a5b2aa5b80b41baa6f425fbed54913f'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:49.958512 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-37e55cb8-838c-4dcc-ad6b-6447222d584f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a5b2aa5b80b41baa6f425fbed54913f'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:49.958670 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-b376f1dc-e8ea-4b08-8cf8-d7115aeddbb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e67b4ad986d542e9814dc73586a01b74', 'request_id': 'req-b376f1dc-e8ea-4b08-8cf8-d7115aeddbb9'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:49.960331 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-37e55cb8-838c-4dcc-ad6b-6447222d584f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a5b2aa5b80b41baa6f425fbed54913f'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:49.961032 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-37e55cb8-838c-4dcc-ad6b-6447222d584f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a5b2aa5b80b41baa6f425fbed54913f'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:50.036644 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-b376f1dc-e8ea-4b08-8cf8-d7115aeddbb9 admin admin] The token cache is being invalidate because project e67b4ad986d542e9814dc73586a01b74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:22:50.036932 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-b376f1dc-e8ea-4b08-8cf8-d7115aeddbb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:50.037545 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-b376f1dc-e8ea-4b08-8cf8-d7115aeddbb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:50.039086 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 940/1882] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:22:49 2022] DELETE /identity/v3/projects/e67b4ad986d542e9814dc73586a01b74 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:22:50.044702 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f88a2-a241-42ce-a189-0f9b0b5b2c87 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:50.044988 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f88a2-a241-42ce-a189-0f9b0b5b2c87 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:50.045261 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f88a2-a241-42ce-a189-0f9b0b5b2c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:50.063530 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-c22f88a2-a241-42ce-a189-0f9b0b5b2c87 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:50.064794 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-c22f88a2-a241-42ce-a189-0f9b0b5b2c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:50.088079 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 943/1883] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:22:49 2022] DELETE /identity/v3/users/5a5b2aa5b80b41baa6f425fbed54913f => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:22:50.124891 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 941/1884] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:22:50.133448 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f254ba-917e-4fc8-81fb-ee62360d9307 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:50.133740 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f254ba-917e-4fc8-81fb-ee62360d9307 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:50.134017 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f254ba-917e-4fc8-81fb-ee62360d9307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:50.152800 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-d9f254ba-917e-4fc8-81fb-ee62360d9307 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:50.154099 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-d9f254ba-917e-4fc8-81fb-ee62360d9307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:50.211296 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:50.220563 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 944/1885] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:22:50.224860 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f88a2-a241-42ce-a189-0f9b0b5b2c87 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:50.229892 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:50.236066 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f88a2-a241-42ce-a189-0f9b0b5b2c87 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:50.240829 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b319f2-e749-40ea-814a-a62be1c73310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:50.241479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b319f2-e749-40ea-814a-a62be1c73310 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:50.241762 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b319f2-e749-40ea-814a-a62be1c73310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:50.242036 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b319f2-e749-40ea-814a-a62be1c73310 admin admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:50.243001 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b319f2-e749-40ea-814a-a62be1c73310 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:22:50.243312 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b319f2-e749-40ea-814a-a62be1c73310 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:50.245054 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b319f2-e749-40ea-814a-a62be1c73310 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:50.256763 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 942/1886] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:22:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:22:50.261148 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f254ba-917e-4fc8-81fb-ee62360d9307 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:50.271483 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f254ba-917e-4fc8-81fb-ee62360d9307 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:50.276364 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38ee4d-d55c-444a-b615-50a8407f565b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:50.277053 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38ee4d-d55c-444a-b615-50a8407f565b admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:50.277310 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38ee4d-d55c-444a-b615-50a8407f565b admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:50.277588 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38ee4d-d55c-444a-b615-50a8407f565b admin admin] PATH_INFO: `/v3/projects` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:50.278276 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f38ee4d-d55c-444a-b615-50a8407f565b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:50.280395 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f38ee4d-d55c-444a-b615-50a8407f565b admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:50.387607 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 945/1887] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:22:50 2022] POST /identity/v3/projects => generated 387 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:22:50.391047 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b319f2-e749-40ea-814a-a62be1c73310 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:50.403496 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b319f2-e749-40ea-814a-a62be1c73310 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:50.471178 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1dd18-b99e-401a-bc14-91a398c4e79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:50.471899 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1dd18-b99e-401a-bc14-91a398c4e79c admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:50.472212 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1dd18-b99e-401a-bc14-91a398c4e79c admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:50.472494 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1dd18-b99e-401a-bc14-91a398c4e79c admin admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:50.473179 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1dd18-b99e-401a-bc14-91a398c4e79c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:50.475119 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1dd18-b99e-401a-bc14-91a398c4e79c admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:50.594440 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 943/1888] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:22:50 2022] POST /identity/v3/users => generated 294 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:22:50.598570 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38ee4d-d55c-444a-b615-50a8407f565b admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:50.609244 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38ee4d-d55c-444a-b615-50a8407f565b admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:50.614739 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b37525-f5be-4957-b739-3c56a86ae42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:50.615356 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b37525-f5be-4957-b739-3c56a86ae42b admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:50.615640 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b37525-f5be-4957-b739-3c56a86ae42b admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:50.615949 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b37525-f5be-4957-b739-3c56a86ae42b admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:50.616708 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b37525-f5be-4957-b739-3c56a86ae42b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:50.618566 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b37525-f5be-4957-b739-3c56a86ae42b admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:50.625691 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1dd18-b99e-401a-bc14-91a398c4e79c admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:50.627576 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-8de1dd18-b99e-401a-bc14-91a398c4e79c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:50.630015 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 946/1889] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:22:50.633933 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b37525-f5be-4957-b739-3c56a86ae42b admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:50.641213 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1dd18-b99e-401a-bc14-91a398c4e79c admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:50.644285 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b37525-f5be-4957-b739-3c56a86ae42b admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:50.646162 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e25223-b154-4e86-9386-8e55a558a59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:50.647053 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e25223-b154-4e86-9386-8e55a558a59f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:50.647453 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e25223-b154-4e86-9386-8e55a558a59f admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:50.647578 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e25223-b154-4e86-9386-8e55a558a59f admin admin] PATH_INFO: `/v3/projects/c7fed3d8462e4390a206ffdd3d7f05ef` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:50.649280 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e25223-b154-4e86-9386-8e55a558a59f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7fed3d8462e4390a206ffdd3d7f05ef)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:50.650544 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e29cf8-d95c-40af-9fab-d0b30031368c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:50.651213 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e25223-b154-4e86-9386-8e55a558a59f admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:50.651323 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e29cf8-d95c-40af-9fab-d0b30031368c admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:50.651469 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e29cf8-d95c-40af-9fab-d0b30031368c admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:50.651717 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e29cf8-d95c-40af-9fab-d0b30031368c admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:50.652571 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e29cf8-d95c-40af-9fab-d0b30031368c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:50.654245 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e29cf8-d95c-40af-9fab-d0b30031368c admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:50.668458 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 947/1890] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:22:50.669688 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e29cf8-d95c-40af-9fab-d0b30031368c admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:50.680184 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e29cf8-d95c-40af-9fab-d0b30031368c admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:50.684808 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4240153-3f26-4f10-832f-388876d8569e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:50.690124 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4240153-3f26-4f10-832f-388876d8569e admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:50.690124 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4240153-3f26-4f10-832f-388876d8569e admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:50.690124 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4240153-3f26-4f10-832f-388876d8569e admin admin] PATH_INFO: `/v3/projects/ff9c54aae1884acf9003781e5926e191/users/fc806a3c2f8a4666b801a04839ba5220/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:50.701786 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4240153-3f26-4f10-832f-388876d8569e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff9c54aae1884acf9003781e5926e191, user_id=fc806a3c2f8a4666b801a04839ba5220, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:50.705235 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4240153-3f26-4f10-832f-388876d8569e admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:50.790738 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 948/1891] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:22:50 2022] PUT /identity/v3/projects/ff9c54aae1884acf9003781e5926e191/users/fc806a3c2f8a4666b801a04839ba5220/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:22:50.799343 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-d5e25223-b154-4e86-9386-8e55a558a59f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7fed3d8462e4390a206ffdd3d7f05ef', 'request_id': 'req-d5e25223-b154-4e86-9386-8e55a558a59f'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:50.802336 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832df73-d4b1-4c85-8212-7d9ee8733d30 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:50.802613 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832df73-d4b1-4c85-8212-7d9ee8733d30 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:50.802889 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832df73-d4b1-4c85-8212-7d9ee8733d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:50.806270 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-d5e25223-b154-4e86-9386-8e55a558a59f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7fed3d8462e4390a206ffdd3d7f05ef', 'request_id': 'req-d5e25223-b154-4e86-9386-8e55a558a59f'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:50.813047 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-d5e25223-b154-4e86-9386-8e55a558a59f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7fed3d8462e4390a206ffdd3d7f05ef', 'request_id': 'req-d5e25223-b154-4e86-9386-8e55a558a59f'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:50.831028 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-2832df73-d4b1-4c85-8212-7d9ee8733d30 None None] MFA Rules not processed for user `fc806a3c2f8a4666b801a04839ba5220`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:50.832296 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-2832df73-d4b1-4c85-8212-7d9ee8733d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:50.896640 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 949/1892] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:22:50.901130 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832df73-d4b1-4c85-8212-7d9ee8733d30 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:50.926937 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-d5e25223-b154-4e86-9386-8e55a558a59f admin admin] The token cache is being invalidate because project c7fed3d8462e4390a206ffdd3d7f05ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:22:50.926937 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-d5e25223-b154-4e86-9386-8e55a558a59f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:50.926937 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-d5e25223-b154-4e86-9386-8e55a558a59f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:50.935236 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 944/1893] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:22:50 2022] DELETE /identity/v3/projects/c7fed3d8462e4390a206ffdd3d7f05ef => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:22:50.936576 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e25223-b154-4e86-9386-8e55a558a59f admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:50.938911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-d5e25223-b154-4e86-9386-8e55a558a59f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:50.997071 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832df73-d4b1-4c85-8212-7d9ee8733d30 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:51.002915 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b9b46-2f27-4dbb-b4aa-54a8d7d35fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:51.003646 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b9b46-2f27-4dbb-b4aa-54a8d7d35fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:51.004072 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b9b46-2f27-4dbb-b4aa-54a8d7d35fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:51.004540 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b9b46-2f27-4dbb-b4aa-54a8d7d35fe1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:51.005725 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09b9b46-2f27-4dbb-b4aa-54a8d7d35fe1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:51.007473 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09b9b46-2f27-4dbb-b4aa-54a8d7d35fe1 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:51.030877 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e25223-b154-4e86-9386-8e55a558a59f admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:51.037046 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5918f0-c461-416b-aec0-69e53ec3daa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:51.038079 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5918f0-c461-416b-aec0-69e53ec3daa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:51.038433 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5918f0-c461-416b-aec0-69e53ec3daa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:51.038770 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5918f0-c461-416b-aec0-69e53ec3daa9 admin admin] PATH_INFO: `/v3/users/147b40dea3f34e93b7a88308e446ff4c` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:51.040686 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5918f0-c461-416b-aec0-69e53ec3daa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=147b40dea3f34e93b7a88308e446ff4c)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:51.042722 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5918f0-c461-416b-aec0-69e53ec3daa9 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:51.045690 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:51.099053 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 950/1894] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:22:50 2022] POST /identity/v3/projects => generated 387 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:22:51.102756 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b9b46-2f27-4dbb-b4aa-54a8d7d35fe1 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:51.104354 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-d09b9b46-2f27-4dbb-b4aa-54a8d7d35fe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:51.113523 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:51.167616 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b9b46-2f27-4dbb-b4aa-54a8d7d35fe1 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:51.172595 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d4fe5-d334-4e32-bb10-afd2dfd4cdac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:51.173272 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d4fe5-d334-4e32-bb10-afd2dfd4cdac admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:51.173552 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d4fe5-d334-4e32-bb10-afd2dfd4cdac admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:51.173828 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d4fe5-d334-4e32-bb10-afd2dfd4cdac admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:51.174537 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7d4fe5-d334-4e32-bb10-afd2dfd4cdac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:51.176509 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7d4fe5-d334-4e32-bb10-afd2dfd4cdac admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:51.265807 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-ba5918f0-c461-416b-aec0-69e53ec3daa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '147b40dea3f34e93b7a88308e446ff4c'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:51.269198 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 951/1895] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:22:51 2022] POST /identity/v3/users => generated 300 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:22:51.270199 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d4fe5-d334-4e32-bb10-afd2dfd4cdac admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:51.277600 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-ba5918f0-c461-416b-aec0-69e53ec3daa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '147b40dea3f34e93b7a88308e446ff4c'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:51.278321 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-ba5918f0-c461-416b-aec0-69e53ec3daa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '147b40dea3f34e93b7a88308e446ff4c'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:51.279778 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d4fe5-d334-4e32-bb10-afd2dfd4cdac admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:51.285031 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df97b5-12f6-445e-bb58-9f1855c418e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:51.285798 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df97b5-12f6-445e-bb58-9f1855c418e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:51.285952 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-ba5918f0-c461-416b-aec0-69e53ec3daa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '147b40dea3f34e93b7a88308e446ff4c'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:51.286093 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df97b5-12f6-445e-bb58-9f1855c418e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:51.286371 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df97b5-12f6-445e-bb58-9f1855c418e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:51.286596 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-ba5918f0-c461-416b-aec0-69e53ec3daa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '147b40dea3f34e93b7a88308e446ff4c'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:51.287080 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92df97b5-12f6-445e-bb58-9f1855c418e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:51.288704 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92df97b5-12f6-445e-bb58-9f1855c418e4 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:51.302434 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 952/1896] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:22:51.303617 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df97b5-12f6-445e-bb58-9f1855c418e4 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:51.305324 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-92df97b5-12f6-445e-bb58-9f1855c418e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:51.318125 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df97b5-12f6-445e-bb58-9f1855c418e4 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:51.322750 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe159e-7525-4882-ba40-864d42058f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:51.323652 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe159e-7525-4882-ba40-864d42058f3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:51.323932 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe159e-7525-4882-ba40-864d42058f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:51.324243 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe159e-7525-4882-ba40-864d42058f3d admin admin] PATH_INFO: `/v3/projects/b56a96b49ace4b5988d086b541300fc7/users/8d3ee657e3864a73b9d761bca94004f9/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:51.340217 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe159e-7525-4882-ba40-864d42058f3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b56a96b49ace4b5988d086b541300fc7, user_id=8d3ee657e3864a73b9d761bca94004f9, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:51.342878 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe159e-7525-4882-ba40-864d42058f3d admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:51.368292 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 945/1897] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:22:50 2022] DELETE /identity/v3/users/147b40dea3f34e93b7a88308e446ff4c => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:22:51.498241 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 953/1898] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:22:51 2022] PUT /identity/v3/projects/b56a96b49ace4b5988d086b541300fc7/users/8d3ee657e3864a73b9d761bca94004f9/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:22:51.502857 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5918f0-c461-416b-aec0-69e53ec3daa9 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:51.573772 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5918f0-c461-416b-aec0-69e53ec3daa9 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:51.646514 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff8a93-7598-4306-a073-3d0844b51987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:51.647711 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff8a93-7598-4306-a073-3d0844b51987 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:51.648000 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff8a93-7598-4306-a073-3d0844b51987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:51.648852 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff8a93-7598-4306-a073-3d0844b51987 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:51.649035 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ff8a93-7598-4306-a073-3d0844b51987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:51.651195 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ff8a93-7598-4306-a073-3d0844b51987 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:51.668516 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 946/1899] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:22:51.671543 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe159e-7525-4882-ba40-864d42058f3d admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:51.684032 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe159e-7525-4882-ba40-864d42058f3d admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:51.691574 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5318e83-c8f2-428d-a394-b6b365dfcd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:51.692764 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5318e83-c8f2-428d-a394-b6b365dfcd6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:51.693146 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5318e83-c8f2-428d-a394-b6b365dfcd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:51.693527 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5318e83-c8f2-428d-a394-b6b365dfcd6f admin admin] PATH_INFO: `/v3/projects/b56a96b49ace4b5988d086b541300fc7/users/8d3ee657e3864a73b9d761bca94004f9/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:51.697104 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5318e83-c8f2-428d-a394-b6b365dfcd6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b56a96b49ace4b5988d086b541300fc7, user_id=8d3ee657e3864a73b9d761bca94004f9, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:51.700894 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5318e83-c8f2-428d-a394-b6b365dfcd6f admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:51.727723 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 954/1900] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:22:51 2022] PUT /identity/v3/projects/b56a96b49ace4b5988d086b541300fc7/users/8d3ee657e3864a73b9d761bca94004f9/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:22:51.739100 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba66ca-f9ad-417a-98ba-81b2742a40ab None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:51.739388 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba66ca-f9ad-417a-98ba-81b2742a40ab None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:51.741660 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba66ca-f9ad-417a-98ba-81b2742a40ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:51.770773 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-8dba66ca-f9ad-417a-98ba-81b2742a40ab None None] MFA Rules not processed for user `8d3ee657e3864a73b9d761bca94004f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:51.772126 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-8dba66ca-f9ad-417a-98ba-81b2742a40ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:51.784534 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:51.841637 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 947/1901] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:51 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:22:51.852788 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5318e83-c8f2-428d-a394-b6b365dfcd6f admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:51.854606 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-f5318e83-c8f2-428d-a394-b6b365dfcd6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:51.859118 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba66ca-f9ad-417a-98ba-81b2742a40ab None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:51.861582 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-8dba66ca-f9ad-417a-98ba-81b2742a40ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:51.925331 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5318e83-c8f2-428d-a394-b6b365dfcd6f admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:51.930800 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1d068-3c9d-48ff-9b92-fcc569bc0543 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:51.932719 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1d068-3c9d-48ff-9b92-fcc569bc0543 service cinder] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:51.933563 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1d068-3c9d-48ff-9b92-fcc569bc0543 service cinder] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:51.933848 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1d068-3c9d-48ff-9b92-fcc569bc0543 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:51.936222 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba66ca-f9ad-417a-98ba-81b2742a40ab None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:51.942442 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549e37e-f17b-4147-b0e6-55d0c81b80a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:51.943582 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549e37e-f17b-4147-b0e6-55d0c81b80a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:51.943965 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549e37e-f17b-4147-b0e6-55d0c81b80a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:51.944662 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549e37e-f17b-4147-b0e6-55d0c81b80a0 admin admin] PATH_INFO: `/v3/projects/7d2d68f519a74e1d894dc44db13bbb9d` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:51.948494 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1d068-3c9d-48ff-9b92-fcc569bc0543 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:51.948685 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2549e37e-f17b-4147-b0e6-55d0c81b80a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d2d68f519a74e1d894dc44db13bbb9d)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:51.948783 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1d068-3c9d-48ff-9b92-fcc569bc0543 service cinder] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:51.949022 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2549e37e-f17b-4147-b0e6-55d0c81b80a0 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:51.959879 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 955/1902] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:22:51 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:22:52.083029 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-2549e37e-f17b-4147-b0e6-55d0c81b80a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d2d68f519a74e1d894dc44db13bbb9d', 'request_id': 'req-2549e37e-f17b-4147-b0e6-55d0c81b80a0'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:52.091277 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-2549e37e-f17b-4147-b0e6-55d0c81b80a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d2d68f519a74e1d894dc44db13bbb9d', 'request_id': 'req-2549e37e-f17b-4147-b0e6-55d0c81b80a0'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:52.098193 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-2549e37e-f17b-4147-b0e6-55d0c81b80a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d2d68f519a74e1d894dc44db13bbb9d', 'request_id': 'req-2549e37e-f17b-4147-b0e6-55d0c81b80a0'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:52.197798 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-2549e37e-f17b-4147-b0e6-55d0c81b80a0 admin admin] The token cache is being invalidate because project 7d2d68f519a74e1d894dc44db13bbb9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:22:52.198107 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-2549e37e-f17b-4147-b0e6-55d0c81b80a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:52.198846 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-2549e37e-f17b-4147-b0e6-55d0c81b80a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:52.200558 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 948/1903] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:22:51 2022] DELETE /identity/v3/projects/7d2d68f519a74e1d894dc44db13bbb9d => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:22:52.208537 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199374f-6c0c-4d1d-a145-7402458b3229 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:52.209033 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199374f-6c0c-4d1d-a145-7402458b3229 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:52.209508 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199374f-6c0c-4d1d-a145-7402458b3229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:52.241887 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-0199374f-6c0c-4d1d-a145-7402458b3229 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:52.244889 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-0199374f-6c0c-4d1d-a145-7402458b3229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:52.301972 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:52.316746 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 956/1904] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:22:52.325918 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8da869-fddb-48e5-b615-1d7e5399cb6a None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:52.326446 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8da869-fddb-48e5-b615-1d7e5399cb6a None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:52.326689 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8da869-fddb-48e5-b615-1d7e5399cb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:52.347044 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-eb8da869-fddb-48e5-b615-1d7e5399cb6a None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:52.348505 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-eb8da869-fddb-48e5-b615-1d7e5399cb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:52.357202 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 949/1905] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:22:52.361507 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0199374f-6c0c-4d1d-a145-7402458b3229 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:52.372069 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0199374f-6c0c-4d1d-a145-7402458b3229 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:52.377147 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0331dcd-4113-4209-8fd8-15ab8d5a4168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:52.377810 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0331dcd-4113-4209-8fd8-15ab8d5a4168 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:52.378092 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0331dcd-4113-4209-8fd8-15ab8d5a4168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:52.378365 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0331dcd-4113-4209-8fd8-15ab8d5a4168 admin admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:52.379105 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0331dcd-4113-4209-8fd8-15ab8d5a4168 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:22:52.379411 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0331dcd-4113-4209-8fd8-15ab8d5a4168 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:52.381021 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0331dcd-4113-4209-8fd8-15ab8d5a4168 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:52.393561 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 957/1906] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:22:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:22:52.449616 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8da869-fddb-48e5-b615-1d7e5399cb6a None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:52.459884 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8da869-fddb-48e5-b615-1d7e5399cb6a None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:52.464516 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32419c7-25e7-40dd-994c-c190570ab637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:52.465169 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32419c7-25e7-40dd-994c-c190570ab637 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:52.467757 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32419c7-25e7-40dd-994c-c190570ab637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:52.467757 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32419c7-25e7-40dd-994c-c190570ab637 admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:52.467757 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32419c7-25e7-40dd-994c-c190570ab637 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:52.469217 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32419c7-25e7-40dd-994c-c190570ab637 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:52.552695 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 950/1907] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:22:52 2022] POST /identity/v3/projects => generated 407 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:22:52.556720 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0331dcd-4113-4209-8fd8-15ab8d5a4168 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:52.567139 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0331dcd-4113-4209-8fd8-15ab8d5a4168 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:52.628035 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab4fb7-1e7c-4558-acfe-ecde9cd6ddd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:52.628890 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab4fb7-1e7c-4558-acfe-ecde9cd6ddd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:52.629170 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab4fb7-1e7c-4558-acfe-ecde9cd6ddd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:52.629443 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab4fb7-1e7c-4558-acfe-ecde9cd6ddd8 admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:52.630131 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab4fb7-1e7c-4558-acfe-ecde9cd6ddd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:52.632024 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab4fb7-1e7c-4558-acfe-ecde9cd6ddd8 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:52.735152 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 958/1908] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:22:52 2022] POST /identity/v3/users => generated 304 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:22:52.739524 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32419c7-25e7-40dd-994c-c190570ab637 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:52.751640 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32419c7-25e7-40dd-994c-c190570ab637 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:52.755873 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c594168-0259-49bc-9a98-e84044e826b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:52.756578 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c594168-0259-49bc-9a98-e84044e826b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:52.756957 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c594168-0259-49bc-9a98-e84044e826b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:52.757358 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c594168-0259-49bc-9a98-e84044e826b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:52.758182 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c594168-0259-49bc-9a98-e84044e826b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:52.759987 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c594168-0259-49bc-9a98-e84044e826b3 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:52.766608 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:52.776029 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 951/1909] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:22:52.777291 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab4fb7-1e7c-4558-acfe-ecde9cd6ddd8 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:52.789752 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab4fb7-1e7c-4558-acfe-ecde9cd6ddd8 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:52.795935 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a249aba-bab1-4bc8-abbf-e97ba41ff764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:52.797733 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a249aba-bab1-4bc8-abbf-e97ba41ff764 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:52.798083 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a249aba-bab1-4bc8-abbf-e97ba41ff764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:52.798504 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a249aba-bab1-4bc8-abbf-e97ba41ff764 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:52.799329 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a249aba-bab1-4bc8-abbf-e97ba41ff764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:52.801018 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a249aba-bab1-4bc8-abbf-e97ba41ff764 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:52.816720 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 959/1910] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:22:52.817978 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c594168-0259-49bc-9a98-e84044e826b3 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:52.829002 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c594168-0259-49bc-9a98-e84044e826b3 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:52.834742 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea522292-f619-4fa1-ad55-ffdeb1155869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:52.835680 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea522292-f619-4fa1-ad55-ffdeb1155869 admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:52.835969 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea522292-f619-4fa1-ad55-ffdeb1155869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:52.836395 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea522292-f619-4fa1-ad55-ffdeb1155869 admin admin] PATH_INFO: `/v3/projects/11127196ca9a48a9be26c4fea86e6623/users/15004b261e684ac9ac57ef4ff6bc217b/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:52.856712 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea522292-f619-4fa1-ad55-ffdeb1155869 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11127196ca9a48a9be26c4fea86e6623, user_id=15004b261e684ac9ac57ef4ff6bc217b, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:52.860270 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea522292-f619-4fa1-ad55-ffdeb1155869 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:52.939783 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 952/1911] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:22:52 2022] PUT /identity/v3/projects/11127196ca9a48a9be26c4fea86e6623/users/15004b261e684ac9ac57ef4ff6bc217b/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:22:52.957361 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f30c5f-bf41-42c8-810c-344b9835aeca None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:52.957740 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f30c5f-bf41-42c8-810c-344b9835aeca None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:52.958029 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f30c5f-bf41-42c8-810c-344b9835aeca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:52.985898 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-42f30c5f-bf41-42c8-810c-344b9835aeca None None] MFA Rules not processed for user `15004b261e684ac9ac57ef4ff6bc217b`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:52.987049 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-42f30c5f-bf41-42c8-810c-344b9835aeca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:53.061196 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 960/1912] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:52 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:22:53.065953 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea522292-f619-4fa1-ad55-ffdeb1155869 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:53.137311 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea522292-f619-4fa1-ad55-ffdeb1155869 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:53.142142 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b8aa1-34ea-46d8-b60f-e042753a1bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:53.142812 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b8aa1-34ea-46d8-b60f-e042753a1bde admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:53.143095 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b8aa1-34ea-46d8-b60f-e042753a1bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:53.143372 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b8aa1-34ea-46d8-b60f-e042753a1bde admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:53.144060 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3b8aa1-34ea-46d8-b60f-e042753a1bde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:53.146048 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3b8aa1-34ea-46d8-b60f-e042753a1bde admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:53.235754 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f30c5f-bf41-42c8-810c-344b9835aeca None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:53.237221 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-42f30c5f-bf41-42c8-810c-344b9835aeca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:53.248962 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 953/1913] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:22:53 2022] POST /identity/v3/projects => generated 409 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:22:53.253087 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b8aa1-34ea-46d8-b60f-e042753a1bde admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:53.265705 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f30c5f-bf41-42c8-810c-344b9835aeca None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:53.313809 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:53.328371 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b1ba2-1ccf-4aef-bf39-c52fae8cd814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:53.329310 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b1ba2-1ccf-4aef-bf39-c52fae8cd814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:53.329604 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b1ba2-1ccf-4aef-bf39-c52fae8cd814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:53.329931 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b1ba2-1ccf-4aef-bf39-c52fae8cd814 admin admin] PATH_INFO: `/v3/users/fc806a3c2f8a4666b801a04839ba5220` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:53.331178 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b1ba2-1ccf-4aef-bf39-c52fae8cd814 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc806a3c2f8a4666b801a04839ba5220)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:53.331605 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b8aa1-34ea-46d8-b60f-e042753a1bde admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:53.333339 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b1ba2-1ccf-4aef-bf39-c52fae8cd814 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:53.336602 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e64f7-7869-415b-b660-43e2769a6a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:53.337490 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e64f7-7869-415b-b660-43e2769a6a3f admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:53.337843 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e64f7-7869-415b-b660-43e2769a6a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:53.338184 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e64f7-7869-415b-b660-43e2769a6a3f admin admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:53.338963 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269e64f7-7869-415b-b660-43e2769a6a3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:53.341732 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269e64f7-7869-415b-b660-43e2769a6a3f admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:53.445926 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 954/1914] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:22:53 2022] POST /identity/v3/users => generated 311 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:22:53.449611 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e64f7-7869-415b-b660-43e2769a6a3f admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:53.460553 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e64f7-7869-415b-b660-43e2769a6a3f admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:53.465257 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc1647-03da-4211-8b2d-e2ea3c6b5b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:53.465920 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc1647-03da-4211-8b2d-e2ea3c6b5b19 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:53.466201 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc1647-03da-4211-8b2d-e2ea3c6b5b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:53.466479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc1647-03da-4211-8b2d-e2ea3c6b5b19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:53.467393 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afc1647-03da-4211-8b2d-e2ea3c6b5b19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:53.469866 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afc1647-03da-4211-8b2d-e2ea3c6b5b19 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:53.480506 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 955/1915] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:22:53.485049 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc1647-03da-4211-8b2d-e2ea3c6b5b19 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:53.495202 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc1647-03da-4211-8b2d-e2ea3c6b5b19 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:53.499970 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a398e3a0-f1e7-4fb2-9af4-199d9b2c3a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:53.501144 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a398e3a0-f1e7-4fb2-9af4-199d9b2c3a35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:53.501431 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a398e3a0-f1e7-4fb2-9af4-199d9b2c3a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:53.501709 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a398e3a0-f1e7-4fb2-9af4-199d9b2c3a35 admin admin] PATH_INFO: `/v3/projects/17283ff8969946c0a97908c13d7d3afb/users/08aec94b4baf496c92f90c9fed5c0e32/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:53.518929 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a398e3a0-f1e7-4fb2-9af4-199d9b2c3a35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17283ff8969946c0a97908c13d7d3afb, user_id=08aec94b4baf496c92f90c9fed5c0e32, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:53.521819 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a398e3a0-f1e7-4fb2-9af4-199d9b2c3a35 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:53.546943 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-153b1ba2-1ccf-4aef-bf39-c52fae8cd814 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc806a3c2f8a4666b801a04839ba5220'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:53.562035 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-153b1ba2-1ccf-4aef-bf39-c52fae8cd814 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc806a3c2f8a4666b801a04839ba5220'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:53.562820 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-153b1ba2-1ccf-4aef-bf39-c52fae8cd814 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc806a3c2f8a4666b801a04839ba5220'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:53.571969 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-153b1ba2-1ccf-4aef-bf39-c52fae8cd814 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc806a3c2f8a4666b801a04839ba5220'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:53.572684 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-153b1ba2-1ccf-4aef-bf39-c52fae8cd814 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc806a3c2f8a4666b801a04839ba5220'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:53.619859 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 956/1916] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:22:53 2022] PUT /identity/v3/projects/17283ff8969946c0a97908c13d7d3afb/users/08aec94b4baf496c92f90c9fed5c0e32/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:22:53.623850 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a398e3a0-f1e7-4fb2-9af4-199d9b2c3a35 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:53.626365 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-a398e3a0-f1e7-4fb2-9af4-199d9b2c3a35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:53.645493 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:53.678726 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 961/1917] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:22:53 2022] DELETE /identity/v3/users/fc806a3c2f8a4666b801a04839ba5220 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:22:53.683694 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9f7a5-5b7b-42a2-a1b7-afd52067311c None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:53.683942 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9f7a5-5b7b-42a2-a1b7-afd52067311c None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:53.685063 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9f7a5-5b7b-42a2-a1b7-afd52067311c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:53.699420 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a398e3a0-f1e7-4fb2-9af4-199d9b2c3a35 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:53.705375 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-0ea9f7a5-5b7b-42a2-a1b7-afd52067311c None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:53.706595 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-0ea9f7a5-5b7b-42a2-a1b7-afd52067311c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:53.774550 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6ba82-1c5c-4f77-b194-95bbc719c0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:53.775141 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6ba82-1c5c-4f77-b194-95bbc719c0ae admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:53.775421 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6ba82-1c5c-4f77-b194-95bbc719c0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:53.775693 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6ba82-1c5c-4f77-b194-95bbc719c0ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:53.776463 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a6ba82-1c5c-4f77-b194-95bbc719c0ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:53.778123 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a6ba82-1c5c-4f77-b194-95bbc719c0ae admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:53.789977 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 957/1918] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:22:53.796623 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 962/1919] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:22:53.796827 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6ba82-1c5c-4f77-b194-95bbc719c0ae admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:53.804122 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea9f7a5-5b7b-42a2-a1b7-afd52067311c None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:53.805555 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-0ea9f7a5-5b7b-42a2-a1b7-afd52067311c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:53.805952 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6ba82-1c5c-4f77-b194-95bbc719c0ae admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:53.810800 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3fcc9-bd76-4b19-9f7b-786eefe8a5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:53.812365 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3fcc9-bd76-4b19-9f7b-786eefe8a5ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:53.812846 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3fcc9-bd76-4b19-9f7b-786eefe8a5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:53.813292 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3fcc9-bd76-4b19-9f7b-786eefe8a5ad admin admin] PATH_INFO: `/v3/projects/17283ff8969946c0a97908c13d7d3afb/users/08aec94b4baf496c92f90c9fed5c0e32/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:53.815397 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3fcc9-bd76-4b19-9f7b-786eefe8a5ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=17283ff8969946c0a97908c13d7d3afb, user_id=08aec94b4baf496c92f90c9fed5c0e32, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:53.818172 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3fcc9-bd76-4b19-9f7b-786eefe8a5ad admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:53.829889 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 958/1920] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:22:53 2022] PUT /identity/v3/projects/17283ff8969946c0a97908c13d7d3afb/users/08aec94b4baf496c92f90c9fed5c0e32/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:22:53.841967 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12547115-9fda-4394-8fb1-d7f93a0d3b33 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:53.842373 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12547115-9fda-4394-8fb1-d7f93a0d3b33 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:53.842802 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12547115-9fda-4394-8fb1-d7f93a0d3b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:53.870839 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-12547115-9fda-4394-8fb1-d7f93a0d3b33 None None] MFA Rules not processed for user `08aec94b4baf496c92f90c9fed5c0e32`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:53.871842 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea9f7a5-5b7b-42a2-a1b7-afd52067311c None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:53.872102 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-12547115-9fda-4394-8fb1-d7f93a0d3b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:53.897635 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:53.928103 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ed4ab-bf3a-4962-9cf4-fb400885ac4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:53.929679 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ed4ab-bf3a-4962-9cf4-fb400885ac4f service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:53.929975 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ed4ab-bf3a-4962-9cf4-fb400885ac4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:53.930640 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ed4ab-bf3a-4962-9cf4-fb400885ac4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:53.986257 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 959/1921] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:53 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:22:54.006803 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12547115-9fda-4394-8fb1-d7f93a0d3b33 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:54.008980 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-12547115-9fda-4394-8fb1-d7f93a0d3b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:54.049680 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ed4ab-bf3a-4962-9cf4-fb400885ac4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:54.053566 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ed4ab-bf3a-4962-9cf4-fb400885ac4f service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:54.066524 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:54.069574 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 963/1922] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:22:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 13:22:54.098267 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12547115-9fda-4394-8fb1-d7f93a0d3b33 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:54.102541 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ea5af-c60a-467f-8112-debd79ae9fe2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:54.103184 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ea5af-c60a-467f-8112-debd79ae9fe2 service cinder] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:54.103542 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ea5af-c60a-467f-8112-debd79ae9fe2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:54.103893 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ea5af-c60a-467f-8112-debd79ae9fe2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:54.124024 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ea5af-c60a-467f-8112-debd79ae9fe2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:54.127226 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ea5af-c60a-467f-8112-debd79ae9fe2 service cinder] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:54.138015 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 960/1923] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:22:54 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 13:22:54.672683 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ed4ab-bf3a-4962-9cf4-fb400885ac4f service neutron] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:54.674845 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-349ed4ab-bf3a-4962-9cf4-fb400885ac4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:54.687941 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ed4ab-bf3a-4962-9cf4-fb400885ac4f service neutron] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:54.691647 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d722718a-a628-4d32-86d0-5761f73da82b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:54.692339 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722718a-a628-4d32-86d0-5761f73da82b service cinder] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:54.693305 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722718a-a628-4d32-86d0-5761f73da82b service cinder] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:54.693537 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722718a-a628-4d32-86d0-5761f73da82b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:54.695414 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-d722718a-a628-4d32-86d0-5761f73da82b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:54.763579 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d722718a-a628-4d32-86d0-5761f73da82b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:54.765814 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d722718a-a628-4d32-86d0-5761f73da82b service cinder] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:54.776364 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 964/1924] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:22:54 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:22:54.895828 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ea5af-c60a-467f-8112-debd79ae9fe2 service cinder] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:54.898659 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-6b7ea5af-c60a-467f-8112-debd79ae9fe2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:54.911619 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ea5af-c60a-467f-8112-debd79ae9fe2 service cinder] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:54.916402 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85485b3a-c2ef-4d10-a469-b23540f7ec9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:54.917269 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85485b3a-c2ef-4d10-a469-b23540f7ec9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:54.917552 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85485b3a-c2ef-4d10-a469-b23540f7ec9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:54.917824 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85485b3a-c2ef-4d10-a469-b23540f7ec9f admin admin] PATH_INFO: `/v3/projects/ff9c54aae1884acf9003781e5926e191` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:54.919020 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85485b3a-c2ef-4d10-a469-b23540f7ec9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff9c54aae1884acf9003781e5926e191)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:54.921994 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85485b3a-c2ef-4d10-a469-b23540f7ec9f admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:55.058914 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-85485b3a-c2ef-4d10-a469-b23540f7ec9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff9c54aae1884acf9003781e5926e191', 'request_id': 'req-85485b3a-c2ef-4d10-a469-b23540f7ec9f'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:55.066885 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-85485b3a-c2ef-4d10-a469-b23540f7ec9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff9c54aae1884acf9003781e5926e191', 'request_id': 'req-85485b3a-c2ef-4d10-a469-b23540f7ec9f'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:55.074579 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-85485b3a-c2ef-4d10-a469-b23540f7ec9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff9c54aae1884acf9003781e5926e191', 'request_id': 'req-85485b3a-c2ef-4d10-a469-b23540f7ec9f'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:55.203085 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-85485b3a-c2ef-4d10-a469-b23540f7ec9f admin admin] The token cache is being invalidate because project ff9c54aae1884acf9003781e5926e191 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:22:55.203085 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-85485b3a-c2ef-4d10-a469-b23540f7ec9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:55.204093 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-85485b3a-c2ef-4d10-a469-b23540f7ec9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:55.207303 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 961/1925] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:22:54 2022] DELETE /identity/v3/projects/ff9c54aae1884acf9003781e5926e191 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:22:55.211435 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d722718a-a628-4d32-86d0-5761f73da82b service cinder] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:55.226306 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d722718a-a628-4d32-86d0-5761f73da82b service cinder] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:55.298907 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9478ad8-fb96-4f4c-801c-63df20030ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:55.299799 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9478ad8-fb96-4f4c-801c-63df20030ab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:55.300079 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9478ad8-fb96-4f4c-801c-63df20030ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:55.300400 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9478ad8-fb96-4f4c-801c-63df20030ab6 admin admin] PATH_INFO: `/v3/users/8d3ee657e3864a73b9d761bca94004f9` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:55.301604 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9478ad8-fb96-4f4c-801c-63df20030ab6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d3ee657e3864a73b9d761bca94004f9)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:55.303587 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9478ad8-fb96-4f4c-801c-63df20030ab6 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:55.320347 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:55.546956 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-b9478ad8-fb96-4f4c-801c-63df20030ab6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d3ee657e3864a73b9d761bca94004f9'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:55.559959 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-b9478ad8-fb96-4f4c-801c-63df20030ab6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d3ee657e3864a73b9d761bca94004f9'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:55.560819 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-b9478ad8-fb96-4f4c-801c-63df20030ab6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d3ee657e3864a73b9d761bca94004f9'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:55.572862 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-b9478ad8-fb96-4f4c-801c-63df20030ab6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d3ee657e3864a73b9d761bca94004f9'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:55.573879 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-b9478ad8-fb96-4f4c-801c-63df20030ab6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d3ee657e3864a73b9d761bca94004f9'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:55.654919 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 965/1926] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:22:55 2022] DELETE /identity/v3/users/8d3ee657e3864a73b9d761bca94004f9 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:22:56.288129 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85485b3a-c2ef-4d10-a469-b23540f7ec9f admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:56.289696 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-85485b3a-c2ef-4d10-a469-b23540f7ec9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:56.303953 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85485b3a-c2ef-4d10-a469-b23540f7ec9f admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:56.376909 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81bafc-c295-428b-8e9b-6bf1ef6153a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:56.377841 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81bafc-c295-428b-8e9b-6bf1ef6153a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:56.378118 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81bafc-c295-428b-8e9b-6bf1ef6153a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:56.378396 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81bafc-c295-428b-8e9b-6bf1ef6153a3 admin admin] PATH_INFO: `/v3/projects/b56a96b49ace4b5988d086b541300fc7` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:56.379599 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab81bafc-c295-428b-8e9b-6bf1ef6153a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b56a96b49ace4b5988d086b541300fc7)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:56.381537 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab81bafc-c295-428b-8e9b-6bf1ef6153a3 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:56.520222 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-ab81bafc-c295-428b-8e9b-6bf1ef6153a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b56a96b49ace4b5988d086b541300fc7', 'request_id': 'req-ab81bafc-c295-428b-8e9b-6bf1ef6153a3'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:56.527910 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-ab81bafc-c295-428b-8e9b-6bf1ef6153a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b56a96b49ace4b5988d086b541300fc7', 'request_id': 'req-ab81bafc-c295-428b-8e9b-6bf1ef6153a3'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:56.534970 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:56.537320 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-ab81bafc-c295-428b-8e9b-6bf1ef6153a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b56a96b49ace4b5988d086b541300fc7', 'request_id': 'req-ab81bafc-c295-428b-8e9b-6bf1ef6153a3'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:56.678165 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-ab81bafc-c295-428b-8e9b-6bf1ef6153a3 admin admin] The token cache is being invalidate because project b56a96b49ace4b5988d086b541300fc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:22:56.678526 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-ab81bafc-c295-428b-8e9b-6bf1ef6153a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:56.679396 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-ab81bafc-c295-428b-8e9b-6bf1ef6153a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:22:56.681376 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 962/1927] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:22:56 2022] DELETE /identity/v3/projects/b56a96b49ace4b5988d086b541300fc7 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:22:56.686191 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841beb4-e4f8-4b94-8304-ee2388d4dcc0 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:56.688408 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841beb4-e4f8-4b94-8304-ee2388d4dcc0 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:56.688755 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841beb4-e4f8-4b94-8304-ee2388d4dcc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:56.707394 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-f841beb4-e4f8-4b94-8304-ee2388d4dcc0 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:56.708643 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-f841beb4-e4f8-4b94-8304-ee2388d4dcc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:56.783875 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 966/1928] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:22:56.791738 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6342a4-8b98-4169-ba07-b53e3951bee8 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:56.792009 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6342a4-8b98-4169-ba07-b53e3951bee8 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:56.792325 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6342a4-8b98-4169-ba07-b53e3951bee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:56.811903 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-4c6342a4-8b98-4169-ba07-b53e3951bee8 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:56.813501 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-4c6342a4-8b98-4169-ba07-b53e3951bee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:56.825466 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 963/1929] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:22:56.826559 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841beb4-e4f8-4b94-8304-ee2388d4dcc0 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:56.837361 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841beb4-e4f8-4b94-8304-ee2388d4dcc0 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:56.844122 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e344f-5bab-414b-a7cd-3505ca8a4f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:56.845152 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e344f-5bab-414b-a7cd-3505ca8a4f46 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:56.845605 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e344f-5bab-414b-a7cd-3505ca8a4f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:56.846295 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e344f-5bab-414b-a7cd-3505ca8a4f46 admin admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:56.848000 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e344f-5bab-414b-a7cd-3505ca8a4f46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:22:56.848475 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e344f-5bab-414b-a7cd-3505ca8a4f46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:56.850264 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e344f-5bab-414b-a7cd-3505ca8a4f46 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:56.871339 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 967/1930] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:22:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:22:56.872727 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6342a4-8b98-4169-ba07-b53e3951bee8 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:56.887800 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6342a4-8b98-4169-ba07-b53e3951bee8 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:56.895896 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25993a17-496e-446e-af78-9d8e288c6d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:56.895896 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25993a17-496e-446e-af78-9d8e288c6d81 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:56.895896 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25993a17-496e-446e-af78-9d8e288c6d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:56.895896 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25993a17-496e-446e-af78-9d8e288c6d81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:56.896341 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25993a17-496e-446e-af78-9d8e288c6d81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:56.897155 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25993a17-496e-446e-af78-9d8e288c6d81 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:57.000450 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 964/1931] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:22:56 2022] POST /identity/v3/projects => generated 375 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:22:57.007536 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e344f-5bab-414b-a7cd-3505ca8a4f46 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:57.020308 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e344f-5bab-414b-a7cd-3505ca8a4f46 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:57.119982 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0d682-692a-47b5-83ad-2b8f5bf9c471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:57.120793 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0d682-692a-47b5-83ad-2b8f5bf9c471 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:57.121075 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0d682-692a-47b5-83ad-2b8f5bf9c471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:57.121406 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0d682-692a-47b5-83ad-2b8f5bf9c471 admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:57.122066 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f0d682-692a-47b5-83ad-2b8f5bf9c471 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:57.124098 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f0d682-692a-47b5-83ad-2b8f5bf9c471 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:57.244363 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 968/1932] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:22:57 2022] POST /identity/v3/users => generated 288 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:22:57.249768 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25993a17-496e-446e-af78-9d8e288c6d81 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:57.261073 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25993a17-496e-446e-af78-9d8e288c6d81 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:57.267495 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c2c04-4ad5-42c4-a2a3-01d0f8b8c87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:57.268213 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c2c04-4ad5-42c4-a2a3-01d0f8b8c87f admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:57.268499 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c2c04-4ad5-42c4-a2a3-01d0f8b8c87f admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:57.268807 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c2c04-4ad5-42c4-a2a3-01d0f8b8c87f admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:57.269545 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c2c04-4ad5-42c4-a2a3-01d0f8b8c87f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:57.272327 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c2c04-4ad5-42c4-a2a3-01d0f8b8c87f admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:57.288112 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 965/1933] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:22:57.289091 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0d682-692a-47b5-83ad-2b8f5bf9c471 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:57.302739 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0d682-692a-47b5-83ad-2b8f5bf9c471 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:57.307716 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01115717-901a-447f-b115-57f0e2b6c9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:57.308557 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01115717-901a-447f-b115-57f0e2b6c9d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:57.309989 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01115717-901a-447f-b115-57f0e2b6c9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:57.309989 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01115717-901a-447f-b115-57f0e2b6c9d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:57.309989 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01115717-901a-447f-b115-57f0e2b6c9d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:57.312833 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01115717-901a-447f-b115-57f0e2b6c9d6 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:57.314692 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:22:57.327714 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 969/1934] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:22:57.331183 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c2c04-4ad5-42c4-a2a3-01d0f8b8c87f admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:57.342506 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c2c04-4ad5-42c4-a2a3-01d0f8b8c87f admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:57.349622 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5764f3-dda4-45a9-90de-f4b927331bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:57.350930 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5764f3-dda4-45a9-90de-f4b927331bde admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:57.351289 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5764f3-dda4-45a9-90de-f4b927331bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:57.351634 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5764f3-dda4-45a9-90de-f4b927331bde admin admin] PATH_INFO: `/v3/projects/768f96630d764620a260d66c3b314263/users/88526ddc350e4a90a4b131bb05eb96aa/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:57.373680 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5764f3-dda4-45a9-90de-f4b927331bde admin admin] RBAC: Authorizing `identity:create_grant(project_id=768f96630d764620a260d66c3b314263, user_id=88526ddc350e4a90a4b131bb05eb96aa, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:57.377548 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5764f3-dda4-45a9-90de-f4b927331bde admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:57.510522 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 966/1935] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:22:57 2022] PUT /identity/v3/projects/768f96630d764620a260d66c3b314263/users/88526ddc350e4a90a4b131bb05eb96aa/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:22:57.521426 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0b555-afcf-4860-979d-886e14a4edef None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:57.521800 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0b555-afcf-4860-979d-886e14a4edef None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:57.522144 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0b555-afcf-4860-979d-886e14a4edef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:57.562612 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-5af0b555-afcf-4860-979d-886e14a4edef None None] MFA Rules not processed for user `88526ddc350e4a90a4b131bb05eb96aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:22:57.563832 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-5af0b555-afcf-4860-979d-886e14a4edef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:57.636801 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 970/1936] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:22:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:22:57.656058 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5764f3-dda4-45a9-90de-f4b927331bde admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:22:57.656058 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-ac5764f3-dda4-45a9-90de-f4b927331bde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:22:57.745692 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5764f3-dda4-45a9-90de-f4b927331bde admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:22:57.750761 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2acf32-b54d-4859-b493-a5bd1f0cfd83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:22:57.751634 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2acf32-b54d-4859-b493-a5bd1f0cfd83 service cinder] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:22:57.752512 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2acf32-b54d-4859-b493-a5bd1f0cfd83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:22:57.752512 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2acf32-b54d-4859-b493-a5bd1f0cfd83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:22:57.772137 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2acf32-b54d-4859-b493-a5bd1f0cfd83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:22:57.773889 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2acf32-b54d-4859-b493-a5bd1f0cfd83 service cinder] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:22:57.788071 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 967/1937] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:22:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:23:04.671674 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0b555-afcf-4860-979d-886e14a4edef None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:04.674525 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-5af0b555-afcf-4860-979d-886e14a4edef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:04.742721 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0b555-afcf-4860-979d-886e14a4edef None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:04.747529 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c73ec-bebc-4e37-bbb0-1fe1256a0edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:04.748445 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c73ec-bebc-4e37-bbb0-1fe1256a0edc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:04.748725 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c73ec-bebc-4e37-bbb0-1fe1256a0edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:04.749114 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c73ec-bebc-4e37-bbb0-1fe1256a0edc admin admin] PATH_INFO: `/v3/users/7e46a995080e479082b439cdec796fb1` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:04.751088 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c73ec-bebc-4e37-bbb0-1fe1256a0edc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e46a995080e479082b439cdec796fb1)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:04.753151 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c73ec-bebc-4e37-bbb0-1fe1256a0edc admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:04.959562 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-3d4c73ec-bebc-4e37-bbb0-1fe1256a0edc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e46a995080e479082b439cdec796fb1'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:04.973944 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-3d4c73ec-bebc-4e37-bbb0-1fe1256a0edc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e46a995080e479082b439cdec796fb1'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:04.974636 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-3d4c73ec-bebc-4e37-bbb0-1fe1256a0edc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e46a995080e479082b439cdec796fb1'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:04.981477 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-3d4c73ec-bebc-4e37-bbb0-1fe1256a0edc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e46a995080e479082b439cdec796fb1'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:04.982179 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-3d4c73ec-bebc-4e37-bbb0-1fe1256a0edc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e46a995080e479082b439cdec796fb1'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:05.066911 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 971/1938] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:23:04 2022] DELETE /identity/v3/users/7e46a995080e479082b439cdec796fb1 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:23:05.072009 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a2ddd-fa08-41de-829a-f482b3983eaa None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:05.072913 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a2ddd-fa08-41de-829a-f482b3983eaa None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:05.073391 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a2ddd-fa08-41de-829a-f482b3983eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:05.100926 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-200a2ddd-fa08-41de-829a-f482b3983eaa None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:23:05.102261 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-200a2ddd-fa08-41de-829a-f482b3983eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:05.167806 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 968/1939] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:23:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:23:05.177971 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c73ec-bebc-4e37-bbb0-1fe1256a0edc admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:05.180066 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-3d4c73ec-bebc-4e37-bbb0-1fe1256a0edc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:05.188877 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:05.244630 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c73ec-bebc-4e37-bbb0-1fe1256a0edc admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:05.248246 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4584e9-43fc-48ed-b158-73b59c413100 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:05.248902 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4584e9-43fc-48ed-b158-73b59c413100 service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:05.249191 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4584e9-43fc-48ed-b158-73b59c413100 service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:05.249470 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4584e9-43fc-48ed-b158-73b59c413100 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:05.259269 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4584e9-43fc-48ed-b158-73b59c413100 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:05.260737 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4584e9-43fc-48ed-b158-73b59c413100 service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:05.270695 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 972/1940] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:23:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:23:05.717686 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a2ddd-fa08-41de-829a-f482b3983eaa None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:05.720070 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-200a2ddd-fa08-41de-829a-f482b3983eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:05.734187 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a2ddd-fa08-41de-829a-f482b3983eaa None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:05.740211 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e95a87-4f00-4afc-b847-3470af47707d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:05.741425 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e95a87-4f00-4afc-b847-3470af47707d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:05.742416 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e95a87-4f00-4afc-b847-3470af47707d admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:05.742906 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e95a87-4f00-4afc-b847-3470af47707d admin admin] PATH_INFO: `/v3/projects/542f8c5303b84e719623bfc48613fa44` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:05.744978 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e95a87-4f00-4afc-b847-3470af47707d admin admin] RBAC: Authorizing `identity:delete_project(project_id=542f8c5303b84e719623bfc48613fa44)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:05.747424 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e95a87-4f00-4afc-b847-3470af47707d admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:05.778675 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:05.889386 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-e5e95a87-4f00-4afc-b847-3470af47707d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '542f8c5303b84e719623bfc48613fa44', 'request_id': 'req-e5e95a87-4f00-4afc-b847-3470af47707d'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:05.899278 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-e5e95a87-4f00-4afc-b847-3470af47707d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '542f8c5303b84e719623bfc48613fa44', 'request_id': 'req-e5e95a87-4f00-4afc-b847-3470af47707d'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:05.905269 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-e5e95a87-4f00-4afc-b847-3470af47707d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '542f8c5303b84e719623bfc48613fa44', 'request_id': 'req-e5e95a87-4f00-4afc-b847-3470af47707d'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:05.971202 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-e5e95a87-4f00-4afc-b847-3470af47707d admin admin] The token cache is being invalidate because project 542f8c5303b84e719623bfc48613fa44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:23:05.971975 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-e5e95a87-4f00-4afc-b847-3470af47707d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:05.972729 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-e5e95a87-4f00-4afc-b847-3470af47707d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:05.974315 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 969/1941] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:23:05 2022] DELETE /identity/v3/projects/542f8c5303b84e719623bfc48613fa44 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:23:05.978229 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4584e9-43fc-48ed-b158-73b59c413100 service neutron] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:05.988731 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4584e9-43fc-48ed-b158-73b59c413100 service neutron] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:06.049514 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee04c1-14e7-48ea-b62f-10d9089dfdc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:06.050394 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee04c1-14e7-48ea-b62f-10d9089dfdc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:06.050680 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee04c1-14e7-48ea-b62f-10d9089dfdc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:06.050951 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee04c1-14e7-48ea-b62f-10d9089dfdc8 admin admin] PATH_INFO: `/v3/users/a51ece381ed7485b9859cade8d8eaacf` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:06.052191 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee04c1-14e7-48ea-b62f-10d9089dfdc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a51ece381ed7485b9859cade8d8eaacf)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:06.054104 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee04c1-14e7-48ea-b62f-10d9089dfdc8 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:06.225021 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-77ee04c1-14e7-48ea-b62f-10d9089dfdc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a51ece381ed7485b9859cade8d8eaacf'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:06.240694 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-77ee04c1-14e7-48ea-b62f-10d9089dfdc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a51ece381ed7485b9859cade8d8eaacf'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:06.241445 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-77ee04c1-14e7-48ea-b62f-10d9089dfdc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a51ece381ed7485b9859cade8d8eaacf'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:06.248844 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-77ee04c1-14e7-48ea-b62f-10d9089dfdc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a51ece381ed7485b9859cade8d8eaacf'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:06.249528 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-77ee04c1-14e7-48ea-b62f-10d9089dfdc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a51ece381ed7485b9859cade8d8eaacf'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:06.321675 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 973/1942] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:23:05 2022] DELETE /identity/v3/users/a51ece381ed7485b9859cade8d8eaacf => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:23:06.746239 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e95a87-4f00-4afc-b847-3470af47707d admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:06.747755 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-e5e95a87-4f00-4afc-b847-3470af47707d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:06.762456 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e95a87-4f00-4afc-b847-3470af47707d admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:06.824494 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84868f7a-3e45-4f09-a77f-c0fd6e9df98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:06.825261 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84868f7a-3e45-4f09-a77f-c0fd6e9df98e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:06.825549 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84868f7a-3e45-4f09-a77f-c0fd6e9df98e admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:06.825828 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84868f7a-3e45-4f09-a77f-c0fd6e9df98e admin admin] PATH_INFO: `/v3/projects/5325b483a8f64a9aac96e8cf2721b703` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:06.827021 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84868f7a-3e45-4f09-a77f-c0fd6e9df98e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5325b483a8f64a9aac96e8cf2721b703)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:06.829487 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84868f7a-3e45-4f09-a77f-c0fd6e9df98e admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:06.956909 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-84868f7a-3e45-4f09-a77f-c0fd6e9df98e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5325b483a8f64a9aac96e8cf2721b703', 'request_id': 'req-84868f7a-3e45-4f09-a77f-c0fd6e9df98e'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:06.963114 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-84868f7a-3e45-4f09-a77f-c0fd6e9df98e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5325b483a8f64a9aac96e8cf2721b703', 'request_id': 'req-84868f7a-3e45-4f09-a77f-c0fd6e9df98e'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:06.968889 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-84868f7a-3e45-4f09-a77f-c0fd6e9df98e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5325b483a8f64a9aac96e8cf2721b703', 'request_id': 'req-84868f7a-3e45-4f09-a77f-c0fd6e9df98e'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:07.054011 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-84868f7a-3e45-4f09-a77f-c0fd6e9df98e admin admin] The token cache is being invalidate because project 5325b483a8f64a9aac96e8cf2721b703 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:23:07.054300 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-84868f7a-3e45-4f09-a77f-c0fd6e9df98e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:07.054913 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-84868f7a-3e45-4f09-a77f-c0fd6e9df98e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:07.056524 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 970/1943] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:23:06 2022] DELETE /identity/v3/projects/5325b483a8f64a9aac96e8cf2721b703 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:23:07.063924 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e096263-07ae-4e64-9111-a1e50f61e2d7 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:07.064449 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e096263-07ae-4e64-9111-a1e50f61e2d7 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:07.064561 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e096263-07ae-4e64-9111-a1e50f61e2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:07.081934 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-9e096263-07ae-4e64-9111-a1e50f61e2d7 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:23:07.083087 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-9e096263-07ae-4e64-9111-a1e50f61e2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:07.103766 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:07.142077 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 974/1944] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:23:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:23:07.149657 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543e8ac-6243-4469-82d2-8ca5042bd350 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:07.149948 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543e8ac-6243-4469-82d2-8ca5042bd350 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:07.150229 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543e8ac-6243-4469-82d2-8ca5042bd350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:07.169084 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-b543e8ac-6243-4469-82d2-8ca5042bd350 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:23:07.170295 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-b543e8ac-6243-4469-82d2-8ca5042bd350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:07.178846 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 971/1945] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:23:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:23:07.184113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e096263-07ae-4e64-9111-a1e50f61e2d7 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:07.194329 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e096263-07ae-4e64-9111-a1e50f61e2d7 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:07.198910 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa17917-c26f-431c-be59-47c16c06b0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:07.199559 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa17917-c26f-431c-be59-47c16c06b0c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:07.199838 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa17917-c26f-431c-be59-47c16c06b0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:07.200112 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa17917-c26f-431c-be59-47c16c06b0c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:07.200899 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa17917-c26f-431c-be59-47c16c06b0c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:23:07.201203 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa17917-c26f-431c-be59-47c16c06b0c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:07.208291 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa17917-c26f-431c-be59-47c16c06b0c4 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:07.214234 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 975/1946] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:23:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:23:07.218584 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b543e8ac-6243-4469-82d2-8ca5042bd350 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:07.228256 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b543e8ac-6243-4469-82d2-8ca5042bd350 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:07.232971 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2a440-7797-4f88-b133-1b1406060169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:07.233616 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2a440-7797-4f88-b133-1b1406060169 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:07.233899 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2a440-7797-4f88-b133-1b1406060169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:07.234174 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2a440-7797-4f88-b133-1b1406060169 admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:07.235668 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e2a440-7797-4f88-b133-1b1406060169 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:07.237648 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e2a440-7797-4f88-b133-1b1406060169 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:07.346630 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 972/1947] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:23:07 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:23:07.349309 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa17917-c26f-431c-be59-47c16c06b0c4 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:07.360082 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa17917-c26f-431c-be59-47c16c06b0c4 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:07.424868 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb660fd2-9edb-41e9-9b38-4f721b9d848e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:07.425574 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb660fd2-9edb-41e9-9b38-4f721b9d848e admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:07.425857 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb660fd2-9edb-41e9-9b38-4f721b9d848e admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:07.426130 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb660fd2-9edb-41e9-9b38-4f721b9d848e admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:07.427614 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb660fd2-9edb-41e9-9b38-4f721b9d848e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:07.429565 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb660fd2-9edb-41e9-9b38-4f721b9d848e admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:07.543834 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 976/1948] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:23:07 2022] POST /identity/v3/users => generated 292 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:23:07.547843 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2a440-7797-4f88-b133-1b1406060169 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:07.558149 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2a440-7797-4f88-b133-1b1406060169 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:07.563637 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611cf43d-dc8f-4563-b1d7-9e0c24aecdb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:07.563885 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611cf43d-dc8f-4563-b1d7-9e0c24aecdb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:07.564230 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611cf43d-dc8f-4563-b1d7-9e0c24aecdb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:07.564680 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611cf43d-dc8f-4563-b1d7-9e0c24aecdb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:07.565492 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611cf43d-dc8f-4563-b1d7-9e0c24aecdb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:07.567194 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611cf43d-dc8f-4563-b1d7-9e0c24aecdb7 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:07.573125 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:07.579694 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 973/1949] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:23:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:23:07.583784 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb660fd2-9edb-41e9-9b38-4f721b9d848e admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:07.595227 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb660fd2-9edb-41e9-9b38-4f721b9d848e admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:07.600177 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b50c4-e13a-4eed-a2a7-a33b2b8047a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:07.600871 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b50c4-e13a-4eed-a2a7-a33b2b8047a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:07.601181 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b50c4-e13a-4eed-a2a7-a33b2b8047a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:07.601472 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b50c4-e13a-4eed-a2a7-a33b2b8047a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:07.602284 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b50c4-e13a-4eed-a2a7-a33b2b8047a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:07.603936 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b50c4-e13a-4eed-a2a7-a33b2b8047a5 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:07.615149 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 977/1950] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:23:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:23:07.619420 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611cf43d-dc8f-4563-b1d7-9e0c24aecdb7 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:07.629693 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611cf43d-dc8f-4563-b1d7-9e0c24aecdb7 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:07.634381 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721ef15-c19d-4b9a-af94-5beafc85edc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:07.635261 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721ef15-c19d-4b9a-af94-5beafc85edc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:07.635542 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721ef15-c19d-4b9a-af94-5beafc85edc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:07.635817 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721ef15-c19d-4b9a-af94-5beafc85edc0 admin admin] PATH_INFO: `/v3/projects/9bf911953602479c963a9e15fd205415/users/8f78e744932c4241b3a346254ee3ee7c/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:07.650756 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b721ef15-c19d-4b9a-af94-5beafc85edc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bf911953602479c963a9e15fd205415, user_id=8f78e744932c4241b3a346254ee3ee7c, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:07.653442 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b721ef15-c19d-4b9a-af94-5beafc85edc0 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:07.716446 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 974/1951] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:23:07 2022] PUT /identity/v3/projects/9bf911953602479c963a9e15fd205415/users/8f78e744932c4241b3a346254ee3ee7c/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:23:07.726981 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b5699-86fa-431a-a553-2e109f314985 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:07.727275 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b5699-86fa-431a-a553-2e109f314985 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:07.727558 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b5699-86fa-431a-a553-2e109f314985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:07.754514 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-045b5699-86fa-431a-a553-2e109f314985 None None] MFA Rules not processed for user `8f78e744932c4241b3a346254ee3ee7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:23:07.755738 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-045b5699-86fa-431a-a553-2e109f314985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:07.819088 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 978/1952] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:23:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:23:07.830949 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721ef15-c19d-4b9a-af94-5beafc85edc0 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:07.832726 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-b721ef15-c19d-4b9a-af94-5beafc85edc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:07.889578 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721ef15-c19d-4b9a-af94-5beafc85edc0 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:07.894119 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4eb3ee-a68f-4c89-a76f-8996f84cbd15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:07.894761 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4eb3ee-a68f-4c89-a76f-8996f84cbd15 service cinder] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:07.895043 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4eb3ee-a68f-4c89-a76f-8996f84cbd15 service cinder] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:07.895319 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4eb3ee-a68f-4c89-a76f-8996f84cbd15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:07.903648 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4eb3ee-a68f-4c89-a76f-8996f84cbd15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:07.905115 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4eb3ee-a68f-4c89-a76f-8996f84cbd15 service cinder] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:07.913846 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 975/1953] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:23:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:23:11.439048 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b5699-86fa-431a-a553-2e109f314985 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:11.440613 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-045b5699-86fa-431a-a553-2e109f314985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:11.466473 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:11.508760 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b5699-86fa-431a-a553-2e109f314985 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:11.513200 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716cebca-0c1e-47e1-a06b-87fe65105fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:11.514106 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716cebca-0c1e-47e1-a06b-87fe65105fcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:11.514387 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716cebca-0c1e-47e1-a06b-87fe65105fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:11.519652 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716cebca-0c1e-47e1-a06b-87fe65105fcf admin admin] PATH_INFO: `/v3/users/15004b261e684ac9ac57ef4ff6bc217b` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:11.519652 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716cebca-0c1e-47e1-a06b-87fe65105fcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=15004b261e684ac9ac57ef4ff6bc217b)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:11.519652 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716cebca-0c1e-47e1-a06b-87fe65105fcf admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:11.672877 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-716cebca-0c1e-47e1-a06b-87fe65105fcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15004b261e684ac9ac57ef4ff6bc217b'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:11.684519 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-716cebca-0c1e-47e1-a06b-87fe65105fcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15004b261e684ac9ac57ef4ff6bc217b'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:11.685197 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-716cebca-0c1e-47e1-a06b-87fe65105fcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15004b261e684ac9ac57ef4ff6bc217b'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:11.692167 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-716cebca-0c1e-47e1-a06b-87fe65105fcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15004b261e684ac9ac57ef4ff6bc217b'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:11.692787 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-716cebca-0c1e-47e1-a06b-87fe65105fcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15004b261e684ac9ac57ef4ff6bc217b'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:11.750211 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 979/1954] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:23:11 2022] DELETE /identity/v3/users/15004b261e684ac9ac57ef4ff6bc217b => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:23:11.754764 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e04328-6403-410d-98bf-2d6273230ba9 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:11.764997 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e04328-6403-410d-98bf-2d6273230ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:11.764997 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e04328-6403-410d-98bf-2d6273230ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:11.772506 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-79e04328-6403-410d-98bf-2d6273230ba9 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:23:11.773732 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-79e04328-6403-410d-98bf-2d6273230ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:11.833434 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 976/1955] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:23:11.842949 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716cebca-0c1e-47e1-a06b-87fe65105fcf admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:11.844990 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-716cebca-0c1e-47e1-a06b-87fe65105fcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:11.901154 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716cebca-0c1e-47e1-a06b-87fe65105fcf admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:11.904785 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1167af3-94ca-4dda-b77e-dd74d9a12c22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:11.905425 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1167af3-94ca-4dda-b77e-dd74d9a12c22 service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:11.905705 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1167af3-94ca-4dda-b77e-dd74d9a12c22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:11.905977 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1167af3-94ca-4dda-b77e-dd74d9a12c22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:11.915872 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1167af3-94ca-4dda-b77e-dd74d9a12c22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:11.917359 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1167af3-94ca-4dda-b77e-dd74d9a12c22 service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:11.927548 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 980/1956] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:23:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:23:12.334827 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e04328-6403-410d-98bf-2d6273230ba9 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:12.336477 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-79e04328-6403-410d-98bf-2d6273230ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:12.350143 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e04328-6403-410d-98bf-2d6273230ba9 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:12.356324 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b19e84-6ecb-43b9-a0f0-dbd186898a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:12.359275 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b19e84-6ecb-43b9-a0f0-dbd186898a67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:12.359275 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b19e84-6ecb-43b9-a0f0-dbd186898a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:12.359275 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b19e84-6ecb-43b9-a0f0-dbd186898a67 admin admin] PATH_INFO: `/v3/projects/11127196ca9a48a9be26c4fea86e6623` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:12.359275 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b19e84-6ecb-43b9-a0f0-dbd186898a67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11127196ca9a48a9be26c4fea86e6623)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:12.362530 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b19e84-6ecb-43b9-a0f0-dbd186898a67 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:12.488030 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-03b19e84-6ecb-43b9-a0f0-dbd186898a67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11127196ca9a48a9be26c4fea86e6623', 'request_id': 'req-03b19e84-6ecb-43b9-a0f0-dbd186898a67'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:12.495095 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-03b19e84-6ecb-43b9-a0f0-dbd186898a67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11127196ca9a48a9be26c4fea86e6623', 'request_id': 'req-03b19e84-6ecb-43b9-a0f0-dbd186898a67'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:12.501850 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-03b19e84-6ecb-43b9-a0f0-dbd186898a67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11127196ca9a48a9be26c4fea86e6623', 'request_id': 'req-03b19e84-6ecb-43b9-a0f0-dbd186898a67'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:12.588211 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-03b19e84-6ecb-43b9-a0f0-dbd186898a67 admin admin] The token cache is being invalidate because project 11127196ca9a48a9be26c4fea86e6623 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:23:12.588535 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-03b19e84-6ecb-43b9-a0f0-dbd186898a67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:12.589179 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-03b19e84-6ecb-43b9-a0f0-dbd186898a67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:12.590705 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 977/1957] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:23:12 2022] DELETE /identity/v3/projects/11127196ca9a48a9be26c4fea86e6623 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:23:12.595091 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1167af3-94ca-4dda-b77e-dd74d9a12c22 service neutron] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:12.604824 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1167af3-94ca-4dda-b77e-dd74d9a12c22 service neutron] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:12.647761 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:12.663493 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ecd398-8b8e-4e9a-8e8e-6aa70ba41555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:12.664480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ecd398-8b8e-4e9a-8e8e-6aa70ba41555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:12.664758 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ecd398-8b8e-4e9a-8e8e-6aa70ba41555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:12.669917 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ecd398-8b8e-4e9a-8e8e-6aa70ba41555 admin admin] PATH_INFO: `/v3/users/08aec94b4baf496c92f90c9fed5c0e32` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:12.669917 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ecd398-8b8e-4e9a-8e8e-6aa70ba41555 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08aec94b4baf496c92f90c9fed5c0e32)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:12.669917 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ecd398-8b8e-4e9a-8e8e-6aa70ba41555 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:12.887028 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-90ecd398-8b8e-4e9a-8e8e-6aa70ba41555 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08aec94b4baf496c92f90c9fed5c0e32'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:12.899708 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-90ecd398-8b8e-4e9a-8e8e-6aa70ba41555 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08aec94b4baf496c92f90c9fed5c0e32'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:12.900477 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-90ecd398-8b8e-4e9a-8e8e-6aa70ba41555 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08aec94b4baf496c92f90c9fed5c0e32'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:12.908099 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-90ecd398-8b8e-4e9a-8e8e-6aa70ba41555 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08aec94b4baf496c92f90c9fed5c0e32'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:12.908887 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-90ecd398-8b8e-4e9a-8e8e-6aa70ba41555 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08aec94b4baf496c92f90c9fed5c0e32'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:12.985659 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 981/1958] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:23:12 2022] DELETE /identity/v3/users/08aec94b4baf496c92f90c9fed5c0e32 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:23:13.409210 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b19e84-6ecb-43b9-a0f0-dbd186898a67 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:13.410477 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-03b19e84-6ecb-43b9-a0f0-dbd186898a67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:13.418533 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:13.425657 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b19e84-6ecb-43b9-a0f0-dbd186898a67 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:13.483320 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e295e-abad-427d-95e6-b8bc1a3682c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:13.484955 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e295e-abad-427d-95e6-b8bc1a3682c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:13.485487 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e295e-abad-427d-95e6-b8bc1a3682c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:13.486122 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e295e-abad-427d-95e6-b8bc1a3682c6 admin admin] PATH_INFO: `/v3/projects/17283ff8969946c0a97908c13d7d3afb` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:13.487728 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e295e-abad-427d-95e6-b8bc1a3682c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17283ff8969946c0a97908c13d7d3afb)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:13.489668 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e295e-abad-427d-95e6-b8bc1a3682c6 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:13.587130 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-5c7e295e-abad-427d-95e6-b8bc1a3682c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17283ff8969946c0a97908c13d7d3afb', 'request_id': 'req-5c7e295e-abad-427d-95e6-b8bc1a3682c6'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:13.593279 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-5c7e295e-abad-427d-95e6-b8bc1a3682c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17283ff8969946c0a97908c13d7d3afb', 'request_id': 'req-5c7e295e-abad-427d-95e6-b8bc1a3682c6'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:13.599330 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-5c7e295e-abad-427d-95e6-b8bc1a3682c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17283ff8969946c0a97908c13d7d3afb', 'request_id': 'req-5c7e295e-abad-427d-95e6-b8bc1a3682c6'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:13.675725 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-5c7e295e-abad-427d-95e6-b8bc1a3682c6 admin admin] The token cache is being invalidate because project 17283ff8969946c0a97908c13d7d3afb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:23:13.676069 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-5c7e295e-abad-427d-95e6-b8bc1a3682c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:13.676719 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-5c7e295e-abad-427d-95e6-b8bc1a3682c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:13.678257 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 978/1959] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:23:13 2022] DELETE /identity/v3/projects/17283ff8969946c0a97908c13d7d3afb => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:23:13.683291 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0951b7-34b7-4725-95e5-2ccb3156d3b5 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:13.683781 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0951b7-34b7-4725-95e5-2ccb3156d3b5 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:13.683876 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0951b7-34b7-4725-95e5-2ccb3156d3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:13.702210 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-7c0951b7-34b7-4725-95e5-2ccb3156d3b5 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:23:13.703593 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-7c0951b7-34b7-4725-95e5-2ccb3156d3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:13.762052 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 982/1960] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:23:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:23:13.770121 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e575dfe-5cdb-43a7-99c6-8c9c4ad78d32 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:13.770413 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e575dfe-5cdb-43a7-99c6-8c9c4ad78d32 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:13.770688 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e575dfe-5cdb-43a7-99c6-8c9c4ad78d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:13.789541 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-2e575dfe-5cdb-43a7-99c6-8c9c4ad78d32 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:23:13.790775 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-2e575dfe-5cdb-43a7-99c6-8c9c4ad78d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:13.799150 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 979/1961] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:23:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:23:13.803256 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0951b7-34b7-4725-95e5-2ccb3156d3b5 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:13.813606 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0951b7-34b7-4725-95e5-2ccb3156d3b5 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:13.818404 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb23ec-76ca-4e94-a8b6-b8b93f28031f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:13.819051 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb23ec-76ca-4e94-a8b6-b8b93f28031f admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:13.819330 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb23ec-76ca-4e94-a8b6-b8b93f28031f admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:13.819600 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb23ec-76ca-4e94-a8b6-b8b93f28031f admin admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:13.820344 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb23ec-76ca-4e94-a8b6-b8b93f28031f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:23:13.820648 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb23ec-76ca-4e94-a8b6-b8b93f28031f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:13.822215 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb23ec-76ca-4e94-a8b6-b8b93f28031f admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:13.837305 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 983/1962] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:23:13.838501 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e575dfe-5cdb-43a7-99c6-8c9c4ad78d32 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:13.848668 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e575dfe-5cdb-43a7-99c6-8c9c4ad78d32 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:13.853269 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e265b0dd-6353-467e-90cd-8504a9ec7d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:13.853957 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265b0dd-6353-467e-90cd-8504a9ec7d03 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:13.854240 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265b0dd-6353-467e-90cd-8504a9ec7d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:13.854512 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265b0dd-6353-467e-90cd-8504a9ec7d03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:13.855190 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e265b0dd-6353-467e-90cd-8504a9ec7d03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:13.857120 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e265b0dd-6353-467e-90cd-8504a9ec7d03 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:13.958241 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 980/1963] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:23:13 2022] POST /identity/v3/projects => generated 371 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:23:13.962049 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb23ec-76ca-4e94-a8b6-b8b93f28031f admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:13.972837 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb23ec-76ca-4e94-a8b6-b8b93f28031f admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:14.019799 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:14.029329 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bbc20b-c503-4ab3-b574-e4691673c34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:14.029999 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbc20b-c503-4ab3-b574-e4691673c34e admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:14.030283 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbc20b-c503-4ab3-b574-e4691673c34e admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:14.030559 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbc20b-c503-4ab3-b574-e4691673c34e admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:14.031894 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bbc20b-c503-4ab3-b574-e4691673c34e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:14.033823 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bbc20b-c503-4ab3-b574-e4691673c34e admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:14.132050 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 984/1964] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:23:13 2022] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:23:14.139224 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e265b0dd-6353-467e-90cd-8504a9ec7d03 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:14.149723 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e265b0dd-6353-467e-90cd-8504a9ec7d03 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:14.154388 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98f0ee-13e2-4dc7-a2b4-c6661bf45a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:14.155040 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98f0ee-13e2-4dc7-a2b4-c6661bf45a7a admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:14.155323 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98f0ee-13e2-4dc7-a2b4-c6661bf45a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:14.155596 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98f0ee-13e2-4dc7-a2b4-c6661bf45a7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:14.157117 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e98f0ee-13e2-4dc7-a2b4-c6661bf45a7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:14.158869 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e98f0ee-13e2-4dc7-a2b4-c6661bf45a7a admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:14.169185 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 981/1965] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:23:14.173719 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bbc20b-c503-4ab3-b574-e4691673c34e admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:14.183842 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bbc20b-c503-4ab3-b574-e4691673c34e admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:14.188399 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6957bbf3-003f-47f3-8e4f-b58ed0e4227e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:14.189051 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957bbf3-003f-47f3-8e4f-b58ed0e4227e admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:14.189333 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957bbf3-003f-47f3-8e4f-b58ed0e4227e admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:14.189608 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957bbf3-003f-47f3-8e4f-b58ed0e4227e admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:14.190339 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6957bbf3-003f-47f3-8e4f-b58ed0e4227e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:14.191911 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6957bbf3-003f-47f3-8e4f-b58ed0e4227e admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:14.201691 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 985/1966] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:23:14.205834 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98f0ee-13e2-4dc7-a2b4-c6661bf45a7a admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:14.215483 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98f0ee-13e2-4dc7-a2b4-c6661bf45a7a admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:14.220554 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c3ff8-bee3-4c1c-8dec-a08e2777f230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:14.221422 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c3ff8-bee3-4c1c-8dec-a08e2777f230 admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:14.221702 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c3ff8-bee3-4c1c-8dec-a08e2777f230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:14.221973 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c3ff8-bee3-4c1c-8dec-a08e2777f230 admin admin] PATH_INFO: `/v3/projects/b14c46915c924d81ae33a8208181405a/users/1a7074fa31fd41719fd2059e9b0697d0/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:14.236624 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385c3ff8-bee3-4c1c-8dec-a08e2777f230 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b14c46915c924d81ae33a8208181405a, user_id=1a7074fa31fd41719fd2059e9b0697d0, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:14.239254 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385c3ff8-bee3-4c1c-8dec-a08e2777f230 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:14.316044 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 982/1967] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:23:14 2022] PUT /identity/v3/projects/b14c46915c924d81ae33a8208181405a/users/1a7074fa31fd41719fd2059e9b0697d0/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:23:14.320984 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2518432-e1ac-4fb4-bd40-642aa93ff5b5 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:14.321332 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2518432-e1ac-4fb4-bd40-642aa93ff5b5 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:14.321611 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2518432-e1ac-4fb4-bd40-642aa93ff5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:14.339628 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-a2518432-e1ac-4fb4-bd40-642aa93ff5b5 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:23:14.340789 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-a2518432-e1ac-4fb4-bd40-642aa93ff5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:14.398959 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 986/1968] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:23:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:23:14.409202 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c3ff8-bee3-4c1c-8dec-a08e2777f230 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:14.410878 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-385c3ff8-bee3-4c1c-8dec-a08e2777f230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:14.441674 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:14.465979 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c3ff8-bee3-4c1c-8dec-a08e2777f230 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:14.470439 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71493b9-0a93-4d47-971c-6fc0cfa4861a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:14.471357 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71493b9-0a93-4d47-971c-6fc0cfa4861a service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:14.472021 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71493b9-0a93-4d47-971c-6fc0cfa4861a service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:14.472347 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71493b9-0a93-4d47-971c-6fc0cfa4861a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:14.481481 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71493b9-0a93-4d47-971c-6fc0cfa4861a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:14.482936 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71493b9-0a93-4d47-971c-6fc0cfa4861a service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:14.492929 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 983/1969] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:23:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:23:16.454558 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb0b28-6616-4ff6-8784-f38a18cd771e None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:16.454558 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb0b28-6616-4ff6-8784-f38a18cd771e None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:16.454558 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb0b28-6616-4ff6-8784-f38a18cd771e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:16.482915 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-5efb0b28-6616-4ff6-8784-f38a18cd771e None None] MFA Rules not processed for user `1a7074fa31fd41719fd2059e9b0697d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:23:16.484256 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-5efb0b28-6616-4ff6-8784-f38a18cd771e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:16.563714 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 987/1970] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:23:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:23:16.574253 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71493b9-0a93-4d47-971c-6fc0cfa4861a service neutron] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:16.587455 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71493b9-0a93-4d47-971c-6fc0cfa4861a service neutron] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:16.592775 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd7ca3-0f5d-4221-8961-51a4eeafaf49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:16.593431 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd7ca3-0f5d-4221-8961-51a4eeafaf49 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:16.594315 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd7ca3-0f5d-4221-8961-51a4eeafaf49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:16.594997 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd7ca3-0f5d-4221-8961-51a4eeafaf49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:16.595620 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd7ca3-0f5d-4221-8961-51a4eeafaf49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:16.597560 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd7ca3-0f5d-4221-8961-51a4eeafaf49 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:16.686946 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 984/1971] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:23:16 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:23:16.690833 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb0b28-6616-4ff6-8784-f38a18cd771e None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:16.702014 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb0b28-6616-4ff6-8784-f38a18cd771e None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:16.765934 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12325977-689e-48c7-ac20-2fd38e94d627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:16.767836 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12325977-689e-48c7-ac20-2fd38e94d627 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:16.768123 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12325977-689e-48c7-ac20-2fd38e94d627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:16.768430 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12325977-689e-48c7-ac20-2fd38e94d627 admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:16.769297 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12325977-689e-48c7-ac20-2fd38e94d627 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:16.771220 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12325977-689e-48c7-ac20-2fd38e94d627 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:16.778297 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:16.891500 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 988/1972] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:23:16 2022] POST /identity/v3/users => generated 293 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:23:16.892882 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd7ca3-0f5d-4221-8961-51a4eeafaf49 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:16.902928 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd7ca3-0f5d-4221-8961-51a4eeafaf49 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:16.908458 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2bafa1-83e1-46ec-a287-bf665c4a5b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:16.909155 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2bafa1-83e1-46ec-a287-bf665c4a5b05 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:16.909436 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2bafa1-83e1-46ec-a287-bf665c4a5b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:16.909706 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2bafa1-83e1-46ec-a287-bf665c4a5b05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:16.910417 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2bafa1-83e1-46ec-a287-bf665c4a5b05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:16.912017 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2bafa1-83e1-46ec-a287-bf665c4a5b05 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:16.925963 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 985/1973] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:23:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:23:16.931603 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12325977-689e-48c7-ac20-2fd38e94d627 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:16.942315 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12325977-689e-48c7-ac20-2fd38e94d627 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:16.947026 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8db9a9-91c5-4c03-b530-99dcf43aed22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:16.947910 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8db9a9-91c5-4c03-b530-99dcf43aed22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:16.948221 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8db9a9-91c5-4c03-b530-99dcf43aed22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:16.948496 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8db9a9-91c5-4c03-b530-99dcf43aed22 admin admin] PATH_INFO: `/v3/projects/7ed29067963c4f19b6c340fd18688f1f/users/896ae1bf255e4814a39798d595e43ff2/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:16.963534 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8db9a9-91c5-4c03-b530-99dcf43aed22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ed29067963c4f19b6c340fd18688f1f, user_id=896ae1bf255e4814a39798d595e43ff2, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:16.966295 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8db9a9-91c5-4c03-b530-99dcf43aed22 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:17.057782 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 989/1974] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:23:16 2022] PUT /identity/v3/projects/7ed29067963c4f19b6c340fd18688f1f/users/896ae1bf255e4814a39798d595e43ff2/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:23:17.061958 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2bafa1-83e1-46ec-a287-bf665c4a5b05 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:17.072251 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2bafa1-83e1-46ec-a287-bf665c4a5b05 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:17.128524 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863a23b-867c-4adb-a821-ea0f15a6dabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:17.129196 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863a23b-867c-4adb-a821-ea0f15a6dabc admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:17.129482 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863a23b-867c-4adb-a821-ea0f15a6dabc admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:17.129759 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863a23b-867c-4adb-a821-ea0f15a6dabc admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:17.130599 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f863a23b-867c-4adb-a821-ea0f15a6dabc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:17.132443 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f863a23b-867c-4adb-a821-ea0f15a6dabc admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:17.144203 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 986/1975] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:23:17.148323 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8db9a9-91c5-4c03-b530-99dcf43aed22 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:17.159320 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8db9a9-91c5-4c03-b530-99dcf43aed22 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:17.164237 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02879feb-2201-469a-80a9-aaae8c6439de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:17.165120 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02879feb-2201-469a-80a9-aaae8c6439de admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:17.165401 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02879feb-2201-469a-80a9-aaae8c6439de admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:17.165928 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02879feb-2201-469a-80a9-aaae8c6439de admin admin] PATH_INFO: `/v3/projects/7ed29067963c4f19b6c340fd18688f1f/users/896ae1bf255e4814a39798d595e43ff2/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:17.167914 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02879feb-2201-469a-80a9-aaae8c6439de admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ed29067963c4f19b6c340fd18688f1f, user_id=896ae1bf255e4814a39798d595e43ff2, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:17.170560 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02879feb-2201-469a-80a9-aaae8c6439de admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:17.183296 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 990/1976] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:23:17 2022] PUT /identity/v3/projects/7ed29067963c4f19b6c340fd18688f1f/users/896ae1bf255e4814a39798d595e43ff2/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:23:17.293730 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863a23b-867c-4adb-a821-ea0f15a6dabc admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:17.295647 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-f863a23b-867c-4adb-a821-ea0f15a6dabc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:17.309012 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863a23b-867c-4adb-a821-ea0f15a6dabc admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:17.371730 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4fbcb-8ee2-40b6-9f08-0e990cee3533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:17.372657 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4fbcb-8ee2-40b6-9f08-0e990cee3533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:17.372938 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4fbcb-8ee2-40b6-9f08-0e990cee3533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:17.373210 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4fbcb-8ee2-40b6-9f08-0e990cee3533 admin admin] PATH_INFO: `/v3/users/8f78e744932c4241b3a346254ee3ee7c` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:17.374457 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e4fbcb-8ee2-40b6-9f08-0e990cee3533 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f78e744932c4241b3a346254ee3ee7c)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:17.377102 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e4fbcb-8ee2-40b6-9f08-0e990cee3533 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:17.557486 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:17.567845 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-55e4fbcb-8ee2-40b6-9f08-0e990cee3533 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f78e744932c4241b3a346254ee3ee7c'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:17.581367 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-55e4fbcb-8ee2-40b6-9f08-0e990cee3533 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f78e744932c4241b3a346254ee3ee7c'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:17.582250 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-55e4fbcb-8ee2-40b6-9f08-0e990cee3533 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f78e744932c4241b3a346254ee3ee7c'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:17.589654 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-55e4fbcb-8ee2-40b6-9f08-0e990cee3533 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f78e744932c4241b3a346254ee3ee7c'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:17.590654 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-55e4fbcb-8ee2-40b6-9f08-0e990cee3533 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f78e744932c4241b3a346254ee3ee7c'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:17.671299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 987/1977] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:23:17 2022] DELETE /identity/v3/users/8f78e744932c4241b3a346254ee3ee7c => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:23:17.676573 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a766f3-0c72-4ba3-86c5-9cae1d2aa33b None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:17.677092 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a766f3-0c72-4ba3-86c5-9cae1d2aa33b None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:17.677092 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a766f3-0c72-4ba3-86c5-9cae1d2aa33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:17.697000 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-60a766f3-0c72-4ba3-86c5-9cae1d2aa33b None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:23:17.698207 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-60a766f3-0c72-4ba3-86c5-9cae1d2aa33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:17.764671 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 991/1978] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:23:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:23:17.775062 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4fbcb-8ee2-40b6-9f08-0e990cee3533 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:17.777698 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-55e4fbcb-8ee2-40b6-9f08-0e990cee3533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:17.841797 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4fbcb-8ee2-40b6-9f08-0e990cee3533 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:17.846781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b590d-1146-480e-b67b-06c6d4e503a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:17.847441 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b590d-1146-480e-b67b-06c6d4e503a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:17.847729 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b590d-1146-480e-b67b-06c6d4e503a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:17.848021 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b590d-1146-480e-b67b-06c6d4e503a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:17.857363 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b590d-1146-480e-b67b-06c6d4e503a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:17.858807 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b590d-1146-480e-b67b-06c6d4e503a6 service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:17.869641 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 988/1979] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:23:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:23:18.306376 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a766f3-0c72-4ba3-86c5-9cae1d2aa33b None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:18.307954 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-60a766f3-0c72-4ba3-86c5-9cae1d2aa33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:18.329121 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a766f3-0c72-4ba3-86c5-9cae1d2aa33b None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:18.340944 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0682d-24fa-4f5d-8faa-22c85f3325bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:18.341962 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0682d-24fa-4f5d-8faa-22c85f3325bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:18.342254 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0682d-24fa-4f5d-8faa-22c85f3325bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:18.342608 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0682d-24fa-4f5d-8faa-22c85f3325bb admin admin] PATH_INFO: `/v3/projects/9bf911953602479c963a9e15fd205415` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:18.344492 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d0682d-24fa-4f5d-8faa-22c85f3325bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bf911953602479c963a9e15fd205415)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:18.346457 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d0682d-24fa-4f5d-8faa-22c85f3325bb admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:18.456474 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-e9d0682d-24fa-4f5d-8faa-22c85f3325bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bf911953602479c963a9e15fd205415', 'request_id': 'req-e9d0682d-24fa-4f5d-8faa-22c85f3325bb'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:18.559610 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-e9d0682d-24fa-4f5d-8faa-22c85f3325bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bf911953602479c963a9e15fd205415', 'request_id': 'req-e9d0682d-24fa-4f5d-8faa-22c85f3325bb'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:18.571239 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-e9d0682d-24fa-4f5d-8faa-22c85f3325bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bf911953602479c963a9e15fd205415', 'request_id': 'req-e9d0682d-24fa-4f5d-8faa-22c85f3325bb'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:18.593411 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-e9d0682d-24fa-4f5d-8faa-22c85f3325bb admin admin] The token cache is being invalidate because project 9bf911953602479c963a9e15fd205415 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:23:18.594969 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-e9d0682d-24fa-4f5d-8faa-22c85f3325bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:18.595425 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-e9d0682d-24fa-4f5d-8faa-22c85f3325bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:18.602705 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 992/1980] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:23:18 2022] DELETE /identity/v3/projects/9bf911953602479c963a9e15fd205415 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:23:18.604480 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6073c5-fe26-4a85-aede-8be758f18047 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:18.614911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6073c5-fe26-4a85-aede-8be758f18047 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:18.614911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6073c5-fe26-4a85-aede-8be758f18047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:18.635339 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-7e6073c5-fe26-4a85-aede-8be758f18047 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:23:18.637356 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-7e6073c5-fe26-4a85-aede-8be758f18047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:18.684022 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b2883-cfa7-4675-b564-94b4b3aef062 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:18.686739 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b2883-cfa7-4675-b564-94b4b3aef062 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:18.686739 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b2883-cfa7-4675-b564-94b4b3aef062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:18.716322 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-b18b2883-cfa7-4675-b564-94b4b3aef062 None None] MFA Rules not processed for user `896ae1bf255e4814a39798d595e43ff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:23:18.717992 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-b18b2883-cfa7-4675-b564-94b4b3aef062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:18.723561 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 989/1981] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:23:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:23:18.732440 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679a9f4-e020-4a1e-acc4-783a44719629 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:18.732830 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679a9f4-e020-4a1e-acc4-783a44719629 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:18.733492 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679a9f4-e020-4a1e-acc4-783a44719629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:18.746770 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:INSERT=6,keystone:SELECT=87,keystone:DELETE=7 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:18.765325 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-7679a9f4-e020-4a1e-acc4-783a44719629 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:23:18.767885 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-7679a9f4-e020-4a1e-acc4-783a44719629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:18.791884 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 990/1982] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:23:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:23:18.791884 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679a9f4-e020-4a1e-acc4-783a44719629 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:18.800306 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679a9f4-e020-4a1e-acc4-783a44719629 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:18.804894 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a006b75-6121-421a-af78-2ba03ac1a705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:18.805811 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a006b75-6121-421a-af78-2ba03ac1a705 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:18.805907 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a006b75-6121-421a-af78-2ba03ac1a705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:18.806142 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a006b75-6121-421a-af78-2ba03ac1a705 admin admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:18.806868 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a006b75-6121-421a-af78-2ba03ac1a705 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:23:18.807273 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a006b75-6121-421a-af78-2ba03ac1a705 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:18.808934 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a006b75-6121-421a-af78-2ba03ac1a705 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:18.822674 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 993/1983] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:23:18 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:23:18.838494 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 991/1984] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:23:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:23:18.838645 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b2883-cfa7-4675-b564-94b4b3aef062 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:18.838645 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-b18b2883-cfa7-4675-b564-94b4b3aef062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:18.839599 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a006b75-6121-421a-af78-2ba03ac1a705 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:18.854236 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a006b75-6121-421a-af78-2ba03ac1a705 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:18.863658 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c6164-f4aa-487b-9791-5aade78e0aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:18.865067 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c6164-f4aa-487b-9791-5aade78e0aaf admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:18.865750 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c6164-f4aa-487b-9791-5aade78e0aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:18.866037 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c6164-f4aa-487b-9791-5aade78e0aaf admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:18.866730 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532c6164-f4aa-487b-9791-5aade78e0aaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:18.869719 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532c6164-f4aa-487b-9791-5aade78e0aaf admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:18.912317 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b2883-cfa7-4675-b564-94b4b3aef062 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:18.916702 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ce036-d500-42e2-bb61-a688929333a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:18.917567 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ce036-d500-42e2-bb61-a688929333a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:18.917898 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ce036-d500-42e2-bb61-a688929333a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:18.918192 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ce036-d500-42e2-bb61-a688929333a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:18.920179 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-918ce036-d500-42e2-bb61-a688929333a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:18.969883 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 992/1985] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:23:18 2022] POST /identity/v3/projects => generated 391 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:23:18.973773 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c6164-f4aa-487b-9791-5aade78e0aaf admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:19.001591 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:19.005943 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918ce036-d500-42e2-bb61-a688929333a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:19.007395 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918ce036-d500-42e2-bb61-a688929333a0 service cinder] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:19.017262 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 994/1986] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:23:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:23:19.048154 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c6164-f4aa-487b-9791-5aade78e0aaf admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:19.052983 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af27f820-a496-431a-b58e-131472cbbe6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:19.053657 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27f820-a496-431a-b58e-131472cbbe6a admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:19.053941 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27f820-a496-431a-b58e-131472cbbe6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:19.054252 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27f820-a496-431a-b58e-131472cbbe6a admin admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:19.055156 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af27f820-a496-431a-b58e-131472cbbe6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:19.057448 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af27f820-a496-431a-b58e-131472cbbe6a admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:19.177260 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 993/1987] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:23:18 2022] POST /identity/v3/users => generated 296 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:23:19.181315 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ce036-d500-42e2-bb61-a688929333a0 service cinder] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:19.192369 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ce036-d500-42e2-bb61-a688929333a0 service cinder] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:19.196868 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573b0fd-bb0b-47c2-9cb7-734dcdd9bf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:19.197588 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573b0fd-bb0b-47c2-9cb7-734dcdd9bf3b admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:19.197868 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573b0fd-bb0b-47c2-9cb7-734dcdd9bf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:19.198148 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573b0fd-bb0b-47c2-9cb7-734dcdd9bf3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:19.198866 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5573b0fd-bb0b-47c2-9cb7-734dcdd9bf3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:19.200619 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5573b0fd-bb0b-47c2-9cb7-734dcdd9bf3b admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:19.211397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 995/1988] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:23:19.215801 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af27f820-a496-431a-b58e-131472cbbe6a admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:19.226515 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af27f820-a496-431a-b58e-131472cbbe6a admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:19.231288 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf07e61-970f-4013-8e94-baca13edb81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:19.231990 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf07e61-970f-4013-8e94-baca13edb81a admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:19.232314 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf07e61-970f-4013-8e94-baca13edb81a admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:19.232591 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf07e61-970f-4013-8e94-baca13edb81a admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:19.235508 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf07e61-970f-4013-8e94-baca13edb81a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:19.236028 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf07e61-970f-4013-8e94-baca13edb81a admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:19.246602 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 994/1989] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:23:19.250931 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573b0fd-bb0b-47c2-9cb7-734dcdd9bf3b admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:19.261048 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573b0fd-bb0b-47c2-9cb7-734dcdd9bf3b admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:19.266213 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254e1fe-b53f-429b-987c-7ff1692faab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:19.267243 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254e1fe-b53f-429b-987c-7ff1692faab7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:19.267531 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254e1fe-b53f-429b-987c-7ff1692faab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:19.267812 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254e1fe-b53f-429b-987c-7ff1692faab7 admin admin] PATH_INFO: `/v3/projects/8a810ee8ee644ed6872c80f68e4655e2/users/533ee62a85ea49e18b6984fb028ed12b/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:19.283693 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254e1fe-b53f-429b-987c-7ff1692faab7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a810ee8ee644ed6872c80f68e4655e2, user_id=533ee62a85ea49e18b6984fb028ed12b, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:19.286533 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254e1fe-b53f-429b-987c-7ff1692faab7 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:19.373764 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 996/1990] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:23:19 2022] PUT /identity/v3/projects/8a810ee8ee644ed6872c80f68e4655e2/users/533ee62a85ea49e18b6984fb028ed12b/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:23:19.385204 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d937d-b8c5-4098-ade9-663b6a07493d None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:19.385492 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d937d-b8c5-4098-ade9-663b6a07493d None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:19.385764 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d937d-b8c5-4098-ade9-663b6a07493d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:19.412378 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-b44d937d-b8c5-4098-ade9-663b6a07493d None None] MFA Rules not processed for user `533ee62a85ea49e18b6984fb028ed12b`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:23:19.413473 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-b44d937d-b8c5-4098-ade9-663b6a07493d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:19.477399 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 995/1991] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:23:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:23:19.488885 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254e1fe-b53f-429b-987c-7ff1692faab7 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:19.490652 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-9254e1fe-b53f-429b-987c-7ff1692faab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:19.535290 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:19.548990 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254e1fe-b53f-429b-987c-7ff1692faab7 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:19.552838 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e88edd-1d8a-4622-b537-4831b623ddf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:19.554599 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e88edd-1d8a-4622-b537-4831b623ddf4 service cinder] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:19.554886 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e88edd-1d8a-4622-b537-4831b623ddf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:19.555162 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e88edd-1d8a-4622-b537-4831b623ddf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:19.564431 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e88edd-1d8a-4622-b537-4831b623ddf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:19.565867 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e88edd-1d8a-4622-b537-4831b623ddf4 service cinder] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:19.575066 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 997/1992] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:23:19 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:23:21.900766 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d937d-b8c5-4098-ade9-663b6a07493d None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:21.910923 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d937d-b8c5-4098-ade9-663b6a07493d None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:21.914480 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f3a63d-1ef3-48c5-bbda-1fba08c7fff5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:21.915120 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3a63d-1ef3-48c5-bbda-1fba08c7fff5 service cinder] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:21.915399 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3a63d-1ef3-48c5-bbda-1fba08c7fff5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:21.915671 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3a63d-1ef3-48c5-bbda-1fba08c7fff5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:21.978896 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f3a63d-1ef3-48c5-bbda-1fba08c7fff5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:21.980407 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f3a63d-1ef3-48c5-bbda-1fba08c7fff5 service cinder] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:21.992019 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 996/1993] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:23:21 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:23:29.650794 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=8 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:31.987216 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:40.134527 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e88edd-1d8a-4622-b537-4831b623ddf4 service cinder] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:40.136009 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-b0e88edd-1d8a-4622-b537-4831b623ddf4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:40.202389 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e88edd-1d8a-4622-b537-4831b623ddf4 service cinder] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:40.207930 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eef99a-1c7b-4737-a6f8-979b9ec5d37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:40.208823 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eef99a-1c7b-4737-a6f8-979b9ec5d37b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:40.209107 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eef99a-1c7b-4737-a6f8-979b9ec5d37b admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:40.209379 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eef99a-1c7b-4737-a6f8-979b9ec5d37b admin admin] PATH_INFO: `/v3/users/144789e582de45c280d03b92dee5692a` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:40.210539 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eef99a-1c7b-4737-a6f8-979b9ec5d37b admin admin] RBAC: Authorizing `identity:delete_user(user_id=144789e582de45c280d03b92dee5692a)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:40.212473 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eef99a-1c7b-4737-a6f8-979b9ec5d37b admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:40.384900 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-b5eef99a-1c7b-4737-a6f8-979b9ec5d37b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '144789e582de45c280d03b92dee5692a'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:40.397694 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-b5eef99a-1c7b-4737-a6f8-979b9ec5d37b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '144789e582de45c280d03b92dee5692a'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:40.398394 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-b5eef99a-1c7b-4737-a6f8-979b9ec5d37b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '144789e582de45c280d03b92dee5692a'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:40.405176 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-b5eef99a-1c7b-4737-a6f8-979b9ec5d37b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '144789e582de45c280d03b92dee5692a'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:40.405874 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-b5eef99a-1c7b-4737-a6f8-979b9ec5d37b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '144789e582de45c280d03b92dee5692a'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:40.473193 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 998/1994] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:23:40 2022] DELETE /identity/v3/users/144789e582de45c280d03b92dee5692a => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:23:40.698151 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f3a63d-1ef3-48c5-bbda-1fba08c7fff5 service cinder] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:40.708847 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f3a63d-1ef3-48c5-bbda-1fba08c7fff5 service cinder] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:40.775067 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d4e3c4-3b22-48b8-8a3d-2cb892bf1dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:40.775931 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4e3c4-3b22-48b8-8a3d-2cb892bf1dac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:40.776248 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4e3c4-3b22-48b8-8a3d-2cb892bf1dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:40.776521 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4e3c4-3b22-48b8-8a3d-2cb892bf1dac admin admin] PATH_INFO: `/v3/projects/f6909571f8274f4ebf822ce71cd43c2b` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:40.777762 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d4e3c4-3b22-48b8-8a3d-2cb892bf1dac admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6909571f8274f4ebf822ce71cd43c2b)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:40.779978 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d4e3c4-3b22-48b8-8a3d-2cb892bf1dac admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:40.915999 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-30d4e3c4-3b22-48b8-8a3d-2cb892bf1dac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6909571f8274f4ebf822ce71cd43c2b', 'request_id': 'req-30d4e3c4-3b22-48b8-8a3d-2cb892bf1dac'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:40.922269 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-30d4e3c4-3b22-48b8-8a3d-2cb892bf1dac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6909571f8274f4ebf822ce71cd43c2b', 'request_id': 'req-30d4e3c4-3b22-48b8-8a3d-2cb892bf1dac'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:40.928460 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-30d4e3c4-3b22-48b8-8a3d-2cb892bf1dac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6909571f8274f4ebf822ce71cd43c2b', 'request_id': 'req-30d4e3c4-3b22-48b8-8a3d-2cb892bf1dac'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:41.007291 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-30d4e3c4-3b22-48b8-8a3d-2cb892bf1dac admin admin] The token cache is being invalidate because project f6909571f8274f4ebf822ce71cd43c2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:23:41.007581 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-30d4e3c4-3b22-48b8-8a3d-2cb892bf1dac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:41.008229 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-30d4e3c4-3b22-48b8-8a3d-2cb892bf1dac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:41.009783 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 997/1995] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:23:40 2022] DELETE /identity/v3/projects/f6909571f8274f4ebf822ce71cd43c2b => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:23:41.015325 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b2bce-70c8-4b80-8cf6-7039780d8d9d None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:41.015614 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b2bce-70c8-4b80-8cf6-7039780d8d9d None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:41.015890 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b2bce-70c8-4b80-8cf6-7039780d8d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:41.033368 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-3b6b2bce-70c8-4b80-8cf6-7039780d8d9d None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:23:41.035107 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-3b6b2bce-70c8-4b80-8cf6-7039780d8d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:41.092382 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 999/1996] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:23:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:23:41.100685 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087a332-8889-4be5-8c48-4652f9ed2134 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:41.100996 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087a332-8889-4be5-8c48-4652f9ed2134 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:41.101276 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087a332-8889-4be5-8c48-4652f9ed2134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:41.120092 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-6087a332-8889-4be5-8c48-4652f9ed2134 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:23:41.121277 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-6087a332-8889-4be5-8c48-4652f9ed2134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:41.129410 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 998/1997] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:23:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:23:41.133611 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b2bce-70c8-4b80-8cf6-7039780d8d9d None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:41.143492 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b2bce-70c8-4b80-8cf6-7039780d8d9d None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:41.148081 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0450075-1b87-4881-b82e-e60e922b7084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:41.148766 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0450075-1b87-4881-b82e-e60e922b7084 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:41.149083 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0450075-1b87-4881-b82e-e60e922b7084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:41.149361 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0450075-1b87-4881-b82e-e60e922b7084 admin admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:41.150028 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0450075-1b87-4881-b82e-e60e922b7084 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:23:41.150493 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0450075-1b87-4881-b82e-e60e922b7084 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:41.152106 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0450075-1b87-4881-b82e-e60e922b7084 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:41.168947 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1000/1998] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:23:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:23:41.170538 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087a332-8889-4be5-8c48-4652f9ed2134 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:41.180316 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087a332-8889-4be5-8c48-4652f9ed2134 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:41.184982 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c35e4-3d23-42be-bbce-ad8e832eb21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:41.185715 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c35e4-3d23-42be-bbce-ad8e832eb21d admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:41.186063 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c35e4-3d23-42be-bbce-ad8e832eb21d admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:41.186403 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c35e4-3d23-42be-bbce-ad8e832eb21d admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:41.187149 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c35e4-3d23-42be-bbce-ad8e832eb21d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:41.189174 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c35e4-3d23-42be-bbce-ad8e832eb21d admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:41.305185 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 999/1999] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:23:41 2022] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:23:41.311940 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0450075-1b87-4881-b82e-e60e922b7084 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:41.328696 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0450075-1b87-4881-b82e-e60e922b7084 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:41.332951 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:41.385407 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78010a35-b7c0-4eb8-afd9-0fa7a7a07835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:41.386074 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78010a35-b7c0-4eb8-afd9-0fa7a7a07835 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:41.386359 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78010a35-b7c0-4eb8-afd9-0fa7a7a07835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:41.386637 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78010a35-b7c0-4eb8-afd9-0fa7a7a07835 admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:41.387325 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78010a35-b7c0-4eb8-afd9-0fa7a7a07835 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:41.389407 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78010a35-b7c0-4eb8-afd9-0fa7a7a07835 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:41.482276 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1001/2000] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:23:41 2022] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:23:41.486270 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c35e4-3d23-42be-bbce-ad8e832eb21d admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:41.496960 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c35e4-3d23-42be-bbce-ad8e832eb21d admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:41.501563 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b08893-bcc8-4a00-b931-967d60da7bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:41.502220 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b08893-bcc8-4a00-b931-967d60da7bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:41.502553 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b08893-bcc8-4a00-b931-967d60da7bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:41.503039 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b08893-bcc8-4a00-b931-967d60da7bc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:41.503761 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b08893-bcc8-4a00-b931-967d60da7bc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:41.505400 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b08893-bcc8-4a00-b931-967d60da7bc8 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:41.517098 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1000/2001] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:23:41.521410 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78010a35-b7c0-4eb8-afd9-0fa7a7a07835 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:41.531314 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78010a35-b7c0-4eb8-afd9-0fa7a7a07835 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:41.536580 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc8388a-d4e5-4db7-bfa2-2597d25f6e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:41.537230 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8388a-d4e5-4db7-bfa2-2597d25f6e29 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:41.537513 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8388a-d4e5-4db7-bfa2-2597d25f6e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:41.537791 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8388a-d4e5-4db7-bfa2-2597d25f6e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:41.538617 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc8388a-d4e5-4db7-bfa2-2597d25f6e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:41.540226 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc8388a-d4e5-4db7-bfa2-2597d25f6e29 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:41.550027 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1002/2002] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:23:41.554128 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b08893-bcc8-4a00-b931-967d60da7bc8 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:41.563996 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b08893-bcc8-4a00-b931-967d60da7bc8 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:41.569332 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f21327-f77d-4025-b7ae-783da3192d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:41.570205 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f21327-f77d-4025-b7ae-783da3192d9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:41.570488 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f21327-f77d-4025-b7ae-783da3192d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:41.570763 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f21327-f77d-4025-b7ae-783da3192d9b admin admin] PATH_INFO: `/v3/projects/cb5b48038fd3479aa381909449bf52eb/users/245121e1c7df42fba17d9025601233bd/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:41.585793 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f21327-f77d-4025-b7ae-783da3192d9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb5b48038fd3479aa381909449bf52eb, user_id=245121e1c7df42fba17d9025601233bd, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:41.588474 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f21327-f77d-4025-b7ae-783da3192d9b admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:41.679579 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1001/2003] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:23:41 2022] PUT /identity/v3/projects/cb5b48038fd3479aa381909449bf52eb/users/245121e1c7df42fba17d9025601233bd/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:23:41.689511 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b17a7-01c7-4466-9ade-cb67d3f2b412 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:41.689848 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b17a7-01c7-4466-9ade-cb67d3f2b412 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:41.690622 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b17a7-01c7-4466-9ade-cb67d3f2b412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:41.717192 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-f70b17a7-01c7-4466-9ade-cb67d3f2b412 None None] MFA Rules not processed for user `245121e1c7df42fba17d9025601233bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:23:41.718395 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-f70b17a7-01c7-4466-9ade-cb67d3f2b412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:41.785295 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1003/2004] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:23:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:23:41.796111 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f21327-f77d-4025-b7ae-783da3192d9b admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:41.797942 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-c5f21327-f77d-4025-b7ae-783da3192d9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:41.829641 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:41.871263 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f21327-f77d-4025-b7ae-783da3192d9b admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:41.876857 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ca697-8109-4397-b32c-2c62b16f6860 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066aaba3e9af4f85ab0cba89a3d32e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:41.878012 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ca697-8109-4397-b32c-2c62b16f6860 service nova] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:41.878293 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ca697-8109-4397-b32c-2c62b16f6860 service nova] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:41.878567 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ca697-8109-4397-b32c-2c62b16f6860 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:41.886202 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ca697-8109-4397-b32c-2c62b16f6860 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:41.887794 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ca697-8109-4397-b32c-2c62b16f6860 service nova] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:41.897360 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1002/2005] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:23:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:23:47.244342 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b17a7-01c7-4466-9ade-cb67d3f2b412 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:47.314491 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b17a7-01c7-4466-9ade-cb67d3f2b412 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:47.319858 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7591761-711e-450f-9391-0c02f637fe3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:47.321906 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7591761-711e-450f-9391-0c02f637fe3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:47.322199 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7591761-711e-450f-9391-0c02f637fe3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:47.322477 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7591761-711e-450f-9391-0c02f637fe3d admin admin] PATH_INFO: `/v3/users/245121e1c7df42fba17d9025601233bd` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:47.323680 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7591761-711e-450f-9391-0c02f637fe3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=245121e1c7df42fba17d9025601233bd)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:47.325667 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7591761-711e-450f-9391-0c02f637fe3d admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:47.347857 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:47.512105 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-c7591761-711e-450f-9391-0c02f637fe3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '245121e1c7df42fba17d9025601233bd'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:47.525138 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-c7591761-711e-450f-9391-0c02f637fe3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '245121e1c7df42fba17d9025601233bd'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:47.525847 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-c7591761-711e-450f-9391-0c02f637fe3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '245121e1c7df42fba17d9025601233bd'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:47.533777 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-c7591761-711e-450f-9391-0c02f637fe3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '245121e1c7df42fba17d9025601233bd'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:47.534964 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-c7591761-711e-450f-9391-0c02f637fe3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '245121e1c7df42fba17d9025601233bd'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:47.618301 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1004/2006] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:23:47 2022] DELETE /identity/v3/users/245121e1c7df42fba17d9025601233bd => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:23:47.623559 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b1768-3b93-4c2e-b6de-1f6c802305a9 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:47.624048 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b1768-3b93-4c2e-b6de-1f6c802305a9 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:47.624197 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b1768-3b93-4c2e-b6de-1f6c802305a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:47.642231 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-756b1768-3b93-4c2e-b6de-1f6c802305a9 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:23:47.649009 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-756b1768-3b93-4c2e-b6de-1f6c802305a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:47.709521 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1003/2007] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:23:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:23:47.716238 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7591761-711e-450f-9391-0c02f637fe3d admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:47.717700 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-c7591761-711e-450f-9391-0c02f637fe3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:47.776177 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7591761-711e-450f-9391-0c02f637fe3d admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:47.779613 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c82f366-1981-4593-92f2-81bf89ebf8c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:47.780320 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82f366-1981-4593-92f2-81bf89ebf8c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:47.780607 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82f366-1981-4593-92f2-81bf89ebf8c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:47.780906 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82f366-1981-4593-92f2-81bf89ebf8c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:47.790223 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c82f366-1981-4593-92f2-81bf89ebf8c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:47.791662 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c82f366-1981-4593-92f2-81bf89ebf8c2 service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:47.801808 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1005/2008] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:23:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:23:48.247158 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b1768-3b93-4c2e-b6de-1f6c802305a9 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:48.248972 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-756b1768-3b93-4c2e-b6de-1f6c802305a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:48.262036 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b1768-3b93-4c2e-b6de-1f6c802305a9 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:48.267984 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4eff9-9e45-4456-875b-5a8d72f892c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:48.269523 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4eff9-9e45-4456-875b-5a8d72f892c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:48.269994 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4eff9-9e45-4456-875b-5a8d72f892c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:48.270550 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4eff9-9e45-4456-875b-5a8d72f892c1 admin admin] PATH_INFO: `/v3/projects/cb5b48038fd3479aa381909449bf52eb` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:48.271952 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4eff9-9e45-4456-875b-5a8d72f892c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb5b48038fd3479aa381909449bf52eb)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:48.278740 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4eff9-9e45-4456-875b-5a8d72f892c1 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:48.489457 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-bff4eff9-9e45-4456-875b-5a8d72f892c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb5b48038fd3479aa381909449bf52eb', 'request_id': 'req-bff4eff9-9e45-4456-875b-5a8d72f892c1'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:48.497699 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-bff4eff9-9e45-4456-875b-5a8d72f892c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb5b48038fd3479aa381909449bf52eb', 'request_id': 'req-bff4eff9-9e45-4456-875b-5a8d72f892c1'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:48.504002 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-bff4eff9-9e45-4456-875b-5a8d72f892c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb5b48038fd3479aa381909449bf52eb', 'request_id': 'req-bff4eff9-9e45-4456-875b-5a8d72f892c1'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:48.601876 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-bff4eff9-9e45-4456-875b-5a8d72f892c1 admin admin] The token cache is being invalidate because project cb5b48038fd3479aa381909449bf52eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:23:48.602255 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-bff4eff9-9e45-4456-875b-5a8d72f892c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:48.603184 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-bff4eff9-9e45-4456-875b-5a8d72f892c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:48.604963 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1004/2009] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:23:48 2022] DELETE /identity/v3/projects/cb5b48038fd3479aa381909449bf52eb => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:23:48.609837 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45432b-5805-4854-8585-06c5ef66ea01 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:48.610337 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45432b-5805-4854-8585-06c5ef66ea01 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:48.610444 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45432b-5805-4854-8585-06c5ef66ea01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:48.639929 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-de45432b-5805-4854-8585-06c5ef66ea01 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:23:48.641155 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-de45432b-5805-4854-8585-06c5ef66ea01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:48.721046 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1006/2010] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:23:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:23:48.729426 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e476b2-89a2-45c2-8d71-6b9e8c735c8d None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:48.729952 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e476b2-89a2-45c2-8d71-6b9e8c735c8d None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:48.730145 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e476b2-89a2-45c2-8d71-6b9e8c735c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:48.751929 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-47e476b2-89a2-45c2-8d71-6b9e8c735c8d None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:23:48.751929 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-47e476b2-89a2-45c2-8d71-6b9e8c735c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:48.760571 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1005/2011] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:23:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:23:48.764791 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45432b-5805-4854-8585-06c5ef66ea01 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:48.772178 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:48.776175 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45432b-5805-4854-8585-06c5ef66ea01 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:48.780900 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664566b-7100-42d6-9884-914da14b964c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:48.781568 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664566b-7100-42d6-9884-914da14b964c admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:48.781849 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664566b-7100-42d6-9884-914da14b964c admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:48.782121 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664566b-7100-42d6-9884-914da14b964c admin admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:48.783009 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2664566b-7100-42d6-9884-914da14b964c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:23:48.783321 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2664566b-7100-42d6-9884-914da14b964c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:48.786409 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2664566b-7100-42d6-9884-914da14b964c admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:48.799543 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1007/2012] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:23:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:23:48.804122 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e476b2-89a2-45c2-8d71-6b9e8c735c8d None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:48.827982 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e476b2-89a2-45c2-8d71-6b9e8c735c8d None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:48.835618 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b7f74-8e61-4ccd-9bc2-88b7ef106445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:48.836329 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b7f74-8e61-4ccd-9bc2-88b7ef106445 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:48.836624 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b7f74-8e61-4ccd-9bc2-88b7ef106445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:48.836886 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b7f74-8e61-4ccd-9bc2-88b7ef106445 admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:48.837742 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135b7f74-8e61-4ccd-9bc2-88b7ef106445 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:48.839725 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135b7f74-8e61-4ccd-9bc2-88b7ef106445 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:48.962164 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1006/2013] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:23:48 2022] POST /identity/v3/projects => generated 403 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:23:48.966021 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664566b-7100-42d6-9884-914da14b964c admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:48.978520 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664566b-7100-42d6-9884-914da14b964c admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:49.035210 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2fe7d2-dd75-41e4-8a6d-8a241595f865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:49.035880 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fe7d2-dd75-41e4-8a6d-8a241595f865 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:49.036184 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fe7d2-dd75-41e4-8a6d-8a241595f865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:49.036464 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fe7d2-dd75-41e4-8a6d-8a241595f865 admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:49.037146 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2fe7d2-dd75-41e4-8a6d-8a241595f865 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:49.039042 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2fe7d2-dd75-41e4-8a6d-8a241595f865 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:49.142136 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1008/2014] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:23:48 2022] POST /identity/v3/users => generated 302 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:23:49.143360 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b7f74-8e61-4ccd-9bc2-88b7ef106445 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:49.154958 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b7f74-8e61-4ccd-9bc2-88b7ef106445 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:49.161877 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff31e8c-92d7-47df-a6ae-f3f8b20b3789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:49.163458 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff31e8c-92d7-47df-a6ae-f3f8b20b3789 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:49.163775 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff31e8c-92d7-47df-a6ae-f3f8b20b3789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:49.164053 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff31e8c-92d7-47df-a6ae-f3f8b20b3789 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:49.164811 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff31e8c-92d7-47df-a6ae-f3f8b20b3789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:49.169032 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff31e8c-92d7-47df-a6ae-f3f8b20b3789 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:49.170587 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:49.183913 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1007/2015] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:23:49.188059 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2fe7d2-dd75-41e4-8a6d-8a241595f865 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:49.199005 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2fe7d2-dd75-41e4-8a6d-8a241595f865 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:49.203915 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac8172-fa82-4ddb-8729-11814f2c10fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:49.204616 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac8172-fa82-4ddb-8729-11814f2c10fb admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:49.207331 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac8172-fa82-4ddb-8729-11814f2c10fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:49.207331 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac8172-fa82-4ddb-8729-11814f2c10fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:49.207331 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ac8172-fa82-4ddb-8729-11814f2c10fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:49.208373 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ac8172-fa82-4ddb-8729-11814f2c10fb admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:49.224068 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1009/2016] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:23:49.235255 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff31e8c-92d7-47df-a6ae-f3f8b20b3789 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:49.242880 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff31e8c-92d7-47df-a6ae-f3f8b20b3789 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:49.250278 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e562c41-c7c9-411f-9ba8-8ce219eb18ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:49.251175 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e562c41-c7c9-411f-9ba8-8ce219eb18ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:49.251458 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e562c41-c7c9-411f-9ba8-8ce219eb18ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:49.251768 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e562c41-c7c9-411f-9ba8-8ce219eb18ed admin admin] PATH_INFO: `/v3/projects/1638a051e6894cf8bdb78ecbc9a19768/users/b2e0f96843cf417b8c409f8c5bf5b131/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:49.270496 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e562c41-c7c9-411f-9ba8-8ce219eb18ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=1638a051e6894cf8bdb78ecbc9a19768, user_id=b2e0f96843cf417b8c409f8c5bf5b131, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:49.272309 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac8172-fa82-4ddb-8729-11814f2c10fb admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:49.273302 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e562c41-c7c9-411f-9ba8-8ce219eb18ed admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:49.275558 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-c8ac8172-fa82-4ddb-8729-11814f2c10fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:49.292395 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac8172-fa82-4ddb-8729-11814f2c10fb admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:49.297133 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6698b73d-61df-425e-856d-a4f12315823b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:49.298054 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698b73d-61df-425e-856d-a4f12315823b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:49.298345 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698b73d-61df-425e-856d-a4f12315823b admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:49.298619 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698b73d-61df-425e-856d-a4f12315823b admin admin] PATH_INFO: `/v3/users/88526ddc350e4a90a4b131bb05eb96aa` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:49.299811 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6698b73d-61df-425e-856d-a4f12315823b admin admin] RBAC: Authorizing `identity:delete_user(user_id=88526ddc350e4a90a4b131bb05eb96aa)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:49.301983 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6698b73d-61df-425e-856d-a4f12315823b admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:49.343984 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1008/2017] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:23:49 2022] PUT /identity/v3/projects/1638a051e6894cf8bdb78ecbc9a19768/users/b2e0f96843cf417b8c409f8c5bf5b131/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:23:49.355628 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee0738-a7e6-4957-a88a-818eeb6c8068 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:49.355941 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee0738-a7e6-4957-a88a-818eeb6c8068 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:49.356250 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee0738-a7e6-4957-a88a-818eeb6c8068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:49.383955 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-a4ee0738-a7e6-4957-a88a-818eeb6c8068 None None] MFA Rules not processed for user `b2e0f96843cf417b8c409f8c5bf5b131`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:23:49.385267 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-a4ee0738-a7e6-4957-a88a-818eeb6c8068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:49.451490 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1009/2018] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:23:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:23:49.455985 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee0738-a7e6-4957-a88a-818eeb6c8068 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:49.491819 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-6698b73d-61df-425e-856d-a4f12315823b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88526ddc350e4a90a4b131bb05eb96aa'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:49.510060 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-6698b73d-61df-425e-856d-a4f12315823b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88526ddc350e4a90a4b131bb05eb96aa'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:49.510935 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-6698b73d-61df-425e-856d-a4f12315823b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88526ddc350e4a90a4b131bb05eb96aa'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:49.518690 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-6698b73d-61df-425e-856d-a4f12315823b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88526ddc350e4a90a4b131bb05eb96aa'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:49.520078 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-6698b73d-61df-425e-856d-a4f12315823b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88526ddc350e4a90a4b131bb05eb96aa'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:49.531787 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee0738-a7e6-4957-a88a-818eeb6c8068 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:49.537589 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335189b6-19ad-4119-becf-fd0ae947b1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:49.538252 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335189b6-19ad-4119-becf-fd0ae947b1f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:49.538538 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335189b6-19ad-4119-becf-fd0ae947b1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:49.538812 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335189b6-19ad-4119-becf-fd0ae947b1f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:49.539631 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335189b6-19ad-4119-becf-fd0ae947b1f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:49.542083 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335189b6-19ad-4119-becf-fd0ae947b1f8 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:49.590567 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1010/2019] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:23:49 2022] DELETE /identity/v3/users/88526ddc350e4a90a4b131bb05eb96aa => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:23:49.594899 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf2236-864f-496a-bb5f-251272f6aacb None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:49.595928 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf2236-864f-496a-bb5f-251272f6aacb None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:49.595928 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf2236-864f-496a-bb5f-251272f6aacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:49.619147 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-cdbf2236-864f-496a-bb5f-251272f6aacb None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:23:49.619147 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-cdbf2236-864f-496a-bb5f-251272f6aacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:49.643079 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1010/2020] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:23:49 2022] POST /identity/v3/projects => generated 405 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:23:49.646967 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335189b6-19ad-4119-becf-fd0ae947b1f8 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:49.648617 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-335189b6-19ad-4119-becf-fd0ae947b1f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:49.654767 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:49.677201 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1011/2021] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:23:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:23:49.687542 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf2236-864f-496a-bb5f-251272f6aacb None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:49.688913 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-cdbf2236-864f-496a-bb5f-251272f6aacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:49.700477 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:49.716015 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335189b6-19ad-4119-becf-fd0ae947b1f8 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:49.721127 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4869b0-a78b-440a-9ce9-281bd5cdc2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:49.721806 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4869b0-a78b-440a-9ce9-281bd5cdc2fb admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:49.722270 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4869b0-a78b-440a-9ce9-281bd5cdc2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:49.722385 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4869b0-a78b-440a-9ce9-281bd5cdc2fb admin admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:49.723059 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4869b0-a78b-440a-9ce9-281bd5cdc2fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:49.725051 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4869b0-a78b-440a-9ce9-281bd5cdc2fb admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:49.782625 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf2236-864f-496a-bb5f-251272f6aacb None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:49.834680 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0413468-03be-48a2-8473-0ac13ce6b32d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:49.835583 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0413468-03be-48a2-8473-0ac13ce6b32d service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:49.838954 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0413468-03be-48a2-8473-0ac13ce6b32d service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:49.839084 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1011/2022] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:23:49 2022] POST /identity/v3/users => generated 309 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:23:49.844918 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0413468-03be-48a2-8473-0ac13ce6b32d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:49.845221 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4869b0-a78b-440a-9ce9-281bd5cdc2fb admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:49.851383 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0413468-03be-48a2-8473-0ac13ce6b32d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:49.852049 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4869b0-a78b-440a-9ce9-281bd5cdc2fb admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:49.854450 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0413468-03be-48a2-8473-0ac13ce6b32d service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:49.857891 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf56856-dd0f-401b-b3f9-cb005b5bcbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:49.858573 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf56856-dd0f-401b-b3f9-cb005b5bcbfc admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:49.859097 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf56856-dd0f-401b-b3f9-cb005b5bcbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:49.859373 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf56856-dd0f-401b-b3f9-cb005b5bcbfc admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:49.860559 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf56856-dd0f-401b-b3f9-cb005b5bcbfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:49.863645 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf56856-dd0f-401b-b3f9-cb005b5bcbfc admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:49.869982 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1012/2023] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:23:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 13:23:49.875339 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1012/2024] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:23:49.885340 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0413468-03be-48a2-8473-0ac13ce6b32d service neutron] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:49.895802 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0413468-03be-48a2-8473-0ac13ce6b32d service neutron] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:49.905130 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718137e-fabe-4d41-add1-25b78c801834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:49.906035 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718137e-fabe-4d41-add1-25b78c801834 admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:49.906343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718137e-fabe-4d41-add1-25b78c801834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:49.906926 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718137e-fabe-4d41-add1-25b78c801834 admin admin] PATH_INFO: `/v3/projects/ae5070bd7fba4c93b839fd0209fa6c82/users/7ac2e3b7491d416c9e3a9c26d7e00f9d/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:49.930303 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718137e-fabe-4d41-add1-25b78c801834 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae5070bd7fba4c93b839fd0209fa6c82, user_id=7ac2e3b7491d416c9e3a9c26d7e00f9d, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:49.933046 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718137e-fabe-4d41-add1-25b78c801834 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:50.083747 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1013/2025] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:23:49 2022] PUT /identity/v3/projects/ae5070bd7fba4c93b839fd0209fa6c82/users/7ac2e3b7491d416c9e3a9c26d7e00f9d/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:23:50.087749 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf56856-dd0f-401b-b3f9-cb005b5bcbfc admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:50.099267 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf56856-dd0f-401b-b3f9-cb005b5bcbfc admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:50.163163 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541b8fa-dc13-482f-807c-bfd1c4d74cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:50.163847 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541b8fa-dc13-482f-807c-bfd1c4d74cca admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:50.164129 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541b8fa-dc13-482f-807c-bfd1c4d74cca admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:50.164554 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541b8fa-dc13-482f-807c-bfd1c4d74cca admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:50.165284 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541b8fa-dc13-482f-807c-bfd1c4d74cca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:50.167147 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541b8fa-dc13-482f-807c-bfd1c4d74cca admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:50.183038 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1013/2026] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:23:50.184734 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718137e-fabe-4d41-add1-25b78c801834 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:50.197407 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718137e-fabe-4d41-add1-25b78c801834 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:50.204416 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659014e1-7c42-4699-8a72-ea1a406f2b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:50.205416 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659014e1-7c42-4699-8a72-ea1a406f2b2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:50.205702 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659014e1-7c42-4699-8a72-ea1a406f2b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:50.205969 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659014e1-7c42-4699-8a72-ea1a406f2b2e admin admin] PATH_INFO: `/v3/projects/ae5070bd7fba4c93b839fd0209fa6c82/users/7ac2e3b7491d416c9e3a9c26d7e00f9d/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:50.207131 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541b8fa-dc13-482f-807c-bfd1c4d74cca admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:50.209210 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-d541b8fa-dc13-482f-807c-bfd1c4d74cca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:50.214369 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659014e1-7c42-4699-8a72-ea1a406f2b2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae5070bd7fba4c93b839fd0209fa6c82, user_id=7ac2e3b7491d416c9e3a9c26d7e00f9d, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:50.214369 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659014e1-7c42-4699-8a72-ea1a406f2b2e admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:50.224170 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541b8fa-dc13-482f-807c-bfd1c4d74cca admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:50.225521 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1014/2027] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:23:50 2022] PUT /identity/v3/projects/ae5070bd7fba4c93b839fd0209fa6c82/users/7ac2e3b7491d416c9e3a9c26d7e00f9d/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:23:50.235740 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8405f3-d8b5-4c11-88ae-d5a0d9fa32a8 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:50.236032 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8405f3-d8b5-4c11-88ae-d5a0d9fa32a8 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:50.237276 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8405f3-d8b5-4c11-88ae-d5a0d9fa32a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:50.269675 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-ac8405f3-d8b5-4c11-88ae-d5a0d9fa32a8 None None] MFA Rules not processed for user `7ac2e3b7491d416c9e3a9c26d7e00f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:23:50.271321 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-ac8405f3-d8b5-4c11-88ae-d5a0d9fa32a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:50.290109 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:50.295491 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c18372-ac32-4cef-b9c9-315737566cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:50.296138 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c18372-ac32-4cef-b9c9-315737566cc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:50.296457 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c18372-ac32-4cef-b9c9-315737566cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:50.296730 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c18372-ac32-4cef-b9c9-315737566cc7 admin admin] PATH_INFO: `/v3/users/533ee62a85ea49e18b6984fb028ed12b` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:50.297947 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c18372-ac32-4cef-b9c9-315737566cc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=533ee62a85ea49e18b6984fb028ed12b)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:50.300026 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c18372-ac32-4cef-b9c9-315737566cc7 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:50.349827 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1015/2028] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:23:50 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:23:50.350824 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8405f3-d8b5-4c11-88ae-d5a0d9fa32a8 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:50.352289 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-ac8405f3-d8b5-4c11-88ae-d5a0d9fa32a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:50.368557 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8405f3-d8b5-4c11-88ae-d5a0d9fa32a8 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:50.373571 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae4663-1a9e-431f-9bbf-4fa87da08981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:50.374431 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae4663-1a9e-431f-9bbf-4fa87da08981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:50.374785 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae4663-1a9e-431f-9bbf-4fa87da08981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:50.375071 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae4663-1a9e-431f-9bbf-4fa87da08981 admin admin] PATH_INFO: `/v3/projects/768f96630d764620a260d66c3b314263` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:50.376578 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae4663-1a9e-431f-9bbf-4fa87da08981 admin admin] RBAC: Authorizing `identity:delete_project(project_id=768f96630d764620a260d66c3b314263)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:50.380252 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae4663-1a9e-431f-9bbf-4fa87da08981 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:50.515652 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-e9c18372-ac32-4cef-b9c9-315737566cc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '533ee62a85ea49e18b6984fb028ed12b'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:50.516933 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-93ae4663-1a9e-431f-9bbf-4fa87da08981 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '768f96630d764620a260d66c3b314263', 'request_id': 'req-93ae4663-1a9e-431f-9bbf-4fa87da08981'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:50.528650 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:50.530044 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-e9c18372-ac32-4cef-b9c9-315737566cc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '533ee62a85ea49e18b6984fb028ed12b'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:50.530744 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-e9c18372-ac32-4cef-b9c9-315737566cc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '533ee62a85ea49e18b6984fb028ed12b'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:50.537790 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-e9c18372-ac32-4cef-b9c9-315737566cc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '533ee62a85ea49e18b6984fb028ed12b'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:50.538427 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-e9c18372-ac32-4cef-b9c9-315737566cc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '533ee62a85ea49e18b6984fb028ed12b'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:50.601721 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-93ae4663-1a9e-431f-9bbf-4fa87da08981 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '768f96630d764620a260d66c3b314263', 'request_id': 'req-93ae4663-1a9e-431f-9bbf-4fa87da08981'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:50.608132 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-93ae4663-1a9e-431f-9bbf-4fa87da08981 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '768f96630d764620a260d66c3b314263', 'request_id': 'req-93ae4663-1a9e-431f-9bbf-4fa87da08981'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:50.620455 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-93ae4663-1a9e-431f-9bbf-4fa87da08981 admin admin] The token cache is being invalidate because project 768f96630d764620a260d66c3b314263 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:23:50.621026 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-93ae4663-1a9e-431f-9bbf-4fa87da08981 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:50.621503 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-93ae4663-1a9e-431f-9bbf-4fa87da08981 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:50.623202 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1016/2029] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:23:50 2022] DELETE /identity/v3/projects/768f96630d764620a260d66c3b314263 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:23:50.624174 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae4663-1a9e-431f-9bbf-4fa87da08981 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:50.625530 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-93ae4663-1a9e-431f-9bbf-4fa87da08981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:50.682942 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae4663-1a9e-431f-9bbf-4fa87da08981 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:50.686656 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932c617-ea92-445e-970e-999387242600 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:50.687299 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932c617-ea92-445e-970e-999387242600 service cinder] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:50.687584 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932c617-ea92-445e-970e-999387242600 service cinder] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:50.687862 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932c617-ea92-445e-970e-999387242600 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:50.689686 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-9932c617-ea92-445e-970e-999387242600 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:50.696678 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1014/2030] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:23:50 2022] DELETE /identity/v3/users/533ee62a85ea49e18b6984fb028ed12b => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:23:50.697990 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf923fa-5763-4aee-92b8-65bcb5ac0537 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:50.698290 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf923fa-5763-4aee-92b8-65bcb5ac0537 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:50.698568 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf923fa-5763-4aee-92b8-65bcb5ac0537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:50.718042 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-caf923fa-5763-4aee-92b8-65bcb5ac0537 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:23:50.719380 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-caf923fa-5763-4aee-92b8-65bcb5ac0537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:50.740663 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:50.755577 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9932c617-ea92-445e-970e-999387242600 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:50.757062 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9932c617-ea92-445e-970e-999387242600 service cinder] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:50.766872 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1017/2031] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:23:50 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:23:50.768198 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456f6af-a5da-4884-a1e7-a0338ce44c59 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:50.768527 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456f6af-a5da-4884-a1e7-a0338ce44c59 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:50.772531 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456f6af-a5da-4884-a1e7-a0338ce44c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:50.782579 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1015/2032] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:23:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:23:50.788111 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-b456f6af-a5da-4884-a1e7-a0338ce44c59 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:23:50.790684 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97d126-a03d-48fa-b1d4-8b429e1e15d9 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:50.790980 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97d126-a03d-48fa-b1d4-8b429e1e15d9 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:50.791104 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-b456f6af-a5da-4884-a1e7-a0338ce44c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:50.791319 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97d126-a03d-48fa-b1d4-8b429e1e15d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:50.801384 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1018/2033] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:23:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:23:50.809606 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b456f6af-a5da-4884-a1e7-a0338ce44c59 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:50.811279 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-b456f6af-a5da-4884-a1e7-a0338ce44c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:50.819716 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-1d97d126-a03d-48fa-b1d4-8b429e1e15d9 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:23:50.820953 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-1d97d126-a03d-48fa-b1d4-8b429e1e15d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:50.829916 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1016/2034] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:23:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:23:50.836405 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97d126-a03d-48fa-b1d4-8b429e1e15d9 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:50.849485 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97d126-a03d-48fa-b1d4-8b429e1e15d9 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:50.856090 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0c4a2-c6b7-4cb8-a7c7-daab23fba9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:50.856090 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0c4a2-c6b7-4cb8-a7c7-daab23fba9c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:50.856090 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0c4a2-c6b7-4cb8-a7c7-daab23fba9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:50.856090 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0c4a2-c6b7-4cb8-a7c7-daab23fba9c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:50.856839 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf0c4a2-c6b7-4cb8-a7c7-daab23fba9c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:23:50.857148 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf0c4a2-c6b7-4cb8-a7c7-daab23fba9c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:50.858748 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf0c4a2-c6b7-4cb8-a7c7-daab23fba9c7 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:50.876935 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1017/2035] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:23:50.877845 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0c4a2-c6b7-4cb8-a7c7-daab23fba9c7 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:50.889010 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0c4a2-c6b7-4cb8-a7c7-daab23fba9c7 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:50.889303 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b456f6af-a5da-4884-a1e7-a0338ce44c59 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:50.893122 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953319ec-47ac-41a4-aa38-2fdc22bdb7c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:50.893727 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09c55a-0292-4d83-b748-a331735453ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:50.895162 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953319ec-47ac-41a4-aa38-2fdc22bdb7c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:50.895294 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09c55a-0292-4d83-b748-a331735453ea admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:50.895444 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953319ec-47ac-41a4-aa38-2fdc22bdb7c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:50.895636 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09c55a-0292-4d83-b748-a331735453ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:50.895744 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953319ec-47ac-41a4-aa38-2fdc22bdb7c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:50.895959 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09c55a-0292-4d83-b748-a331735453ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:50.896654 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a09c55a-0292-4d83-b748-a331735453ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:50.900534 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a09c55a-0292-4d83-b748-a331735453ea admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:50.908752 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953319ec-47ac-41a4-aa38-2fdc22bdb7c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:50.910338 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953319ec-47ac-41a4-aa38-2fdc22bdb7c6 service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:50.921545 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1019/2036] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:23:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 13:23:50.956275 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953319ec-47ac-41a4-aa38-2fdc22bdb7c6 service neutron] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:50.956275 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-953319ec-47ac-41a4-aa38-2fdc22bdb7c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:50.967834 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953319ec-47ac-41a4-aa38-2fdc22bdb7c6 service neutron] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:50.975330 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0288efb-d959-4b62-b953-4d831a56f478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:50.976240 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0288efb-d959-4b62-b953-4d831a56f478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:50.976650 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0288efb-d959-4b62-b953-4d831a56f478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:50.979288 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0288efb-d959-4b62-b953-4d831a56f478 admin admin] PATH_INFO: `/v3/users/b2e0f96843cf417b8c409f8c5bf5b131` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:50.979288 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0288efb-d959-4b62-b953-4d831a56f478 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2e0f96843cf417b8c409f8c5bf5b131)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:50.979891 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0288efb-d959-4b62-b953-4d831a56f478 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:50.991415 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1018/2037] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:23:50 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:23:50.991415 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09c55a-0292-4d83-b748-a331735453ea admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:51.058470 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09c55a-0292-4d83-b748-a331735453ea admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:51.063283 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57cc76-a767-46d8-a9b6-a5a282905da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:51.063949 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57cc76-a767-46d8-a9b6-a5a282905da2 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:51.064262 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57cc76-a767-46d8-a9b6-a5a282905da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:51.064537 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57cc76-a767-46d8-a9b6-a5a282905da2 admin admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:51.065216 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae57cc76-a767-46d8-a9b6-a5a282905da2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:51.067858 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae57cc76-a767-46d8-a9b6-a5a282905da2 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:51.184890 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1019/2038] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:23:50 2022] POST /identity/v3/users => generated 287 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:23:51.188818 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57cc76-a767-46d8-a9b6-a5a282905da2 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:51.199884 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57cc76-a767-46d8-a9b6-a5a282905da2 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:51.204709 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393451d1-b31c-4235-9d46-8f4d1042ed81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:51.205374 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393451d1-b31c-4235-9d46-8f4d1042ed81 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:51.205660 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393451d1-b31c-4235-9d46-8f4d1042ed81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:51.205938 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393451d1-b31c-4235-9d46-8f4d1042ed81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:51.206808 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393451d1-b31c-4235-9d46-8f4d1042ed81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:51.208451 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393451d1-b31c-4235-9d46-8f4d1042ed81 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:51.219631 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1020/2039] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:23:51.223683 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393451d1-b31c-4235-9d46-8f4d1042ed81 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:51.230837 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-c0288efb-d959-4b62-b953-4d831a56f478 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2e0f96843cf417b8c409f8c5bf5b131'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:51.233634 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393451d1-b31c-4235-9d46-8f4d1042ed81 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:51.239723 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44fd702-57e6-4bfd-9111-cb5010f0baca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:51.240472 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44fd702-57e6-4bfd-9111-cb5010f0baca admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:51.241310 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44fd702-57e6-4bfd-9111-cb5010f0baca admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:51.241449 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44fd702-57e6-4bfd-9111-cb5010f0baca admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:51.242234 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44fd702-57e6-4bfd-9111-cb5010f0baca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:51.243842 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44fd702-57e6-4bfd-9111-cb5010f0baca admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:51.246521 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-c0288efb-d959-4b62-b953-4d831a56f478 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2e0f96843cf417b8c409f8c5bf5b131'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:51.247362 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-c0288efb-d959-4b62-b953-4d831a56f478 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2e0f96843cf417b8c409f8c5bf5b131'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:51.256621 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1021/2040] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:23:51.261532 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44fd702-57e6-4bfd-9111-cb5010f0baca admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:51.263483 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-c0288efb-d959-4b62-b953-4d831a56f478 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2e0f96843cf417b8c409f8c5bf5b131'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:51.266267 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-c0288efb-d959-4b62-b953-4d831a56f478 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2e0f96843cf417b8c409f8c5bf5b131'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:51.273093 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44fd702-57e6-4bfd-9111-cb5010f0baca admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:51.277675 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2779f86f-47f7-4607-ab97-67641dcbe7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:51.278744 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779f86f-47f7-4607-ab97-67641dcbe7da admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:51.279026 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779f86f-47f7-4607-ab97-67641dcbe7da admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:51.279307 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779f86f-47f7-4607-ab97-67641dcbe7da admin admin] PATH_INFO: `/v3/projects/69f27f98dbbe45b0aa2becc3ec27a673/users/fda2a9830b5d4e8ea956026451d138b8/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:51.281555 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:51.294965 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2779f86f-47f7-4607-ab97-67641dcbe7da admin admin] RBAC: Authorizing `identity:create_grant(project_id=69f27f98dbbe45b0aa2becc3ec27a673, user_id=fda2a9830b5d4e8ea956026451d138b8, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:51.298107 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2779f86f-47f7-4607-ab97-67641dcbe7da admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:51.380025 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1020/2041] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:23:50 2022] DELETE /identity/v3/users/b2e0f96843cf417b8c409f8c5bf5b131 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:23:51.380248 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1022/2042] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:23:51 2022] PUT /identity/v3/projects/69f27f98dbbe45b0aa2becc3ec27a673/users/fda2a9830b5d4e8ea956026451d138b8/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:23:51.384436 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2779f86f-47f7-4607-ab97-67641dcbe7da admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:51.386301 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f77fa-bc51-4031-9429-e8dd2223bf9e None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:51.387070 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f77fa-bc51-4031-9429-e8dd2223bf9e None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:51.387613 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f77fa-bc51-4031-9429-e8dd2223bf9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:51.388555 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-2779f86f-47f7-4607-ab97-67641dcbe7da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:51.412681 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-ba2f77fa-bc51-4031-9429-e8dd2223bf9e None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:23:51.423673 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-ba2f77fa-bc51-4031-9429-e8dd2223bf9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:51.493782 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:51.500324 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2779f86f-47f7-4607-ab97-67641dcbe7da admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:51.505347 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dea018-27c2-48ce-bd55-12812579ba07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:51.506217 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dea018-27c2-48ce-bd55-12812579ba07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:51.506501 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dea018-27c2-48ce-bd55-12812579ba07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:51.506775 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dea018-27c2-48ce-bd55-12812579ba07 admin admin] PATH_INFO: `/v3/projects/8a810ee8ee644ed6872c80f68e4655e2` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:51.508211 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1021/2043] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:23:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:23:51.508688 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492fd8c-1caa-4701-9163-79c2f6e55508 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:51.509073 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492fd8c-1caa-4701-9163-79c2f6e55508 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:51.509435 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492fd8c-1caa-4701-9163-79c2f6e55508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:51.509827 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dea018-27c2-48ce-bd55-12812579ba07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a810ee8ee644ed6872c80f68e4655e2)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:51.512268 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dea018-27c2-48ce-bd55-12812579ba07 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:51.540874 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-0492fd8c-1caa-4701-9163-79c2f6e55508 None None] MFA Rules not processed for user `fda2a9830b5d4e8ea956026451d138b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:23:51.542244 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-0492fd8c-1caa-4701-9163-79c2f6e55508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:51.606457 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1022/2044] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:23:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:23:51.607444 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492fd8c-1caa-4701-9163-79c2f6e55508 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:51.608725 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-0492fd8c-1caa-4701-9163-79c2f6e55508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:51.643169 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-a6dea018-27c2-48ce-bd55-12812579ba07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a810ee8ee644ed6872c80f68e4655e2', 'request_id': 'req-a6dea018-27c2-48ce-bd55-12812579ba07'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:51.650199 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-a6dea018-27c2-48ce-bd55-12812579ba07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a810ee8ee644ed6872c80f68e4655e2', 'request_id': 'req-a6dea018-27c2-48ce-bd55-12812579ba07'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:51.656909 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-a6dea018-27c2-48ce-bd55-12812579ba07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a810ee8ee644ed6872c80f68e4655e2', 'request_id': 'req-a6dea018-27c2-48ce-bd55-12812579ba07'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:51.671924 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492fd8c-1caa-4701-9163-79c2f6e55508 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:51.719506 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c7371-2ff3-4599-8147-ce8a9abc676e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:51.720176 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c7371-2ff3-4599-8147-ce8a9abc676e service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:51.720757 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c7371-2ff3-4599-8147-ce8a9abc676e service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:51.721298 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c7371-2ff3-4599-8147-ce8a9abc676e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:51.727778 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-a6dea018-27c2-48ce-bd55-12812579ba07 admin admin] The token cache is being invalidate because project 8a810ee8ee644ed6872c80f68e4655e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:23:51.731435 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-a6dea018-27c2-48ce-bd55-12812579ba07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:51.731435 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-a6dea018-27c2-48ce-bd55-12812579ba07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:51.731435 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1023/2045] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:23:51 2022] DELETE /identity/v3/projects/8a810ee8ee644ed6872c80f68e4655e2 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:23:51.734274 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dea018-27c2-48ce-bd55-12812579ba07 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:51.735581 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-a6dea018-27c2-48ce-bd55-12812579ba07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:51.775013 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:51.785467 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c7371-2ff3-4599-8147-ce8a9abc676e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:51.786923 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c7371-2ff3-4599-8147-ce8a9abc676e service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:51.794416 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dea018-27c2-48ce-bd55-12812579ba07 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:51.797338 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1023/2046] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:23:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:23:51.798164 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc4a7d-42c0-44a1-bcfd-eedc96c986c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:51.798652 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e686dda-ad80-4a1b-9755-f90e0ac99970 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:51.798820 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc4a7d-42c0-44a1-bcfd-eedc96c986c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:51.799001 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e686dda-ad80-4a1b-9755-f90e0ac99970 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:51.799129 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc4a7d-42c0-44a1-bcfd-eedc96c986c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:51.799215 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e686dda-ad80-4a1b-9755-f90e0ac99970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:51.799350 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc4a7d-42c0-44a1-bcfd-eedc96c986c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:51.801375 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-52cc4a7d-42c0-44a1-bcfd-eedc96c986c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:51.820307 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-8e686dda-ad80-4a1b-9755-f90e0ac99970 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:23:51.821531 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-8e686dda-ad80-4a1b-9755-f90e0ac99970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:51.830679 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:51.832043 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1024/2047] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:23:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:23:51.840461 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb5487-d90a-4447-a780-5e3dc13f6a3a None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:51.840816 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb5487-d90a-4447-a780-5e3dc13f6a3a None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:51.841314 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb5487-d90a-4447-a780-5e3dc13f6a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:51.863776 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-fdcb5487-d90a-4447-a780-5e3dc13f6a3a None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:23:51.865571 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-fdcb5487-d90a-4447-a780-5e3dc13f6a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:51.867058 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc4a7d-42c0-44a1-bcfd-eedc96c986c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:51.868724 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc4a7d-42c0-44a1-bcfd-eedc96c986c0 service cinder] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:51.878873 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1025/2048] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:23:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:23:51.879053 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1024/2049] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:23:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:23:51.880550 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb5487-d90a-4447-a780-5e3dc13f6a3a None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:51.890255 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb5487-d90a-4447-a780-5e3dc13f6a3a None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:51.895836 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893854e7-8d10-4ae5-a00b-f1db04462b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:51.896463 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893854e7-8d10-4ae5-a00b-f1db04462b36 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:51.896742 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893854e7-8d10-4ae5-a00b-f1db04462b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:51.897016 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893854e7-8d10-4ae5-a00b-f1db04462b36 admin admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:51.897800 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893854e7-8d10-4ae5-a00b-f1db04462b36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:23:51.898103 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893854e7-8d10-4ae5-a00b-f1db04462b36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:51.899694 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893854e7-8d10-4ae5-a00b-f1db04462b36 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:51.907423 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc4a7d-42c0-44a1-bcfd-eedc96c986c0 service cinder] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:51.908969 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-52cc4a7d-42c0-44a1-bcfd-eedc96c986c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:51.916175 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1026/2050] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:23:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:23:51.923101 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc4a7d-42c0-44a1-bcfd-eedc96c986c0 service cinder] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:51.926709 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893854e7-8d10-4ae5-a00b-f1db04462b36 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:51.930045 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7638fb5-e7d0-407f-bf32-d150800de401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:51.930919 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7638fb5-e7d0-407f-bf32-d150800de401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:51.931199 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7638fb5-e7d0-407f-bf32-d150800de401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:51.931472 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7638fb5-e7d0-407f-bf32-d150800de401 admin admin] PATH_INFO: `/v3/users/fda2a9830b5d4e8ea956026451d138b8` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:51.932746 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7638fb5-e7d0-407f-bf32-d150800de401 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fda2a9830b5d4e8ea956026451d138b8)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:51.934901 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7638fb5-e7d0-407f-bf32-d150800de401 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:51.936783 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893854e7-8d10-4ae5-a00b-f1db04462b36 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:51.941564 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ca506-5ccb-483d-862f-d7b617accffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:51.942319 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ca506-5ccb-483d-862f-d7b617accffa admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:51.942604 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ca506-5ccb-483d-862f-d7b617accffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:51.942883 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ca506-5ccb-483d-862f-d7b617accffa admin admin] PATH_INFO: `/v3/projects` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:51.943564 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ca506-5ccb-483d-862f-d7b617accffa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:51.945489 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ca506-5ccb-483d-862f-d7b617accffa admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:52.049602 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1027/2051] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:23:51 2022] POST /identity/v3/projects => generated 395 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:23:52.050971 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ca506-5ccb-483d-862f-d7b617accffa admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:52.133644 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-f7638fb5-e7d0-407f-bf32-d150800de401 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fda2a9830b5d4e8ea956026451d138b8'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:52.133884 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ca506-5ccb-483d-862f-d7b617accffa admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:52.139720 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74106c6-2520-44b5-b38d-e0a3b779e420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:52.141130 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74106c6-2520-44b5-b38d-e0a3b779e420 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:52.141514 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74106c6-2520-44b5-b38d-e0a3b779e420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:52.141886 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74106c6-2520-44b5-b38d-e0a3b779e420 admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:52.142791 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74106c6-2520-44b5-b38d-e0a3b779e420 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:52.146444 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74106c6-2520-44b5-b38d-e0a3b779e420 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:52.154059 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-f7638fb5-e7d0-407f-bf32-d150800de401 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fda2a9830b5d4e8ea956026451d138b8'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:52.155792 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-f7638fb5-e7d0-407f-bf32-d150800de401 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fda2a9830b5d4e8ea956026451d138b8'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:52.164846 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-f7638fb5-e7d0-407f-bf32-d150800de401 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fda2a9830b5d4e8ea956026451d138b8'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:52.166145 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-f7638fb5-e7d0-407f-bf32-d150800de401 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fda2a9830b5d4e8ea956026451d138b8'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:52.245502 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1028/2052] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:23:52 2022] POST /identity/v3/users => generated 298 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:23:52.249360 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74106c6-2520-44b5-b38d-e0a3b779e420 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:52.251120 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-f74106c6-2520-44b5-b38d-e0a3b779e420 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:52.257819 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1025/2053] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:23:51 2022] DELETE /identity/v3/users/fda2a9830b5d4e8ea956026451d138b8 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:23:52.262133 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742bc480-87cc-4310-913c-de6a1df471f0 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:52.262411 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742bc480-87cc-4310-913c-de6a1df471f0 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:52.262688 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742bc480-87cc-4310-913c-de6a1df471f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:52.264413 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74106c6-2520-44b5-b38d-e0a3b779e420 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:52.282211 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-742bc480-87cc-4310-913c-de6a1df471f0 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:23:52.283466 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-742bc480-87cc-4310-913c-de6a1df471f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:52.330185 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7626caf-f5dd-4e54-8a26-b2cdb34481f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:52.330950 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7626caf-f5dd-4e54-8a26-b2cdb34481f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:52.331135 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7626caf-f5dd-4e54-8a26-b2cdb34481f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:52.332098 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7626caf-f5dd-4e54-8a26-b2cdb34481f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:52.332977 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7626caf-f5dd-4e54-8a26-b2cdb34481f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:52.334636 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7626caf-f5dd-4e54-8a26-b2cdb34481f5 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:52.347896 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1029/2054] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:23:52.349721 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7626caf-f5dd-4e54-8a26-b2cdb34481f5 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:52.351443 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-b7626caf-f5dd-4e54-8a26-b2cdb34481f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:52.354554 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1026/2055] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:23:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:23:52.356682 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742bc480-87cc-4310-913c-de6a1df471f0 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:52.368427 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7626caf-f5dd-4e54-8a26-b2cdb34481f5 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:52.375630 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742bc480-87cc-4310-913c-de6a1df471f0 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:52.377935 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9d99c-a007-4cc0-9e69-184e8b0d8881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:52.380362 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9d99c-a007-4cc0-9e69-184e8b0d8881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:52.380646 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9d99c-a007-4cc0-9e69-184e8b0d8881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:52.380919 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9d99c-a007-4cc0-9e69-184e8b0d8881 admin admin] PATH_INFO: `/v3/projects/1638a051e6894cf8bdb78ecbc9a19768` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:52.382102 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0a443-709c-41d1-a4c1-539887829f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:52.382431 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9d99c-a007-4cc0-9e69-184e8b0d8881 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1638a051e6894cf8bdb78ecbc9a19768)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:52.383130 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0a443-709c-41d1-a4c1-539887829f55 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:52.383373 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0a443-709c-41d1-a4c1-539887829f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:52.383753 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0a443-709c-41d1-a4c1-539887829f55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:52.384690 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9d99c-a007-4cc0-9e69-184e8b0d8881 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:52.384944 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b0a443-709c-41d1-a4c1-539887829f55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:52.386758 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b0a443-709c-41d1-a4c1-539887829f55 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:52.398908 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1027/2056] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:23:52.401152 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0a443-709c-41d1-a4c1-539887829f55 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:52.402918 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-88b0a443-709c-41d1-a4c1-539887829f55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:52.418152 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:52.436506 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:52.463030 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0a443-709c-41d1-a4c1-539887829f55 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:52.466741 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a0444-4363-4205-9c7d-f67f134e601e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:52.470983 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a0444-4363-4205-9c7d-f67f134e601e service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:52.470983 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a0444-4363-4205-9c7d-f67f134e601e service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:52.470983 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a0444-4363-4205-9c7d-f67f134e601e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:52.477648 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a0444-4363-4205-9c7d-f67f134e601e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:52.479091 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a0444-4363-4205-9c7d-f67f134e601e service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:52.489067 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1028/2057] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:23:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:23:52.489957 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a0444-4363-4205-9c7d-f67f134e601e service neutron] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:52.501706 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a0444-4363-4205-9c7d-f67f134e601e service neutron] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:52.509842 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276fb0cd-54cd-4148-b23a-69a4025e0e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:52.510809 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fb0cd-54cd-4148-b23a-69a4025e0e49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:52.511092 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fb0cd-54cd-4148-b23a-69a4025e0e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:52.511360 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fb0cd-54cd-4148-b23a-69a4025e0e49 admin admin] PATH_INFO: `/v3/projects/b46a3a5107454a07aafe1bf043efa5f0/users/e25d0027b3494815b01c60e4042cdb38/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:52.534221 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276fb0cd-54cd-4148-b23a-69a4025e0e49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b46a3a5107454a07aafe1bf043efa5f0, user_id=e25d0027b3494815b01c60e4042cdb38, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:52.539458 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276fb0cd-54cd-4148-b23a-69a4025e0e49 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:52.543096 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-31e9d99c-a007-4cc0-9e69-184e8b0d8881 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1638a051e6894cf8bdb78ecbc9a19768', 'request_id': 'req-31e9d99c-a007-4cc0-9e69-184e8b0d8881'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:52.631364 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1029/2058] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:23:52 2022] PUT /identity/v3/projects/b46a3a5107454a07aafe1bf043efa5f0/users/e25d0027b3494815b01c60e4042cdb38/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:23:52.642687 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f663d95-75ff-41d6-9920-11490eb81ac3 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:52.643005 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f663d95-75ff-41d6-9920-11490eb81ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:52.643280 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f663d95-75ff-41d6-9920-11490eb81ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:52.670716 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-3f663d95-75ff-41d6-9920-11490eb81ac3 None None] MFA Rules not processed for user `e25d0027b3494815b01c60e4042cdb38`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:23:52.671971 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-3f663d95-75ff-41d6-9920-11490eb81ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:52.681640 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-31e9d99c-a007-4cc0-9e69-184e8b0d8881 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1638a051e6894cf8bdb78ecbc9a19768', 'request_id': 'req-31e9d99c-a007-4cc0-9e69-184e8b0d8881'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:52.689770 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-31e9d99c-a007-4cc0-9e69-184e8b0d8881 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1638a051e6894cf8bdb78ecbc9a19768', 'request_id': 'req-31e9d99c-a007-4cc0-9e69-184e8b0d8881'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:52.707470 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-31e9d99c-a007-4cc0-9e69-184e8b0d8881 admin admin] The token cache is being invalidate because project 1638a051e6894cf8bdb78ecbc9a19768 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:23:52.707773 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-31e9d99c-a007-4cc0-9e69-184e8b0d8881 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:52.711336 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-31e9d99c-a007-4cc0-9e69-184e8b0d8881 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:52.718468 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1030/2059] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:23:52 2022] DELETE /identity/v3/projects/1638a051e6894cf8bdb78ecbc9a19768 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:23:52.722675 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9d99c-a007-4cc0-9e69-184e8b0d8881 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:52.724793 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-31e9d99c-a007-4cc0-9e69-184e8b0d8881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:52.797224 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1030/2060] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:23:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:23:52.813324 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f663d95-75ff-41d6-9920-11490eb81ac3 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:52.815200 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-3f663d95-75ff-41d6-9920-11490eb81ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:52.822072 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9d99c-a007-4cc0-9e69-184e8b0d8881 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:52.892573 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f663d95-75ff-41d6-9920-11490eb81ac3 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:52.897569 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d71a80-ba83-4337-8e5b-b82451226a29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:52.898322 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d71a80-ba83-4337-8e5b-b82451226a29 service cinder] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:52.898613 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d71a80-ba83-4337-8e5b-b82451226a29 service cinder] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:52.898956 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d71a80-ba83-4337-8e5b-b82451226a29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:52.902624 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd07dac-d569-4e3a-96e3-6723f81980e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:52.903570 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd07dac-d569-4e3a-96e3-6723f81980e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:52.903926 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd07dac-d569-4e3a-96e3-6723f81980e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:52.904302 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd07dac-d569-4e3a-96e3-6723f81980e9 admin admin] PATH_INFO: `/v3/users/7ac2e3b7491d416c9e3a9c26d7e00f9d` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:52.905604 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd07dac-d569-4e3a-96e3-6723f81980e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ac2e3b7491d416c9e3a9c26d7e00f9d)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:52.911038 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd07dac-d569-4e3a-96e3-6723f81980e9 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:52.911190 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d71a80-ba83-4337-8e5b-b82451226a29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:52.911190 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d71a80-ba83-4337-8e5b-b82451226a29 service cinder] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:52.919098 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1031/2061] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:23:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 13:23:52.987096 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d71a80-ba83-4337-8e5b-b82451226a29 service cinder] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:52.991347 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-03d71a80-ba83-4337-8e5b-b82451226a29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:53.015554 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d71a80-ba83-4337-8e5b-b82451226a29 service cinder] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:53.020769 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b1122-01b6-416e-9636-90120a0d4d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:53.021946 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b1122-01b6-416e-9636-90120a0d4d92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:53.022410 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b1122-01b6-416e-9636-90120a0d4d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:53.023034 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b1122-01b6-416e-9636-90120a0d4d92 admin admin] PATH_INFO: `/v3/projects/69f27f98dbbe45b0aa2becc3ec27a673` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:53.024620 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037b1122-01b6-416e-9636-90120a0d4d92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69f27f98dbbe45b0aa2becc3ec27a673)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:53.027116 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037b1122-01b6-416e-9636-90120a0d4d92 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:53.133036 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-0cd07dac-d569-4e3a-96e3-6723f81980e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ac2e3b7491d416c9e3a9c26d7e00f9d'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:53.144821 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:53.147845 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-0cd07dac-d569-4e3a-96e3-6723f81980e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ac2e3b7491d416c9e3a9c26d7e00f9d'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:53.148956 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-0cd07dac-d569-4e3a-96e3-6723f81980e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ac2e3b7491d416c9e3a9c26d7e00f9d'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:53.157112 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:53.157287 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-0cd07dac-d569-4e3a-96e3-6723f81980e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ac2e3b7491d416c9e3a9c26d7e00f9d'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:53.157728 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-0cd07dac-d569-4e3a-96e3-6723f81980e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ac2e3b7491d416c9e3a9c26d7e00f9d'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:53.170404 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-037b1122-01b6-416e-9636-90120a0d4d92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69f27f98dbbe45b0aa2becc3ec27a673', 'request_id': 'req-037b1122-01b6-416e-9636-90120a0d4d92'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:53.177070 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-037b1122-01b6-416e-9636-90120a0d4d92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69f27f98dbbe45b0aa2becc3ec27a673', 'request_id': 'req-037b1122-01b6-416e-9636-90120a0d4d92'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:53.182806 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-037b1122-01b6-416e-9636-90120a0d4d92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69f27f98dbbe45b0aa2becc3ec27a673', 'request_id': 'req-037b1122-01b6-416e-9636-90120a0d4d92'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:53.253282 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1031/2062] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:23:52 2022] DELETE /identity/v3/users/7ac2e3b7491d416c9e3a9c26d7e00f9d => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:23:53.335410 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-037b1122-01b6-416e-9636-90120a0d4d92 admin admin] The token cache is being invalidate because project 69f27f98dbbe45b0aa2becc3ec27a673 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:23:53.335683 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-037b1122-01b6-416e-9636-90120a0d4d92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:53.336403 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-037b1122-01b6-416e-9636-90120a0d4d92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:53.338271 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1032/2063] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:23:52 2022] DELETE /identity/v3/projects/69f27f98dbbe45b0aa2becc3ec27a673 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:23:53.761054 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd07dac-d569-4e3a-96e3-6723f81980e9 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:53.764715 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-0cd07dac-d569-4e3a-96e3-6723f81980e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:53.855646 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd07dac-d569-4e3a-96e3-6723f81980e9 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:53.860373 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8558c4-c721-485d-8f6b-8e6b504283a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:53.861230 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8558c4-c721-485d-8f6b-8e6b504283a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:53.861513 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8558c4-c721-485d-8f6b-8e6b504283a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:53.861787 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8558c4-c721-485d-8f6b-8e6b504283a0 admin admin] PATH_INFO: `/v3/projects/ae5070bd7fba4c93b839fd0209fa6c82` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:53.863090 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8558c4-c721-485d-8f6b-8e6b504283a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae5070bd7fba4c93b839fd0209fa6c82)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:53.865229 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8558c4-c721-485d-8f6b-8e6b504283a0 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:53.993149 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-fc8558c4-c721-485d-8f6b-8e6b504283a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae5070bd7fba4c93b839fd0209fa6c82', 'request_id': 'req-fc8558c4-c721-485d-8f6b-8e6b504283a0'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:54.116162 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-fc8558c4-c721-485d-8f6b-8e6b504283a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae5070bd7fba4c93b839fd0209fa6c82', 'request_id': 'req-fc8558c4-c721-485d-8f6b-8e6b504283a0'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:54.123742 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-fc8558c4-c721-485d-8f6b-8e6b504283a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae5070bd7fba4c93b839fd0209fa6c82', 'request_id': 'req-fc8558c4-c721-485d-8f6b-8e6b504283a0'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:54.141930 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-fc8558c4-c721-485d-8f6b-8e6b504283a0 admin admin] The token cache is being invalidate because project ae5070bd7fba4c93b839fd0209fa6c82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:23:54.142392 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-fc8558c4-c721-485d-8f6b-8e6b504283a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:54.143395 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-fc8558c4-c721-485d-8f6b-8e6b504283a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:54.145916 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1032/2064] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:23:53 2022] DELETE /identity/v3/projects/ae5070bd7fba4c93b839fd0209fa6c82 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:23:54.151548 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e12e7a-1528-445f-a7cb-89aaec50fe77 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:54.152011 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e12e7a-1528-445f-a7cb-89aaec50fe77 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:54.152358 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e12e7a-1528-445f-a7cb-89aaec50fe77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:54.204282 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-d1e12e7a-1528-445f-a7cb-89aaec50fe77 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:23:54.205510 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-d1e12e7a-1528-445f-a7cb-89aaec50fe77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:54.273138 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1033/2065] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:23:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:23:54.274764 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a680bc-ddbf-4e73-9e21-356b58c6f7c4 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:54.275080 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a680bc-ddbf-4e73-9e21-356b58c6f7c4 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:54.275361 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a680bc-ddbf-4e73-9e21-356b58c6f7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:54.294628 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-e0a680bc-ddbf-4e73-9e21-356b58c6f7c4 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:23:54.296194 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-e0a680bc-ddbf-4e73-9e21-356b58c6f7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:54.305091 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1033/2066] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:23:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:23:54.309400 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e12e7a-1528-445f-a7cb-89aaec50fe77 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:54.319442 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e12e7a-1528-445f-a7cb-89aaec50fe77 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:54.324066 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a77d76-3d4f-42a2-8ac8-6024dfc2c83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:54.324834 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a77d76-3d4f-42a2-8ac8-6024dfc2c83d admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:54.325018 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a77d76-3d4f-42a2-8ac8-6024dfc2c83d admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:54.325294 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a77d76-3d4f-42a2-8ac8-6024dfc2c83d admin admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:54.326019 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a77d76-3d4f-42a2-8ac8-6024dfc2c83d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:23:54.326332 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a77d76-3d4f-42a2-8ac8-6024dfc2c83d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:54.328009 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a77d76-3d4f-42a2-8ac8-6024dfc2c83d admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:54.340169 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1034/2067] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:23:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:23:54.344400 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a680bc-ddbf-4e73-9e21-356b58c6f7c4 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:54.354110 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a680bc-ddbf-4e73-9e21-356b58c6f7c4 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:54.358777 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926eca8-1ab6-41d5-be35-c7fd191441dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:54.359420 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926eca8-1ab6-41d5-be35-c7fd191441dc admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:54.359698 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926eca8-1ab6-41d5-be35-c7fd191441dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:54.359970 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926eca8-1ab6-41d5-be35-c7fd191441dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:54.360705 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5926eca8-1ab6-41d5-be35-c7fd191441dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:54.362577 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5926eca8-1ab6-41d5-be35-c7fd191441dc admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:54.460698 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1034/2068] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:23:54 2022] POST /identity/v3/projects => generated 365 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:23:54.464965 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a77d76-3d4f-42a2-8ac8-6024dfc2c83d admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:54.476331 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a77d76-3d4f-42a2-8ac8-6024dfc2c83d admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:54.550470 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa26f8-bf2c-4e0a-8b14-dba6916a8750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:54.551165 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa26f8-bf2c-4e0a-8b14-dba6916a8750 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:54.551449 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa26f8-bf2c-4e0a-8b14-dba6916a8750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:54.551726 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa26f8-bf2c-4e0a-8b14-dba6916a8750 admin admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:54.552463 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aa26f8-bf2c-4e0a-8b14-dba6916a8750 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:54.554384 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aa26f8-bf2c-4e0a-8b14-dba6916a8750 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:54.656341 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1035/2069] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:23:54 2022] POST /identity/v3/users => generated 283 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:23:54.660475 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926eca8-1ab6-41d5-be35-c7fd191441dc admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:54.670593 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926eca8-1ab6-41d5-be35-c7fd191441dc admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:54.675127 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec3047-73d1-4107-80b4-afbc35a84458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:54.676421 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec3047-73d1-4107-80b4-afbc35a84458 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:54.676706 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec3047-73d1-4107-80b4-afbc35a84458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:54.676977 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec3047-73d1-4107-80b4-afbc35a84458 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:54.677708 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aec3047-73d1-4107-80b4-afbc35a84458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:54.682278 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aec3047-73d1-4107-80b4-afbc35a84458 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:54.696307 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1035/2070] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:23:54.696411 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa26f8-bf2c-4e0a-8b14-dba6916a8750 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:54.708811 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa26f8-bf2c-4e0a-8b14-dba6916a8750 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:54.713653 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024168f-ff58-48b4-8d18-e84aa35c2329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:54.714324 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024168f-ff58-48b4-8d18-e84aa35c2329 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:54.714610 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024168f-ff58-48b4-8d18-e84aa35c2329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:54.714891 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024168f-ff58-48b4-8d18-e84aa35c2329 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:54.715625 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3024168f-ff58-48b4-8d18-e84aa35c2329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:54.717279 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3024168f-ff58-48b4-8d18-e84aa35c2329 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:54.718667 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:54.730613 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1036/2071] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:23:54.733209 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec3047-73d1-4107-80b4-afbc35a84458 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:54.744432 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec3047-73d1-4107-80b4-afbc35a84458 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:54.749393 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed14e85-d21f-47b4-84d7-c8871eecd3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:54.750367 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed14e85-d21f-47b4-84d7-c8871eecd3d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:54.750718 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed14e85-d21f-47b4-84d7-c8871eecd3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:54.751138 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed14e85-d21f-47b4-84d7-c8871eecd3d8 admin admin] PATH_INFO: `/v3/projects/6afff705a25b4439ac98a72dc8c7b946/users/878fbc956c7748a28e1ac041e24d2a13/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:54.760965 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:54.768548 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed14e85-d21f-47b4-84d7-c8871eecd3d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6afff705a25b4439ac98a72dc8c7b946, user_id=878fbc956c7748a28e1ac041e24d2a13, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:54.771492 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed14e85-d21f-47b4-84d7-c8871eecd3d8 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:54.850642 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1036/2072] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:23:54 2022] PUT /identity/v3/projects/6afff705a25b4439ac98a72dc8c7b946/users/878fbc956c7748a28e1ac041e24d2a13/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:23:54.861981 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5298903-f330-48ea-876c-f2144e424374 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:54.862303 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5298903-f330-48ea-876c-f2144e424374 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:54.862590 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5298903-f330-48ea-876c-f2144e424374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:54.889536 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-a5298903-f330-48ea-876c-f2144e424374 None None] MFA Rules not processed for user `878fbc956c7748a28e1ac041e24d2a13`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:23:54.890747 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-a5298903-f330-48ea-876c-f2144e424374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:54.956708 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1037/2073] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:23:54 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:23:54.961217 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed14e85-d21f-47b4-84d7-c8871eecd3d8 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:55.023706 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed14e85-d21f-47b4-84d7-c8871eecd3d8 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:55.029611 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e645280-76df-4c90-a3e8-0afee18da640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:55.030274 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e645280-76df-4c90-a3e8-0afee18da640 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:55.030557 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e645280-76df-4c90-a3e8-0afee18da640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:55.030833 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e645280-76df-4c90-a3e8-0afee18da640 admin admin] PATH_INFO: `/v3/projects` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:55.031530 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e645280-76df-4c90-a3e8-0afee18da640 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:55.033449 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e645280-76df-4c90-a3e8-0afee18da640 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:55.115081 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1037/2074] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:23:54 2022] POST /identity/v3/projects => generated 365 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:23:55.119370 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5298903-f330-48ea-876c-f2144e424374 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:55.130045 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5298903-f330-48ea-876c-f2144e424374 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:55.186311 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1e760-070b-4f6c-a45b-02c0c4c27924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:55.186976 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1e760-070b-4f6c-a45b-02c0c4c27924 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:55.187251 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1e760-070b-4f6c-a45b-02c0c4c27924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:55.187530 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1e760-070b-4f6c-a45b-02c0c4c27924 admin admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:55.188256 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf1e760-070b-4f6c-a45b-02c0c4c27924 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:55.190225 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf1e760-070b-4f6c-a45b-02c0c4c27924 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:55.288312 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1038/2075] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:23:55 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:23:55.292297 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e645280-76df-4c90-a3e8-0afee18da640 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:55.303312 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e645280-76df-4c90-a3e8-0afee18da640 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:55.307856 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11916360-4d9a-4313-bf63-007619663427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:55.308535 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11916360-4d9a-4313-bf63-007619663427 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:55.308853 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11916360-4d9a-4313-bf63-007619663427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:55.309139 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11916360-4d9a-4313-bf63-007619663427 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:55.309848 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11916360-4d9a-4313-bf63-007619663427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:55.311415 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11916360-4d9a-4313-bf63-007619663427 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:55.321954 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1038/2076] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:23:55.325947 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1e760-070b-4f6c-a45b-02c0c4c27924 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:55.336188 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1e760-070b-4f6c-a45b-02c0c4c27924 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:55.340941 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04492ba2-3b4b-4ecb-92ec-acf09c1a3e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:55.341816 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04492ba2-3b4b-4ecb-92ec-acf09c1a3e3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:55.342101 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04492ba2-3b4b-4ecb-92ec-acf09c1a3e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:55.342376 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04492ba2-3b4b-4ecb-92ec-acf09c1a3e3e admin admin] PATH_INFO: `/v3/projects/ffb437d31a574d1b9080130ed32209f3/users/c953c208e9b444949fa26c9961d10b5a/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:55.357418 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04492ba2-3b4b-4ecb-92ec-acf09c1a3e3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffb437d31a574d1b9080130ed32209f3, user_id=c953c208e9b444949fa26c9961d10b5a, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:55.360075 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04492ba2-3b4b-4ecb-92ec-acf09c1a3e3e admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:55.433172 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1039/2077] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:23:55 2022] PUT /identity/v3/projects/ffb437d31a574d1b9080130ed32209f3/users/c953c208e9b444949fa26c9961d10b5a/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:23:55.437015 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11916360-4d9a-4313-bf63-007619663427 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:55.447458 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11916360-4d9a-4313-bf63-007619663427 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:55.504625 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5193c2a-f801-43d9-9c79-a845fc63eb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:55.505340 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5193c2a-f801-43d9-9c79-a845fc63eb22 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:55.505626 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5193c2a-f801-43d9-9c79-a845fc63eb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:55.505900 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5193c2a-f801-43d9-9c79-a845fc63eb22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:55.506677 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5193c2a-f801-43d9-9c79-a845fc63eb22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:55.508309 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5193c2a-f801-43d9-9c79-a845fc63eb22 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:55.517992 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1039/2078] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:23:55.522834 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04492ba2-3b4b-4ecb-92ec-acf09c1a3e3e admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:55.533129 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04492ba2-3b4b-4ecb-92ec-acf09c1a3e3e admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:55.538582 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66652591-b002-4c78-8d77-7503f43a7484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:55.539465 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66652591-b002-4c78-8d77-7503f43a7484 admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:55.539750 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66652591-b002-4c78-8d77-7503f43a7484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:55.540027 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66652591-b002-4c78-8d77-7503f43a7484 admin admin] PATH_INFO: `/v3/projects/ffb437d31a574d1b9080130ed32209f3/users/c953c208e9b444949fa26c9961d10b5a/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:55.542041 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66652591-b002-4c78-8d77-7503f43a7484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffb437d31a574d1b9080130ed32209f3, user_id=c953c208e9b444949fa26c9961d10b5a, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:55.544740 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66652591-b002-4c78-8d77-7503f43a7484 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:55.555080 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1040/2079] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:23:55 2022] PUT /identity/v3/projects/ffb437d31a574d1b9080130ed32209f3/users/c953c208e9b444949fa26c9961d10b5a/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:23:55.565056 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2378e-18fd-4323-9555-6c1e04c50ac9 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:55.565349 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2378e-18fd-4323-9555-6c1e04c50ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:55.565738 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2378e-18fd-4323-9555-6c1e04c50ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:55.593045 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-e3f2378e-18fd-4323-9555-6c1e04c50ac9 None None] MFA Rules not processed for user `c953c208e9b444949fa26c9961d10b5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:23:55.594246 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-e3f2378e-18fd-4323-9555-6c1e04c50ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:55.643962 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:55.671249 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1040/2080] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:23:55 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:23:55.683060 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66652591-b002-4c78-8d77-7503f43a7484 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:55.684840 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-66652591-b002-4c78-8d77-7503f43a7484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:23:55.731638 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:55.747482 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66652591-b002-4c78-8d77-7503f43a7484 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:55.754927 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d655527c-f68a-4c7c-9443-1bb09203c575 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:55.754927 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655527c-f68a-4c7c-9443-1bb09203c575 service cinder] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:55.754927 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655527c-f68a-4c7c-9443-1bb09203c575 service cinder] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:55.754927 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655527c-f68a-4c7c-9443-1bb09203c575 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:55.762849 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d655527c-f68a-4c7c-9443-1bb09203c575 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:55.764189 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d655527c-f68a-4c7c-9443-1bb09203c575 service cinder] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:55.775425 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1041/2081] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:23:55 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:23:55.988826 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2378e-18fd-4323-9555-6c1e04c50ac9 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:55.999705 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2378e-18fd-4323-9555-6c1e04c50ac9 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:56.003629 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aaeaed-dd2d-48aa-9470-1d721c6e03fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:56.005439 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aaeaed-dd2d-48aa-9470-1d721c6e03fc service cinder] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:56.005439 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aaeaed-dd2d-48aa-9470-1d721c6e03fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:56.005690 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aaeaed-dd2d-48aa-9470-1d721c6e03fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:56.064712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aaeaed-dd2d-48aa-9470-1d721c6e03fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:56.066909 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aaeaed-dd2d-48aa-9470-1d721c6e03fc service cinder] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:56.075805 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1041/2082] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:23:55 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:23:59.633750 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d655527c-f68a-4c7c-9443-1bb09203c575 service cinder] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:23:59.695663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d655527c-f68a-4c7c-9443-1bb09203c575 service cinder] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:23:59.700128 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1dc27-c5f8-4379-b057-65d153782e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:23:59.701004 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1dc27-c5f8-4379-b057-65d153782e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:59.701281 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1dc27-c5f8-4379-b057-65d153782e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:59.701552 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1dc27-c5f8-4379-b057-65d153782e60 admin admin] PATH_INFO: `/v3/users/878fbc956c7748a28e1ac041e24d2a13` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:59.702741 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1dc27-c5f8-4379-b057-65d153782e60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=878fbc956c7748a28e1ac041e24d2a13)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:23:59.704688 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1dc27-c5f8-4379-b057-65d153782e60 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:23:59.875387 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-c6f1dc27-c5f8-4379-b057-65d153782e60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '878fbc956c7748a28e1ac041e24d2a13'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:59.887630 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-c6f1dc27-c5f8-4379-b057-65d153782e60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '878fbc956c7748a28e1ac041e24d2a13'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:59.888271 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-c6f1dc27-c5f8-4379-b057-65d153782e60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '878fbc956c7748a28e1ac041e24d2a13'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:59.894994 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-c6f1dc27-c5f8-4379-b057-65d153782e60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '878fbc956c7748a28e1ac041e24d2a13'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:59.896293 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-c6f1dc27-c5f8-4379-b057-65d153782e60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '878fbc956c7748a28e1ac041e24d2a13'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:23:59.972553 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1042/2083] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:23:59 2022] DELETE /identity/v3/users/878fbc956c7748a28e1ac041e24d2a13 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:23:59.977880 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23374b80-0332-465b-bd54-8b78e6306721 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:23:59.978366 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23374b80-0332-465b-bd54-8b78e6306721 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:23:59.978473 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23374b80-0332-465b-bd54-8b78e6306721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:23:59.996042 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-23374b80-0332-465b-bd54-8b78e6306721 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:23:59.997337 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-23374b80-0332-465b-bd54-8b78e6306721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:00.056224 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1042/2084] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:23:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:24:00.065708 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1dc27-c5f8-4379-b057-65d153782e60 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:00.067130 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-c6f1dc27-c5f8-4379-b057-65d153782e60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:00.125034 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1dc27-c5f8-4379-b057-65d153782e60 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:00.128698 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ca58d-2a5a-4199-9250-4fd66c98bb88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:00.129344 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ca58d-2a5a-4199-9250-4fd66c98bb88 service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:00.129626 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ca58d-2a5a-4199-9250-4fd66c98bb88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:00.129933 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ca58d-2a5a-4199-9250-4fd66c98bb88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:00.141572 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2ca58d-2a5a-4199-9250-4fd66c98bb88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:00.141572 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2ca58d-2a5a-4199-9250-4fd66c98bb88 service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:00.150599 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1043/2085] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:24:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:24:00.594475 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23374b80-0332-465b-bd54-8b78e6306721 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:00.595868 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-23374b80-0332-465b-bd54-8b78e6306721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:00.607836 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23374b80-0332-465b-bd54-8b78e6306721 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:00.612535 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc728ed-c2e3-4e48-94fb-e47a01a3a2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:00.613396 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc728ed-c2e3-4e48-94fb-e47a01a3a2a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:00.613682 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc728ed-c2e3-4e48-94fb-e47a01a3a2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:00.614448 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc728ed-c2e3-4e48-94fb-e47a01a3a2a9 admin admin] PATH_INFO: `/v3/projects/6afff705a25b4439ac98a72dc8c7b946` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:00.615795 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc728ed-c2e3-4e48-94fb-e47a01a3a2a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6afff705a25b4439ac98a72dc8c7b946)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:00.617775 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc728ed-c2e3-4e48-94fb-e47a01a3a2a9 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:00.745585 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-dcc728ed-c2e3-4e48-94fb-e47a01a3a2a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6afff705a25b4439ac98a72dc8c7b946', 'request_id': 'req-dcc728ed-c2e3-4e48-94fb-e47a01a3a2a9'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:00.819241 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-dcc728ed-c2e3-4e48-94fb-e47a01a3a2a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6afff705a25b4439ac98a72dc8c7b946', 'request_id': 'req-dcc728ed-c2e3-4e48-94fb-e47a01a3a2a9'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:00.825364 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-dcc728ed-c2e3-4e48-94fb-e47a01a3a2a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6afff705a25b4439ac98a72dc8c7b946', 'request_id': 'req-dcc728ed-c2e3-4e48-94fb-e47a01a3a2a9'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:00.836373 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-dcc728ed-c2e3-4e48-94fb-e47a01a3a2a9 admin admin] The token cache is being invalidate because project 6afff705a25b4439ac98a72dc8c7b946 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:24:00.836661 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-dcc728ed-c2e3-4e48-94fb-e47a01a3a2a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:00.837292 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-dcc728ed-c2e3-4e48-94fb-e47a01a3a2a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:00.838860 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1043/2086] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:24:00 2022] DELETE /identity/v3/projects/6afff705a25b4439ac98a72dc8c7b946 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:24:00.842867 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ca58d-2a5a-4199-9250-4fd66c98bb88 service neutron] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:00.847880 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:00.853380 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ca58d-2a5a-4199-9250-4fd66c98bb88 service neutron] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:00.913383 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd20b2a-6030-443a-a1c9-643d366013e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:00.914438 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd20b2a-6030-443a-a1c9-643d366013e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:00.914788 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd20b2a-6030-443a-a1c9-643d366013e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:00.915129 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd20b2a-6030-443a-a1c9-643d366013e7 admin admin] PATH_INFO: `/v3/users/c953c208e9b444949fa26c9961d10b5a` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:00.916473 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd20b2a-6030-443a-a1c9-643d366013e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c953c208e9b444949fa26c9961d10b5a)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:00.918521 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd20b2a-6030-443a-a1c9-643d366013e7 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:01.116317 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-0bd20b2a-6030-443a-a1c9-643d366013e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c953c208e9b444949fa26c9961d10b5a'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:01.129430 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-0bd20b2a-6030-443a-a1c9-643d366013e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c953c208e9b444949fa26c9961d10b5a'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:01.130198 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-0bd20b2a-6030-443a-a1c9-643d366013e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c953c208e9b444949fa26c9961d10b5a'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:01.136912 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-0bd20b2a-6030-443a-a1c9-643d366013e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c953c208e9b444949fa26c9961d10b5a'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:01.137531 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-0bd20b2a-6030-443a-a1c9-643d366013e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c953c208e9b444949fa26c9961d10b5a'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:01.192617 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1044/2087] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:24:00 2022] DELETE /identity/v3/users/c953c208e9b444949fa26c9961d10b5a => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:24:01.596208 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc728ed-c2e3-4e48-94fb-e47a01a3a2a9 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:01.597742 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-dcc728ed-c2e3-4e48-94fb-e47a01a3a2a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:01.633235 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:01.641075 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc728ed-c2e3-4e48-94fb-e47a01a3a2a9 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:01.699724 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49807f13-c8fe-4425-a3df-d2283a03ec91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:01.700648 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49807f13-c8fe-4425-a3df-d2283a03ec91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:01.700930 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49807f13-c8fe-4425-a3df-d2283a03ec91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:01.701206 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49807f13-c8fe-4425-a3df-d2283a03ec91 admin admin] PATH_INFO: `/v3/projects/ffb437d31a574d1b9080130ed32209f3` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:01.702376 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49807f13-c8fe-4425-a3df-d2283a03ec91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffb437d31a574d1b9080130ed32209f3)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:01.704308 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49807f13-c8fe-4425-a3df-d2283a03ec91 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:01.800235 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-49807f13-c8fe-4425-a3df-d2283a03ec91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffb437d31a574d1b9080130ed32209f3', 'request_id': 'req-49807f13-c8fe-4425-a3df-d2283a03ec91'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:01.889640 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-49807f13-c8fe-4425-a3df-d2283a03ec91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffb437d31a574d1b9080130ed32209f3', 'request_id': 'req-49807f13-c8fe-4425-a3df-d2283a03ec91'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:01.896220 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-49807f13-c8fe-4425-a3df-d2283a03ec91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffb437d31a574d1b9080130ed32209f3', 'request_id': 'req-49807f13-c8fe-4425-a3df-d2283a03ec91'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:01.911433 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-49807f13-c8fe-4425-a3df-d2283a03ec91 admin admin] The token cache is being invalidate because project ffb437d31a574d1b9080130ed32209f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:24:01.911747 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-49807f13-c8fe-4425-a3df-d2283a03ec91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:01.912454 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-49807f13-c8fe-4425-a3df-d2283a03ec91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:01.914016 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1044/2088] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:24:01 2022] DELETE /identity/v3/projects/ffb437d31a574d1b9080130ed32209f3 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:24:01.919056 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dda706-9323-4784-800f-09e1cf41d26d None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:01.919538 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dda706-9323-4784-800f-09e1cf41d26d None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:01.919653 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dda706-9323-4784-800f-09e1cf41d26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:01.938019 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-93dda706-9323-4784-800f-09e1cf41d26d None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:24:01.939414 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-93dda706-9323-4784-800f-09e1cf41d26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:02.010876 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1045/2089] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:24:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:24:02.019786 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf42e5-cad2-44c2-9703-c51c935b9f4b None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:02.020079 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf42e5-cad2-44c2-9703-c51c935b9f4b None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:02.021108 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf42e5-cad2-44c2-9703-c51c935b9f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:02.040351 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-decf42e5-cad2-44c2-9703-c51c935b9f4b None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:24:02.041574 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-decf42e5-cad2-44c2-9703-c51c935b9f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:02.049869 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1045/2090] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:24:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:24:02.053966 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dda706-9323-4784-800f-09e1cf41d26d None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:02.064003 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dda706-9323-4784-800f-09e1cf41d26d None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:02.069468 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40717663-f5b9-45e4-831a-0713b0207209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:02.070068 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40717663-f5b9-45e4-831a-0713b0207209 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:02.070351 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40717663-f5b9-45e4-831a-0713b0207209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:02.070627 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40717663-f5b9-45e4-831a-0713b0207209 admin admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:02.071357 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40717663-f5b9-45e4-831a-0713b0207209 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:24:02.071682 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40717663-f5b9-45e4-831a-0713b0207209 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:02.073331 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40717663-f5b9-45e4-831a-0713b0207209 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:02.087646 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1046/2091] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:24:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:24:02.092020 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf42e5-cad2-44c2-9703-c51c935b9f4b None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:02.101754 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf42e5-cad2-44c2-9703-c51c935b9f4b None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:02.106676 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8984e-898e-4bee-973b-05037a0d3e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:02.107375 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8984e-898e-4bee-973b-05037a0d3e72 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:02.107789 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8984e-898e-4bee-973b-05037a0d3e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:02.108074 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8984e-898e-4bee-973b-05037a0d3e72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:02.108810 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8984e-898e-4bee-973b-05037a0d3e72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:02.110768 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8984e-898e-4bee-973b-05037a0d3e72 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:02.221147 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1046/2092] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:24:02 2022] POST /identity/v3/projects => generated 369 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:24:02.225309 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40717663-f5b9-45e4-831a-0713b0207209 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:02.235341 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40717663-f5b9-45e4-831a-0713b0207209 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:02.241438 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:02.294403 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1b4d5-2dfe-4926-b5df-d916bd539a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:02.295076 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1b4d5-2dfe-4926-b5df-d916bd539a43 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:02.295357 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1b4d5-2dfe-4926-b5df-d916bd539a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:02.295629 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1b4d5-2dfe-4926-b5df-d916bd539a43 admin admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:02.296359 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef1b4d5-2dfe-4926-b5df-d916bd539a43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:02.298409 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef1b4d5-2dfe-4926-b5df-d916bd539a43 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:02.396749 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1047/2093] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:24:02 2022] POST /identity/v3/users => generated 285 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:24:02.398195 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8984e-898e-4bee-973b-05037a0d3e72 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:02.409010 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8984e-898e-4bee-973b-05037a0d3e72 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:02.413950 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5af1c-6be9-4d3a-82ae-b1445ee9b8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:02.414663 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5af1c-6be9-4d3a-82ae-b1445ee9b8ab admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:02.414949 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5af1c-6be9-4d3a-82ae-b1445ee9b8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:02.415229 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5af1c-6be9-4d3a-82ae-b1445ee9b8ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:02.415957 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5af1c-6be9-4d3a-82ae-b1445ee9b8ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:02.417640 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5af1c-6be9-4d3a-82ae-b1445ee9b8ab admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:02.429694 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1047/2094] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:24:02.433776 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1b4d5-2dfe-4926-b5df-d916bd539a43 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:02.445161 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1b4d5-2dfe-4926-b5df-d916bd539a43 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:02.450448 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed2b96-9a74-4f28-9ce9-9561b61a01f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:02.450710 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed2b96-9a74-4f28-9ce9-9561b61a01f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:02.450804 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed2b96-9a74-4f28-9ce9-9561b61a01f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:02.451079 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed2b96-9a74-4f28-9ce9-9561b61a01f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:02.451799 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed2b96-9a74-4f28-9ce9-9561b61a01f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:02.453440 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed2b96-9a74-4f28-9ce9-9561b61a01f1 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:02.463540 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1048/2095] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:24:02.467684 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5af1c-6be9-4d3a-82ae-b1445ee9b8ab admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:02.478576 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5af1c-6be9-4d3a-82ae-b1445ee9b8ab admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:02.483245 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126cab9d-8f1c-460b-a7a7-b8b4138cb244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:02.484116 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cab9d-8f1c-460b-a7a7-b8b4138cb244 admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:02.484502 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cab9d-8f1c-460b-a7a7-b8b4138cb244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:02.484778 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cab9d-8f1c-460b-a7a7-b8b4138cb244 admin admin] PATH_INFO: `/v3/projects/33b9f825f65d4d75a86ee03dcdc769e1/users/7f14c01cb61348e59856b30b14ef2dba/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:02.500585 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126cab9d-8f1c-460b-a7a7-b8b4138cb244 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33b9f825f65d4d75a86ee03dcdc769e1, user_id=7f14c01cb61348e59856b30b14ef2dba, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:02.503230 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126cab9d-8f1c-460b-a7a7-b8b4138cb244 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:02.608235 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1048/2096] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:24:02 2022] PUT /identity/v3/projects/33b9f825f65d4d75a86ee03dcdc769e1/users/7f14c01cb61348e59856b30b14ef2dba/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:24:02.619664 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c8995-0768-4c69-ac95-3e25ec629c49 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:02.619952 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c8995-0768-4c69-ac95-3e25ec629c49 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:02.620267 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c8995-0768-4c69-ac95-3e25ec629c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:02.650393 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-d16c8995-0768-4c69-ac95-3e25ec629c49 None None] MFA Rules not processed for user `7f14c01cb61348e59856b30b14ef2dba`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:24:02.651597 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-d16c8995-0768-4c69-ac95-3e25ec629c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:02.722661 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1049/2097] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:24:02 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:24:02.728498 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126cab9d-8f1c-460b-a7a7-b8b4138cb244 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:02.763915 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:02.794649 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126cab9d-8f1c-460b-a7a7-b8b4138cb244 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:02.800915 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3645e-3262-4e40-9316-5f4702c78d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:02.802313 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3645e-3262-4e40-9316-5f4702c78d85 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:02.803132 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3645e-3262-4e40-9316-5f4702c78d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:02.803282 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3645e-3262-4e40-9316-5f4702c78d85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:02.803873 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe3645e-3262-4e40-9316-5f4702c78d85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:02.805905 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe3645e-3262-4e40-9316-5f4702c78d85 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:02.934530 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1049/2098] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:24:02 2022] POST /identity/v3/projects => generated 369 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:24:02.938819 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c8995-0768-4c69-ac95-3e25ec629c49 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:02.949971 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c8995-0768-4c69-ac95-3e25ec629c49 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:03.029460 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ace71-3465-4199-9553-0bf39f8de68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:03.030136 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ace71-3465-4199-9553-0bf39f8de68b admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:03.030414 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ace71-3465-4199-9553-0bf39f8de68b admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:03.030684 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ace71-3465-4199-9553-0bf39f8de68b admin admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:03.031441 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587ace71-3465-4199-9553-0bf39f8de68b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:03.033533 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587ace71-3465-4199-9553-0bf39f8de68b admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:03.130764 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1050/2099] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:24:02 2022] POST /identity/v3/users => generated 291 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:24:03.134769 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3645e-3262-4e40-9316-5f4702c78d85 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:03.144875 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3645e-3262-4e40-9316-5f4702c78d85 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:03.150087 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a0349-926d-4c7b-8e26-e9855616e79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:03.150746 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a0349-926d-4c7b-8e26-e9855616e79e admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:03.151032 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a0349-926d-4c7b-8e26-e9855616e79e admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:03.151307 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a0349-926d-4c7b-8e26-e9855616e79e admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:03.152240 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a0349-926d-4c7b-8e26-e9855616e79e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:03.153845 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a0349-926d-4c7b-8e26-e9855616e79e admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:03.166567 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1050/2100] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:24:03.170800 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ace71-3465-4199-9553-0bf39f8de68b admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:03.181134 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ace71-3465-4199-9553-0bf39f8de68b admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:03.185914 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f47296-c08c-4a27-b746-3595390be274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:03.186797 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f47296-c08c-4a27-b746-3595390be274 admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:03.187078 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f47296-c08c-4a27-b746-3595390be274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:03.187817 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f47296-c08c-4a27-b746-3595390be274 admin admin] PATH_INFO: `/v3/projects/acd1789eb72a4f3e9d47d69d63542cc2/users/c0a46d5de20b4a83a9caf0d6f508c901/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:03.189808 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:03.203486 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f47296-c08c-4a27-b746-3595390be274 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acd1789eb72a4f3e9d47d69d63542cc2, user_id=c0a46d5de20b4a83a9caf0d6f508c901, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:03.206160 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f47296-c08c-4a27-b746-3595390be274 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:03.290664 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a0349-926d-4c7b-8e26-e9855616e79e admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:03.291249 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1051/2101] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:24:03 2022] PUT /identity/v3/projects/acd1789eb72a4f3e9d47d69d63542cc2/users/c0a46d5de20b4a83a9caf0d6f508c901/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:24:03.300820 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a0349-926d-4c7b-8e26-e9855616e79e admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:03.367970 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfaca33-ed8c-4013-80cf-fd5523ce6c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:03.368856 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfaca33-ed8c-4013-80cf-fd5523ce6c51 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:03.369400 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfaca33-ed8c-4013-80cf-fd5523ce6c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:03.369680 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfaca33-ed8c-4013-80cf-fd5523ce6c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:03.370412 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfaca33-ed8c-4013-80cf-fd5523ce6c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:03.372009 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfaca33-ed8c-4013-80cf-fd5523ce6c51 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:03.383862 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1051/2102] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:24:03.387940 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f47296-c08c-4a27-b746-3595390be274 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:03.401763 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f47296-c08c-4a27-b746-3595390be274 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:03.407136 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305e832-6668-4834-ac78-91d1bf8317a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:03.408009 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305e832-6668-4834-ac78-91d1bf8317a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:03.410788 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305e832-6668-4834-ac78-91d1bf8317a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:03.411301 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305e832-6668-4834-ac78-91d1bf8317a1 admin admin] PATH_INFO: `/v3/projects/acd1789eb72a4f3e9d47d69d63542cc2/users/c0a46d5de20b4a83a9caf0d6f508c901/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:03.413395 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7305e832-6668-4834-ac78-91d1bf8317a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acd1789eb72a4f3e9d47d69d63542cc2, user_id=c0a46d5de20b4a83a9caf0d6f508c901, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:03.420258 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7305e832-6668-4834-ac78-91d1bf8317a1 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:03.428774 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1052/2103] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:24:03 2022] PUT /identity/v3/projects/acd1789eb72a4f3e9d47d69d63542cc2/users/c0a46d5de20b4a83a9caf0d6f508c901/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:24:03.439720 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae55d2f-eb8a-4a09-ab26-37a03d44be6e None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:03.440245 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae55d2f-eb8a-4a09-ab26-37a03d44be6e None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:03.440427 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae55d2f-eb8a-4a09-ab26-37a03d44be6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:03.471426 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-cae55d2f-eb8a-4a09-ab26-37a03d44be6e None None] MFA Rules not processed for user `c0a46d5de20b4a83a9caf0d6f508c901`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:24:03.472909 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-cae55d2f-eb8a-4a09-ab26-37a03d44be6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:03.554667 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1052/2104] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:24:03 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:24:03.565550 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305e832-6668-4834-ac78-91d1bf8317a1 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:03.567831 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-7305e832-6668-4834-ac78-91d1bf8317a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:03.644025 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305e832-6668-4834-ac78-91d1bf8317a1 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:03.646695 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58280f0-97ef-433f-9a4f-aa9a8fa76bb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:03.647354 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58280f0-97ef-433f-9a4f-aa9a8fa76bb4 service cinder] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:03.647636 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58280f0-97ef-433f-9a4f-aa9a8fa76bb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:03.647915 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58280f0-97ef-433f-9a4f-aa9a8fa76bb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:03.657193 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58280f0-97ef-433f-9a4f-aa9a8fa76bb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:03.658635 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58280f0-97ef-433f-9a4f-aa9a8fa76bb4 service cinder] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:03.670239 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1053/2105] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:24:03 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:24:03.690556 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae55d2f-eb8a-4a09-ab26-37a03d44be6e None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:03.693471 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-cae55d2f-eb8a-4a09-ab26-37a03d44be6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:03.732112 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:03.765898 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae55d2f-eb8a-4a09-ab26-37a03d44be6e None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:03.771328 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a72ede4-4420-4e26-8c5a-3d4d1a39a8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:03.772224 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a72ede4-4420-4e26-8c5a-3d4d1a39a8fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:03.772514 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a72ede4-4420-4e26-8c5a-3d4d1a39a8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:03.772785 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a72ede4-4420-4e26-8c5a-3d4d1a39a8fc admin admin] PATH_INFO: `/v3/users/1a7074fa31fd41719fd2059e9b0697d0` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:03.773985 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a72ede4-4420-4e26-8c5a-3d4d1a39a8fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a7074fa31fd41719fd2059e9b0697d0)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:03.775899 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a72ede4-4420-4e26-8c5a-3d4d1a39a8fc admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:04.037582 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-7a72ede4-4420-4e26-8c5a-3d4d1a39a8fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a7074fa31fd41719fd2059e9b0697d0'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:04.049640 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-7a72ede4-4420-4e26-8c5a-3d4d1a39a8fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a7074fa31fd41719fd2059e9b0697d0'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:04.050327 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-7a72ede4-4420-4e26-8c5a-3d4d1a39a8fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a7074fa31fd41719fd2059e9b0697d0'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:04.057431 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-7a72ede4-4420-4e26-8c5a-3d4d1a39a8fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a7074fa31fd41719fd2059e9b0697d0'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:04.058112 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-7a72ede4-4420-4e26-8c5a-3d4d1a39a8fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a7074fa31fd41719fd2059e9b0697d0'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:04.130324 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58280f0-97ef-433f-9a4f-aa9a8fa76bb4 service cinder] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:04.131795 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-c58280f0-97ef-433f-9a4f-aa9a8fa76bb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:04.144182 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1053/2106] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:24:03 2022] DELETE /identity/v3/users/1a7074fa31fd41719fd2059e9b0697d0 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:24:04.145134 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58280f0-97ef-433f-9a4f-aa9a8fa76bb4 service cinder] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:04.206170 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42b205-e348-43b4-b023-4bbcb4de6acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:04.207051 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42b205-e348-43b4-b023-4bbcb4de6acf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:04.207329 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42b205-e348-43b4-b023-4bbcb4de6acf admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:04.207606 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42b205-e348-43b4-b023-4bbcb4de6acf admin admin] PATH_INFO: `/v3/users/e25d0027b3494815b01c60e4042cdb38` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:04.209576 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d42b205-e348-43b4-b023-4bbcb4de6acf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e25d0027b3494815b01c60e4042cdb38)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:04.211513 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d42b205-e348-43b4-b023-4bbcb4de6acf admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:04.387165 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-7d42b205-e348-43b4-b023-4bbcb4de6acf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e25d0027b3494815b01c60e4042cdb38'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:04.399875 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-7d42b205-e348-43b4-b023-4bbcb4de6acf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e25d0027b3494815b01c60e4042cdb38'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:04.400411 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-7d42b205-e348-43b4-b023-4bbcb4de6acf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e25d0027b3494815b01c60e4042cdb38'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:04.407656 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-7d42b205-e348-43b4-b023-4bbcb4de6acf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e25d0027b3494815b01c60e4042cdb38'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:04.408474 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-7d42b205-e348-43b4-b023-4bbcb4de6acf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e25d0027b3494815b01c60e4042cdb38'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:04.410251 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a72ede4-4420-4e26-8c5a-3d4d1a39a8fc admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:04.410683 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:04.412691 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-7a72ede4-4420-4e26-8c5a-3d4d1a39a8fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:04.433862 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a72ede4-4420-4e26-8c5a-3d4d1a39a8fc admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:04.442044 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12956b8e-6402-45d5-af5b-596e425ca604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:04.444335 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12956b8e-6402-45d5-af5b-596e425ca604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:04.445485 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12956b8e-6402-45d5-af5b-596e425ca604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:04.445899 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12956b8e-6402-45d5-af5b-596e425ca604 admin admin] PATH_INFO: `/v3/projects/b14c46915c924d81ae33a8208181405a` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:04.447669 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12956b8e-6402-45d5-af5b-596e425ca604 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b14c46915c924d81ae33a8208181405a)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:04.450443 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12956b8e-6402-45d5-af5b-596e425ca604 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:04.488613 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1054/2107] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:24:04 2022] DELETE /identity/v3/users/e25d0027b3494815b01c60e4042cdb38 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:24:04.496666 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac82499-9751-4f7a-a37d-8a71525a96c5 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:04.496894 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac82499-9751-4f7a-a37d-8a71525a96c5 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:04.497500 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac82499-9751-4f7a-a37d-8a71525a96c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:04.515793 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-cac82499-9751-4f7a-a37d-8a71525a96c5 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:24:04.517230 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-cac82499-9751-4f7a-a37d-8a71525a96c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:04.577304 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1055/2108] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:24:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:24:04.587421 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac82499-9751-4f7a-a37d-8a71525a96c5 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:04.588768 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-cac82499-9751-4f7a-a37d-8a71525a96c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:04.603284 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-12956b8e-6402-45d5-af5b-596e425ca604 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b14c46915c924d81ae33a8208181405a', 'request_id': 'req-12956b8e-6402-45d5-af5b-596e425ca604'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:04.649800 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac82499-9751-4f7a-a37d-8a71525a96c5 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:04.678690 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-12956b8e-6402-45d5-af5b-596e425ca604 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b14c46915c924d81ae33a8208181405a', 'request_id': 'req-12956b8e-6402-45d5-af5b-596e425ca604'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:04.684913 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-12956b8e-6402-45d5-af5b-596e425ca604 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b14c46915c924d81ae33a8208181405a', 'request_id': 'req-12956b8e-6402-45d5-af5b-596e425ca604'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:04.697187 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-12956b8e-6402-45d5-af5b-596e425ca604 admin admin] The token cache is being invalidate because project b14c46915c924d81ae33a8208181405a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:24:04.697827 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-12956b8e-6402-45d5-af5b-596e425ca604 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:04.698095 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-12956b8e-6402-45d5-af5b-596e425ca604 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:04.698616 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120775fb-8fbc-405c-a173-3df3c8b034b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:04.699287 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120775fb-8fbc-405c-a173-3df3c8b034b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:04.702625 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1054/2109] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:24:04 2022] DELETE /identity/v3/projects/b14c46915c924d81ae33a8208181405a => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:24:04.702756 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120775fb-8fbc-405c-a173-3df3c8b034b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:04.702756 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120775fb-8fbc-405c-a173-3df3c8b034b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:04.702756 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-120775fb-8fbc-405c-a173-3df3c8b034b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:04.703448 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12956b8e-6402-45d5-af5b-596e425ca604 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:04.704767 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-12956b8e-6402-45d5-af5b-596e425ca604 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:04.736410 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:04.770524 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120775fb-8fbc-405c-a173-3df3c8b034b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:04.772024 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120775fb-8fbc-405c-a173-3df3c8b034b0 service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:04.772570 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12956b8e-6402-45d5-af5b-596e425ca604 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:04.780191 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085dd3a2-dc88-44ca-8119-4a290e8fc66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:04.780191 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085dd3a2-dc88-44ca-8119-4a290e8fc66f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:04.780191 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085dd3a2-dc88-44ca-8119-4a290e8fc66f admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:04.782341 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085dd3a2-dc88-44ca-8119-4a290e8fc66f admin admin] PATH_INFO: `/v3/users/896ae1bf255e4814a39798d595e43ff2` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:04.782341 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085dd3a2-dc88-44ca-8119-4a290e8fc66f admin admin] RBAC: Authorizing `identity:delete_user(user_id=896ae1bf255e4814a39798d595e43ff2)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:04.783835 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085dd3a2-dc88-44ca-8119-4a290e8fc66f admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:04.790043 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1056/2110] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:24:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 13:24:05.058611 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-085dd3a2-dc88-44ca-8119-4a290e8fc66f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '896ae1bf255e4814a39798d595e43ff2'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:05.092179 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-085dd3a2-dc88-44ca-8119-4a290e8fc66f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '896ae1bf255e4814a39798d595e43ff2'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:05.092179 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-085dd3a2-dc88-44ca-8119-4a290e8fc66f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '896ae1bf255e4814a39798d595e43ff2'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:05.100987 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-085dd3a2-dc88-44ca-8119-4a290e8fc66f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '896ae1bf255e4814a39798d595e43ff2'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:05.101934 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-085dd3a2-dc88-44ca-8119-4a290e8fc66f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '896ae1bf255e4814a39798d595e43ff2'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:05.188737 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1055/2111] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:24:04 2022] DELETE /identity/v3/users/896ae1bf255e4814a39798d595e43ff2 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:24:05.210988 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:05.322460 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120775fb-8fbc-405c-a173-3df3c8b034b0 service neutron] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:05.324094 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-120775fb-8fbc-405c-a173-3df3c8b034b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:05.336390 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120775fb-8fbc-405c-a173-3df3c8b034b0 service neutron] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:05.424135 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077fe789-008e-4117-8713-dcb5beaca557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:05.425040 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fe789-008e-4117-8713-dcb5beaca557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:05.425326 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fe789-008e-4117-8713-dcb5beaca557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:05.425627 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fe789-008e-4117-8713-dcb5beaca557 admin admin] PATH_INFO: `/v3/projects/b46a3a5107454a07aafe1bf043efa5f0` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:05.426914 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077fe789-008e-4117-8713-dcb5beaca557 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b46a3a5107454a07aafe1bf043efa5f0)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:05.428937 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077fe789-008e-4117-8713-dcb5beaca557 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:05.451994 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085dd3a2-dc88-44ca-8119-4a290e8fc66f admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:05.453486 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-085dd3a2-dc88-44ca-8119-4a290e8fc66f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:05.474483 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085dd3a2-dc88-44ca-8119-4a290e8fc66f admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:05.484807 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e50845-cecb-4b9a-ba00-c4b224050728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:05.485678 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e50845-cecb-4b9a-ba00-c4b224050728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:05.485960 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e50845-cecb-4b9a-ba00-c4b224050728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:05.486233 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e50845-cecb-4b9a-ba00-c4b224050728 admin admin] PATH_INFO: `/v3/projects/7ed29067963c4f19b6c340fd18688f1f` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:05.487465 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e50845-cecb-4b9a-ba00-c4b224050728 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ed29067963c4f19b6c340fd18688f1f)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:05.489517 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e50845-cecb-4b9a-ba00-c4b224050728 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:05.569982 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-077fe789-008e-4117-8713-dcb5beaca557 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b46a3a5107454a07aafe1bf043efa5f0', 'request_id': 'req-077fe789-008e-4117-8713-dcb5beaca557'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:05.577770 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-077fe789-008e-4117-8713-dcb5beaca557 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b46a3a5107454a07aafe1bf043efa5f0', 'request_id': 'req-077fe789-008e-4117-8713-dcb5beaca557'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:05.585245 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-077fe789-008e-4117-8713-dcb5beaca557 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b46a3a5107454a07aafe1bf043efa5f0', 'request_id': 'req-077fe789-008e-4117-8713-dcb5beaca557'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:05.596706 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-07e50845-cecb-4b9a-ba00-c4b224050728 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ed29067963c4f19b6c340fd18688f1f', 'request_id': 'req-07e50845-cecb-4b9a-ba00-c4b224050728'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:05.678670 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-077fe789-008e-4117-8713-dcb5beaca557 admin admin] The token cache is being invalidate because project b46a3a5107454a07aafe1bf043efa5f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:24:05.679025 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-077fe789-008e-4117-8713-dcb5beaca557 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:05.679837 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-077fe789-008e-4117-8713-dcb5beaca557 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:05.681484 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1057/2112] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:24:05 2022] DELETE /identity/v3/projects/b46a3a5107454a07aafe1bf043efa5f0 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:24:05.686467 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308e183-8119-4ef6-a312-fa371a1f2362 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:05.686759 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308e183-8119-4ef6-a312-fa371a1f2362 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:05.687038 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308e183-8119-4ef6-a312-fa371a1f2362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:05.706777 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-5308e183-8119-4ef6-a312-fa371a1f2362 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:24:05.708739 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-5308e183-8119-4ef6-a312-fa371a1f2362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:05.767974 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-07e50845-cecb-4b9a-ba00-c4b224050728 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ed29067963c4f19b6c340fd18688f1f', 'request_id': 'req-07e50845-cecb-4b9a-ba00-c4b224050728'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:05.768450 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1058/2113] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:24:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:24:05.775075 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-07e50845-cecb-4b9a-ba00-c4b224050728 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ed29067963c4f19b6c340fd18688f1f', 'request_id': 'req-07e50845-cecb-4b9a-ba00-c4b224050728'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:05.776091 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141db7fb-9f93-40c5-9411-ddccd590b979 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:05.776452 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141db7fb-9f93-40c5-9411-ddccd590b979 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:05.776691 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141db7fb-9f93-40c5-9411-ddccd590b979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:05.789149 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-07e50845-cecb-4b9a-ba00-c4b224050728 admin admin] The token cache is being invalidate because project 7ed29067963c4f19b6c340fd18688f1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:24:05.790293 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-07e50845-cecb-4b9a-ba00-c4b224050728 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:05.794464 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-07e50845-cecb-4b9a-ba00-c4b224050728 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:05.794464 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1056/2114] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:24:05 2022] DELETE /identity/v3/projects/7ed29067963c4f19b6c340fd18688f1f => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:24:05.798087 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e593c-53cc-4912-b439-ee5bee2241cd None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:05.798535 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e593c-53cc-4912-b439-ee5bee2241cd None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:05.798961 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e593c-53cc-4912-b439-ee5bee2241cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:05.799904 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-141db7fb-9f93-40c5-9411-ddccd590b979 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:24:05.801227 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-141db7fb-9f93-40c5-9411-ddccd590b979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:05.811949 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1059/2115] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:24:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:24:05.820815 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-a37e593c-53cc-4912-b439-ee5bee2241cd None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:24:05.821010 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141db7fb-9f93-40c5-9411-ddccd590b979 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:05.822197 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-a37e593c-53cc-4912-b439-ee5bee2241cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:05.830088 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141db7fb-9f93-40c5-9411-ddccd590b979 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:05.830664 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1057/2116] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:24:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:24:05.835480 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d75032-60c4-4015-b5c5-7cf04c9f48a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:05.836137 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d75032-60c4-4015-b5c5-7cf04c9f48a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:05.836458 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d75032-60c4-4015-b5c5-7cf04c9f48a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:05.836761 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d75032-60c4-4015-b5c5-7cf04c9f48a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:05.837552 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d75032-60c4-4015-b5c5-7cf04c9f48a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:24:05.837825 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d75032-60c4-4015-b5c5-7cf04c9f48a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:05.839263 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd59c1-569a-4427-a9c5-403a29acc057 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:05.839425 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d75032-60c4-4015-b5c5-7cf04c9f48a1 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:05.839557 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd59c1-569a-4427-a9c5-403a29acc057 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:05.839841 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd59c1-569a-4427-a9c5-403a29acc057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:05.851405 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1060/2117] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:24:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:24:05.855777 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d75032-60c4-4015-b5c5-7cf04c9f48a1 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:05.858850 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-44dd59c1-569a-4427-a9c5-403a29acc057 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:24:05.860033 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-44dd59c1-569a-4427-a9c5-403a29acc057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:05.865871 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d75032-60c4-4015-b5c5-7cf04c9f48a1 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:05.870515 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1058/2118] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:24:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:24:05.871272 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485695ba-0b1f-43f5-ac9b-2d959616b1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:05.871913 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485695ba-0b1f-43f5-ac9b-2d959616b1a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:05.874141 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485695ba-0b1f-43f5-ac9b-2d959616b1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:05.874141 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485695ba-0b1f-43f5-ac9b-2d959616b1a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:05.874141 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485695ba-0b1f-43f5-ac9b-2d959616b1a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:05.875063 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485695ba-0b1f-43f5-ac9b-2d959616b1a4 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:05.877104 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd59c1-569a-4427-a9c5-403a29acc057 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:05.887140 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd59c1-569a-4427-a9c5-403a29acc057 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:05.891943 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81cc38-ce9a-429b-869c-ebd7af0b509d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:05.892639 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81cc38-ce9a-429b-869c-ebd7af0b509d admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:05.892923 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81cc38-ce9a-429b-869c-ebd7af0b509d admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:05.893198 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81cc38-ce9a-429b-869c-ebd7af0b509d admin admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:05.894008 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81cc38-ce9a-429b-869c-ebd7af0b509d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:24:05.894271 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81cc38-ce9a-429b-869c-ebd7af0b509d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:05.896408 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81cc38-ce9a-429b-869c-ebd7af0b509d admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:05.908443 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1059/2119] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:24:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:24:05.912724 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81cc38-ce9a-429b-869c-ebd7af0b509d admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:05.918660 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:05.922366 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81cc38-ce9a-429b-869c-ebd7af0b509d admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:05.927793 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17b777-00c8-4de9-b330-fd378a9f07c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:05.928659 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17b777-00c8-4de9-b330-fd378a9f07c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:05.928946 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17b777-00c8-4de9-b330-fd378a9f07c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:05.929227 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17b777-00c8-4de9-b330-fd378a9f07c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:05.930024 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17b777-00c8-4de9-b330-fd378a9f07c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:05.931901 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17b777-00c8-4de9-b330-fd378a9f07c1 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:06.034656 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1061/2120] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:24:05 2022] POST /identity/v3/projects => generated 383 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:24:06.038823 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485695ba-0b1f-43f5-ac9b-2d959616b1a4 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:06.057534 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:06.059475 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1060/2121] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:24:05 2022] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:24:06.063367 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17b777-00c8-4de9-b330-fd378a9f07c1 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:06.113488 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485695ba-0b1f-43f5-ac9b-2d959616b1a4 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:06.136326 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17b777-00c8-4de9-b330-fd378a9f07c1 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:06.141150 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f559e9-49bc-489a-a57a-a0f2b4f580f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:06.141820 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f559e9-49bc-489a-a57a-a0f2b4f580f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:06.142448 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f559e9-49bc-489a-a57a-a0f2b4f580f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:06.142448 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f559e9-49bc-489a-a57a-a0f2b4f580f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:06.143091 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f559e9-49bc-489a-a57a-a0f2b4f580f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:06.145926 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f559e9-49bc-489a-a57a-a0f2b4f580f0 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:06.172464 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3c4f8-35c2-4338-8e24-d98ebdfc0823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:06.173126 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3c4f8-35c2-4338-8e24-d98ebdfc0823 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:06.173404 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3c4f8-35c2-4338-8e24-d98ebdfc0823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:06.173677 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3c4f8-35c2-4338-8e24-d98ebdfc0823 admin admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:06.174344 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3c4f8-35c2-4338-8e24-d98ebdfc0823 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:06.176285 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3c4f8-35c2-4338-8e24-d98ebdfc0823 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:06.250320 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1061/2122] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:24:06 2022] POST /identity/v3/users => generated 289 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:24:06.254253 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f559e9-49bc-489a-a57a-a0f2b4f580f0 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:06.265276 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f559e9-49bc-489a-a57a-a0f2b4f580f0 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:06.271182 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc26e459-b48c-4840-8b8b-2598817fed69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:06.272091 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26e459-b48c-4840-8b8b-2598817fed69 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:06.272545 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26e459-b48c-4840-8b8b-2598817fed69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:06.272966 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26e459-b48c-4840-8b8b-2598817fed69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:06.273855 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc26e459-b48c-4840-8b8b-2598817fed69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:06.275949 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc26e459-b48c-4840-8b8b-2598817fed69 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:06.285694 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1062/2123] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:24:06 2022] POST /identity/v3/users => generated 292 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:24:06.288624 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1062/2124] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:24:06.290285 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc26e459-b48c-4840-8b8b-2598817fed69 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:06.292389 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3c4f8-35c2-4338-8e24-d98ebdfc0823 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:06.301071 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc26e459-b48c-4840-8b8b-2598817fed69 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:06.303109 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3c4f8-35c2-4338-8e24-d98ebdfc0823 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:06.306453 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1fa73c-fe80-4a3c-8af2-be7a1449d8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:06.307119 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fa73c-fe80-4a3c-8af2-be7a1449d8f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:06.314891 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fa73c-fe80-4a3c-8af2-be7a1449d8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:06.314891 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fa73c-fe80-4a3c-8af2-be7a1449d8f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:06.314891 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1fa73c-fe80-4a3c-8af2-be7a1449d8f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:06.315276 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d1c5f-8fe7-412a-ab2f-b668b6b4f6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:06.315276 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d1c5f-8fe7-412a-ab2f-b668b6b4f6cd admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:06.315276 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d1c5f-8fe7-412a-ab2f-b668b6b4f6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:06.315530 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1fa73c-fe80-4a3c-8af2-be7a1449d8f4 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:06.315637 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d1c5f-8fe7-412a-ab2f-b668b6b4f6cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:06.315637 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d1c5f-8fe7-412a-ab2f-b668b6b4f6cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:06.315637 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d1c5f-8fe7-412a-ab2f-b668b6b4f6cd admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:06.323903 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1063/2125] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:24:06.327080 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1063/2126] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:24:06.328068 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1fa73c-fe80-4a3c-8af2-be7a1449d8f4 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:06.330452 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d1c5f-8fe7-412a-ab2f-b668b6b4f6cd admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:06.339250 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1fa73c-fe80-4a3c-8af2-be7a1449d8f4 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:06.344111 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff714f7b-fd28-4584-9628-62d933ecd54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:06.344805 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff714f7b-fd28-4584-9628-62d933ecd54a admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:06.345089 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff714f7b-fd28-4584-9628-62d933ecd54a admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:06.345465 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff714f7b-fd28-4584-9628-62d933ecd54a admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:06.353059 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d1c5f-8fe7-412a-ab2f-b668b6b4f6cd admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:06.353190 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff714f7b-fd28-4584-9628-62d933ecd54a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:06.353190 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff714f7b-fd28-4584-9628-62d933ecd54a admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:06.353445 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6e552-59bc-48a3-b56c-6e5ce4f43190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:06.354482 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6e552-59bc-48a3-b56c-6e5ce4f43190 admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:06.354769 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6e552-59bc-48a3-b56c-6e5ce4f43190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:06.355041 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6e552-59bc-48a3-b56c-6e5ce4f43190 admin admin] PATH_INFO: `/v3/projects/b9f5846d73bc465ba3009a1600e6ca95/users/4be47589351a489c8bd0c2ede4ccc235/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:06.358909 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1064/2127] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:24:06.363201 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff714f7b-fd28-4584-9628-62d933ecd54a admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:06.372274 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb6e552-59bc-48a3-b56c-6e5ce4f43190 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9f5846d73bc465ba3009a1600e6ca95, user_id=4be47589351a489c8bd0c2ede4ccc235, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:06.375953 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb6e552-59bc-48a3-b56c-6e5ce4f43190 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:06.377312 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff714f7b-fd28-4584-9628-62d933ecd54a admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:06.383164 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2462373-439c-407c-ab4d-a700cfa5da49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:06.384098 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2462373-439c-407c-ab4d-a700cfa5da49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:06.384427 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2462373-439c-407c-ab4d-a700cfa5da49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:06.384749 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2462373-439c-407c-ab4d-a700cfa5da49 admin admin] PATH_INFO: `/v3/projects/03432cb8c28c46fba16dc9f88d648d11/users/4d0490962ec743048ef924340c93de20/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:06.414523 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2462373-439c-407c-ab4d-a700cfa5da49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03432cb8c28c46fba16dc9f88d648d11, user_id=4d0490962ec743048ef924340c93de20, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:06.417240 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2462373-439c-407c-ab4d-a700cfa5da49 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:06.458908 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1064/2128] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:24:06 2022] PUT /identity/v3/projects/b9f5846d73bc465ba3009a1600e6ca95/users/4be47589351a489c8bd0c2ede4ccc235/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:24:06.470204 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60c915-f1ca-421b-afd2-efc412cb3935 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:06.470430 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60c915-f1ca-421b-afd2-efc412cb3935 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:06.470704 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60c915-f1ca-421b-afd2-efc412cb3935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:06.498554 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-5f60c915-f1ca-421b-afd2-efc412cb3935 None None] MFA Rules not processed for user `4be47589351a489c8bd0c2ede4ccc235`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:24:06.499914 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-5f60c915-f1ca-421b-afd2-efc412cb3935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:06.515840 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1065/2129] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:24:06 2022] PUT /identity/v3/projects/03432cb8c28c46fba16dc9f88d648d11/users/4d0490962ec743048ef924340c93de20/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:24:06.521120 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d5162-e4ea-4986-a3f8-eeff2cef8ea9 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:06.521404 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d5162-e4ea-4986-a3f8-eeff2cef8ea9 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:06.521833 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d5162-e4ea-4986-a3f8-eeff2cef8ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:06.540912 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-f42d5162-e4ea-4986-a3f8-eeff2cef8ea9 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:24:06.542380 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-f42d5162-e4ea-4986-a3f8-eeff2cef8ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:06.567945 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1065/2130] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:24:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:24:06.572230 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60c915-f1ca-421b-afd2-efc412cb3935 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:06.612417 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1066/2131] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:24:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:24:06.622535 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d5162-e4ea-4986-a3f8-eeff2cef8ea9 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:06.623963 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-f42d5162-e4ea-4986-a3f8-eeff2cef8ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:06.637772 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60c915-f1ca-421b-afd2-efc412cb3935 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:06.642446 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b5a51-7c13-42d5-a3f4-e0e1cbf25a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:06.643102 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b5a51-7c13-42d5-a3f4-e0e1cbf25a75 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:06.643445 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b5a51-7c13-42d5-a3f4-e0e1cbf25a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:06.643719 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b5a51-7c13-42d5-a3f4-e0e1cbf25a75 admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:06.644627 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b5a51-7c13-42d5-a3f4-e0e1cbf25a75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:06.647264 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b5a51-7c13-42d5-a3f4-e0e1cbf25a75 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:06.681422 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d5162-e4ea-4986-a3f8-eeff2cef8ea9 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:06.685084 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff017f-0c1f-41a9-bd2b-d59ed6473dc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:06.685733 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff017f-0c1f-41a9-bd2b-d59ed6473dc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:06.686017 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff017f-0c1f-41a9-bd2b-d59ed6473dc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:06.686960 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff017f-0c1f-41a9-bd2b-d59ed6473dc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:06.695849 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ff017f-0c1f-41a9-bd2b-d59ed6473dc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:06.697318 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ff017f-0c1f-41a9-bd2b-d59ed6473dc9 service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:06.706775 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1067/2132] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:24:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 13:24:06.707558 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff017f-0c1f-41a9-bd2b-d59ed6473dc9 service neutron] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:06.709382 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-d6ff017f-0c1f-41a9-bd2b-d59ed6473dc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:06.721431 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff017f-0c1f-41a9-bd2b-d59ed6473dc9 service neutron] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:06.726695 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f463e-4546-4cba-8454-b55ea0237b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:06.727548 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f463e-4546-4cba-8454-b55ea0237b14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:06.727824 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f463e-4546-4cba-8454-b55ea0237b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:06.728100 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f463e-4546-4cba-8454-b55ea0237b14 admin admin] PATH_INFO: `/v3/users/7f14c01cb61348e59856b30b14ef2dba` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:06.729293 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f463e-4546-4cba-8454-b55ea0237b14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f14c01cb61348e59856b30b14ef2dba)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:06.731196 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f463e-4546-4cba-8454-b55ea0237b14 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:06.768717 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1066/2133] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:24:06 2022] POST /identity/v3/projects => generated 377 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:24:06.773367 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b5a51-7c13-42d5-a3f4-e0e1cbf25a75 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:06.791333 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:06.837379 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b5a51-7c13-42d5-a3f4-e0e1cbf25a75 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:06.842402 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342446f5-a437-4a02-94f7-f4e519cd0dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:06.843074 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342446f5-a437-4a02-94f7-f4e519cd0dad admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:06.843359 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342446f5-a437-4a02-94f7-f4e519cd0dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:06.843660 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342446f5-a437-4a02-94f7-f4e519cd0dad admin admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:06.844366 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342446f5-a437-4a02-94f7-f4e519cd0dad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:06.846347 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342446f5-a437-4a02-94f7-f4e519cd0dad admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:06.859222 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:06.932363 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-3f1f463e-4546-4cba-8454-b55ea0237b14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f14c01cb61348e59856b30b14ef2dba'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:06.944315 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-3f1f463e-4546-4cba-8454-b55ea0237b14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f14c01cb61348e59856b30b14ef2dba'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:06.945005 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-3f1f463e-4546-4cba-8454-b55ea0237b14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f14c01cb61348e59856b30b14ef2dba'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:06.951569 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-3f1f463e-4546-4cba-8454-b55ea0237b14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f14c01cb61348e59856b30b14ef2dba'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:06.952248 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-3f1f463e-4546-4cba-8454-b55ea0237b14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f14c01cb61348e59856b30b14ef2dba'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:06.960434 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1067/2134] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:24:06 2022] POST /identity/v3/users => generated 289 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:24:06.964543 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342446f5-a437-4a02-94f7-f4e519cd0dad admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:06.966421 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-342446f5-a437-4a02-94f7-f4e519cd0dad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:06.979835 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342446f5-a437-4a02-94f7-f4e519cd0dad admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:06.984516 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d9833d-56b6-4d85-b837-22a6f4cf8455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:06.985155 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9833d-56b6-4d85-b837-22a6f4cf8455 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:06.985441 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9833d-56b6-4d85-b837-22a6f4cf8455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:06.985746 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9833d-56b6-4d85-b837-22a6f4cf8455 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:06.987195 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d9833d-56b6-4d85-b837-22a6f4cf8455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:06.991863 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d9833d-56b6-4d85-b837-22a6f4cf8455 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:06.999566 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1068/2135] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:24:07.003891 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d9833d-56b6-4d85-b837-22a6f4cf8455 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:07.016918 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d9833d-56b6-4d85-b837-22a6f4cf8455 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:07.023144 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624488c-68e6-4853-b605-30bf1fab4d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:07.023843 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624488c-68e6-4853-b605-30bf1fab4d1a admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:07.026299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624488c-68e6-4853-b605-30bf1fab4d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:07.026299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624488c-68e6-4853-b605-30bf1fab4d1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:07.026299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5624488c-68e6-4853-b605-30bf1fab4d1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:07.026823 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5624488c-68e6-4853-b605-30bf1fab4d1a admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:07.038289 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1069/2136] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:24:07.042285 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624488c-68e6-4853-b605-30bf1fab4d1a admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:07.050688 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1068/2137] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:24:06 2022] DELETE /identity/v3/users/7f14c01cb61348e59856b30b14ef2dba => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:24:07.053342 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624488c-68e6-4853-b605-30bf1fab4d1a admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:07.059096 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887393e-012a-41f9-8cb3-9506b9882a58 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:07.059620 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887393e-012a-41f9-8cb3-9506b9882a58 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:07.060423 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887393e-012a-41f9-8cb3-9506b9882a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:07.078807 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-d887393e-012a-41f9-8cb3-9506b9882a58 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:24:07.080008 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-d887393e-012a-41f9-8cb3-9506b9882a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:07.113431 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90282602-bbf5-4a50-9da9-1a4b570f2cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:07.114563 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90282602-bbf5-4a50-9da9-1a4b570f2cd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:07.114684 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90282602-bbf5-4a50-9da9-1a4b570f2cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:07.114973 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90282602-bbf5-4a50-9da9-1a4b570f2cd0 admin admin] PATH_INFO: `/v3/projects/fe7b201f7b044bf3b59e6190d6a8328b/users/2fda441de0a54b9990b30c851bcd5516/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:07.129457 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90282602-bbf5-4a50-9da9-1a4b570f2cd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe7b201f7b044bf3b59e6190d6a8328b, user_id=2fda441de0a54b9990b30c851bcd5516, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:07.132871 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90282602-bbf5-4a50-9da9-1a4b570f2cd0 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:07.141279 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1069/2138] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:24:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:24:07.151828 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887393e-012a-41f9-8cb3-9506b9882a58 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:07.153202 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-d887393e-012a-41f9-8cb3-9506b9882a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:07.210831 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887393e-012a-41f9-8cb3-9506b9882a58 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:07.216205 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1070/2139] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:24:07 2022] PUT /identity/v3/projects/fe7b201f7b044bf3b59e6190d6a8328b/users/2fda441de0a54b9990b30c851bcd5516/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:24:07.226827 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c9a62-4178-408a-8bf4-be1e81a86604 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:07.227130 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c9a62-4178-408a-8bf4-be1e81a86604 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:07.227403 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c9a62-4178-408a-8bf4-be1e81a86604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:07.265338 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc06f73-ad24-40bd-aaa0-c610b7140f2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:07.266084 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc06f73-ad24-40bd-aaa0-c610b7140f2a service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:07.266390 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc06f73-ad24-40bd-aaa0-c610b7140f2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:07.266665 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc06f73-ad24-40bd-aaa0-c610b7140f2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:07.271278 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-cd2c9a62-4178-408a-8bf4-be1e81a86604 None None] MFA Rules not processed for user `2fda441de0a54b9990b30c851bcd5516`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:24:07.272734 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-cd2c9a62-4178-408a-8bf4-be1e81a86604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:07.331020 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc06f73-ad24-40bd-aaa0-c610b7140f2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:07.332613 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc06f73-ad24-40bd-aaa0-c610b7140f2a service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:07.341213 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1071/2140] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:24:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:24:07.343608 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1070/2141] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:24:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 13:24:07.345593 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c9a62-4178-408a-8bf4-be1e81a86604 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:07.356554 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c9a62-4178-408a-8bf4-be1e81a86604 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:07.361953 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4351943-d0e9-40e5-92f0-be9438291da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:07.361953 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4351943-d0e9-40e5-92f0-be9438291da3 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:07.362303 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4351943-d0e9-40e5-92f0-be9438291da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:07.362394 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4351943-d0e9-40e5-92f0-be9438291da3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:07.363164 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4351943-d0e9-40e5-92f0-be9438291da3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:07.365817 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4351943-d0e9-40e5-92f0-be9438291da3 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:07.431989 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:07.499148 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1072/2142] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:24:07 2022] POST /identity/v3/projects => generated 377 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:24:07.500279 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc06f73-ad24-40bd-aaa0-c610b7140f2a service neutron] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:07.510408 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc06f73-ad24-40bd-aaa0-c610b7140f2a service neutron] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:07.517519 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:07.584326 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0391eb95-05e5-4466-8a1a-72892cd5ce45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:07.585044 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391eb95-05e5-4466-8a1a-72892cd5ce45 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:07.594308 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391eb95-05e5-4466-8a1a-72892cd5ce45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:07.594308 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391eb95-05e5-4466-8a1a-72892cd5ce45 admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:07.594308 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0391eb95-05e5-4466-8a1a-72892cd5ce45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:07.594308 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0391eb95-05e5-4466-8a1a-72892cd5ce45 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:07.729938 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1071/2143] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:24:07 2022] POST /identity/v3/users => generated 295 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:24:07.731563 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4351943-d0e9-40e5-92f0-be9438291da3 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:07.743148 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4351943-d0e9-40e5-92f0-be9438291da3 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:07.752298 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcd066c-3875-457e-930f-d273028741da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:07.752298 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd066c-3875-457e-930f-d273028741da admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:07.752298 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd066c-3875-457e-930f-d273028741da admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:07.752298 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd066c-3875-457e-930f-d273028741da admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:07.752691 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcd066c-3875-457e-930f-d273028741da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:07.752691 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcd066c-3875-457e-930f-d273028741da admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:07.766987 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1073/2144] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:24:07.768334 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0391eb95-05e5-4466-8a1a-72892cd5ce45 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:07.779556 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0391eb95-05e5-4466-8a1a-72892cd5ce45 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:07.784203 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad4c769-9433-42de-88b6-c58684495b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:07.785085 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4c769-9433-42de-88b6-c58684495b5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:07.785372 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4c769-9433-42de-88b6-c58684495b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:07.785653 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4c769-9433-42de-88b6-c58684495b5f admin admin] PATH_INFO: `/v3/projects/43a6dcdb8f49469aa19e0869045a7964/users/880394d24f50410c9714cbed60986c10/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:07.809840 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad4c769-9433-42de-88b6-c58684495b5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=43a6dcdb8f49469aa19e0869045a7964, user_id=880394d24f50410c9714cbed60986c10, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:07.810430 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcd066c-3875-457e-930f-d273028741da admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:07.810526 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad4c769-9433-42de-88b6-c58684495b5f admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:07.810631 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-0dcd066c-3875-457e-930f-d273028741da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:07.819022 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcd066c-3875-457e-930f-d273028741da admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:07.823634 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0a93d-7358-410c-9503-bcd378753096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:07.824563 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0a93d-7358-410c-9503-bcd378753096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:07.824832 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0a93d-7358-410c-9503-bcd378753096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:07.825104 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0a93d-7358-410c-9503-bcd378753096 admin admin] PATH_INFO: `/v3/projects/33b9f825f65d4d75a86ee03dcdc769e1` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:07.826292 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef0a93d-7358-410c-9503-bcd378753096 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33b9f825f65d4d75a86ee03dcdc769e1)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:07.828427 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef0a93d-7358-410c-9503-bcd378753096 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:07.924904 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1072/2145] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:24:07 2022] PUT /identity/v3/projects/43a6dcdb8f49469aa19e0869045a7964/users/880394d24f50410c9714cbed60986c10/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:24:07.929184 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad4c769-9433-42de-88b6-c58684495b5f admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:07.990500 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad4c769-9433-42de-88b6-c58684495b5f admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:08.000202 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-4ef0a93d-7358-410c-9503-bcd378753096 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33b9f825f65d4d75a86ee03dcdc769e1', 'request_id': 'req-4ef0a93d-7358-410c-9503-bcd378753096'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:08.003882 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-4ef0a93d-7358-410c-9503-bcd378753096 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33b9f825f65d4d75a86ee03dcdc769e1', 'request_id': 'req-4ef0a93d-7358-410c-9503-bcd378753096'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:08.010526 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-4ef0a93d-7358-410c-9503-bcd378753096 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33b9f825f65d4d75a86ee03dcdc769e1', 'request_id': 'req-4ef0a93d-7358-410c-9503-bcd378753096'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:08.051716 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83350792-fb7c-46c5-a44d-7d2911436fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:08.052485 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83350792-fb7c-46c5-a44d-7d2911436fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:08.052849 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83350792-fb7c-46c5-a44d-7d2911436fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:08.053127 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83350792-fb7c-46c5-a44d-7d2911436fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:08.053981 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83350792-fb7c-46c5-a44d-7d2911436fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:08.055629 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83350792-fb7c-46c5-a44d-7d2911436fa9 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:08.070377 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1073/2146] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:24:08.071455 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83350792-fb7c-46c5-a44d-7d2911436fa9 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:08.081548 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83350792-fb7c-46c5-a44d-7d2911436fa9 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:08.086847 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb7d3f0-b8ac-40c2-95b4-ffa877560597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:08.087719 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7d3f0-b8ac-40c2-95b4-ffa877560597 admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:08.087997 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7d3f0-b8ac-40c2-95b4-ffa877560597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:08.088308 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7d3f0-b8ac-40c2-95b4-ffa877560597 admin admin] PATH_INFO: `/v3/projects/43a6dcdb8f49469aa19e0869045a7964/users/880394d24f50410c9714cbed60986c10/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:08.090253 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb7d3f0-b8ac-40c2-95b4-ffa877560597 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43a6dcdb8f49469aa19e0869045a7964, user_id=880394d24f50410c9714cbed60986c10, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:08.092916 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb7d3f0-b8ac-40c2-95b4-ffa877560597 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:08.104522 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1074/2147] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:24:08 2022] PUT /identity/v3/projects/43a6dcdb8f49469aa19e0869045a7964/users/880394d24f50410c9714cbed60986c10/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:24:08.115595 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1596a-c9b4-44ab-a59a-4d58de87724b None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:08.121480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1596a-c9b4-44ab-a59a-4d58de87724b None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:08.121480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1596a-c9b4-44ab-a59a-4d58de87724b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:08.121674 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-4ef0a93d-7358-410c-9503-bcd378753096 admin admin] The token cache is being invalidate because project 33b9f825f65d4d75a86ee03dcdc769e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:24:08.121674 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-4ef0a93d-7358-410c-9503-bcd378753096 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:08.121674 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-4ef0a93d-7358-410c-9503-bcd378753096 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:08.122841 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1074/2148] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:24:07 2022] DELETE /identity/v3/projects/33b9f825f65d4d75a86ee03dcdc769e1 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:24:08.126725 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0a93d-7358-410c-9503-bcd378753096 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:08.128434 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-4ef0a93d-7358-410c-9503-bcd378753096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:08.142101 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0a93d-7358-410c-9503-bcd378753096 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:08.166651 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-9af1596a-c9b4-44ab-a59a-4d58de87724b None None] MFA Rules not processed for user `880394d24f50410c9714cbed60986c10`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:24:08.168508 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-9af1596a-c9b4-44ab-a59a-4d58de87724b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:08.246251 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c13f7a6-8f57-4297-8c8b-5270ab5256f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:08.247146 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13f7a6-8f57-4297-8c8b-5270ab5256f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:08.247428 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13f7a6-8f57-4297-8c8b-5270ab5256f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:08.247703 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13f7a6-8f57-4297-8c8b-5270ab5256f3 admin admin] PATH_INFO: `/v3/users/c0a46d5de20b4a83a9caf0d6f508c901` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:08.249148 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c13f7a6-8f57-4297-8c8b-5270ab5256f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0a46d5de20b4a83a9caf0d6f508c901)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:08.251187 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c13f7a6-8f57-4297-8c8b-5270ab5256f3 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:08.260354 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1075/2149] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:24:08 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:24:08.271595 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af1596a-c9b4-44ab-a59a-4d58de87724b None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:08.273303 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-9af1596a-c9b4-44ab-a59a-4d58de87724b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:08.290372 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:08.351710 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af1596a-c9b4-44ab-a59a-4d58de87724b None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:08.356636 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b543ba64-1d26-4297-a2e3-8cf0f3668e9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:08.357426 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543ba64-1d26-4297-a2e3-8cf0f3668e9b service cinder] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:08.357777 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543ba64-1d26-4297-a2e3-8cf0f3668e9b service cinder] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:08.358125 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543ba64-1d26-4297-a2e3-8cf0f3668e9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:08.360446 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-b543ba64-1d26-4297-a2e3-8cf0f3668e9b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:08.420873 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:08.449521 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b543ba64-1d26-4297-a2e3-8cf0f3668e9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:08.451264 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b543ba64-1d26-4297-a2e3-8cf0f3668e9b service cinder] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:08.461955 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1076/2150] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:24:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 13:24:08.494112 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-8c13f7a6-8f57-4297-8c8b-5270ab5256f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0a46d5de20b4a83a9caf0d6f508c901'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:08.513501 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-8c13f7a6-8f57-4297-8c8b-5270ab5256f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0a46d5de20b4a83a9caf0d6f508c901'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:08.515038 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-8c13f7a6-8f57-4297-8c8b-5270ab5256f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0a46d5de20b4a83a9caf0d6f508c901'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:08.527522 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-8c13f7a6-8f57-4297-8c8b-5270ab5256f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0a46d5de20b4a83a9caf0d6f508c901'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:08.528425 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-8c13f7a6-8f57-4297-8c8b-5270ab5256f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0a46d5de20b4a83a9caf0d6f508c901'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:08.645769 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1075/2151] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:24:08 2022] DELETE /identity/v3/users/c0a46d5de20b4a83a9caf0d6f508c901 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:24:09.246992 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b543ba64-1d26-4297-a2e3-8cf0f3668e9b service cinder] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:09.266451 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b543ba64-1d26-4297-a2e3-8cf0f3668e9b service cinder] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:09.305898 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:09.412493 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1b253-d398-4204-8cd8-772bb07001a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:09.413376 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1b253-d398-4204-8cd8-772bb07001a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:09.413660 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1b253-d398-4204-8cd8-772bb07001a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:09.413996 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1b253-d398-4204-8cd8-772bb07001a5 admin admin] PATH_INFO: `/v3/projects/acd1789eb72a4f3e9d47d69d63542cc2` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:09.415274 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca1b253-d398-4204-8cd8-772bb07001a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acd1789eb72a4f3e9d47d69d63542cc2)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:09.417287 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca1b253-d398-4204-8cd8-772bb07001a5 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:09.573864 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-1ca1b253-d398-4204-8cd8-772bb07001a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acd1789eb72a4f3e9d47d69d63542cc2', 'request_id': 'req-1ca1b253-d398-4204-8cd8-772bb07001a5'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:09.644067 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-1ca1b253-d398-4204-8cd8-772bb07001a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acd1789eb72a4f3e9d47d69d63542cc2', 'request_id': 'req-1ca1b253-d398-4204-8cd8-772bb07001a5'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:09.652063 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-1ca1b253-d398-4204-8cd8-772bb07001a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acd1789eb72a4f3e9d47d69d63542cc2', 'request_id': 'req-1ca1b253-d398-4204-8cd8-772bb07001a5'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:09.667058 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-1ca1b253-d398-4204-8cd8-772bb07001a5 admin admin] The token cache is being invalidate because project acd1789eb72a4f3e9d47d69d63542cc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:24:09.667447 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-1ca1b253-d398-4204-8cd8-772bb07001a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:09.668226 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-1ca1b253-d398-4204-8cd8-772bb07001a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:09.670143 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1077/2152] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:24:09 2022] DELETE /identity/v3/projects/acd1789eb72a4f3e9d47d69d63542cc2 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:24:09.674820 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa45931-0d7d-4419-a257-1c8cac5aa0aa None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:09.675313 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa45931-0d7d-4419-a257-1c8cac5aa0aa None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:09.675518 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa45931-0d7d-4419-a257-1c8cac5aa0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:09.718074 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-9aa45931-0d7d-4419-a257-1c8cac5aa0aa None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:24:09.719445 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-9aa45931-0d7d-4419-a257-1c8cac5aa0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:09.800372 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1076/2153] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:24:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:24:09.820959 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563acb4-796c-4d88-9d43-f0a35c4d2062 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:09.820959 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563acb4-796c-4d88-9d43-f0a35c4d2062 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:09.820959 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563acb4-796c-4d88-9d43-f0a35c4d2062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:09.843515 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-5563acb4-796c-4d88-9d43-f0a35c4d2062 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:24:09.845165 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-5563acb4-796c-4d88-9d43-f0a35c4d2062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:09.860374 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1078/2154] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:24:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:24:09.861829 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa45931-0d7d-4419-a257-1c8cac5aa0aa None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:09.870703 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:09.874676 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa45931-0d7d-4419-a257-1c8cac5aa0aa None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:09.882302 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe77b40-e2d3-41b2-a2e0-9e559edbed9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:09.883165 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe77b40-e2d3-41b2-a2e0-9e559edbed9b admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:09.883634 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe77b40-e2d3-41b2-a2e0-9e559edbed9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:09.883910 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe77b40-e2d3-41b2-a2e0-9e559edbed9b admin admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:09.884718 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe77b40-e2d3-41b2-a2e0-9e559edbed9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:24:09.885485 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe77b40-e2d3-41b2-a2e0-9e559edbed9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:09.887399 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe77b40-e2d3-41b2-a2e0-9e559edbed9b admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:09.901132 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1077/2155] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:24:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:24:09.905792 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5563acb4-796c-4d88-9d43-f0a35c4d2062 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:09.917128 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5563acb4-796c-4d88-9d43-f0a35c4d2062 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:09.922251 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e2db1-2824-4dbe-92a5-8750ac201382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:09.923112 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e2db1-2824-4dbe-92a5-8750ac201382 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:09.923536 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e2db1-2824-4dbe-92a5-8750ac201382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:09.923917 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e2db1-2824-4dbe-92a5-8750ac201382 admin admin] PATH_INFO: `/v3/projects` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:09.924804 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e2db1-2824-4dbe-92a5-8750ac201382 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:09.928788 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e2db1-2824-4dbe-92a5-8750ac201382 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:10.013461 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1079/2156] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:24:09 2022] POST /identity/v3/projects => generated 389 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:24:10.017191 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe77b40-e2d3-41b2-a2e0-9e559edbed9b admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:10.028127 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe77b40-e2d3-41b2-a2e0-9e559edbed9b admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:10.095447 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19121d-e749-403c-b9e5-a56fe7b054cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:10.096269 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19121d-e749-403c-b9e5-a56fe7b054cc admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:10.096550 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19121d-e749-403c-b9e5-a56fe7b054cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:10.096822 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19121d-e749-403c-b9e5-a56fe7b054cc admin admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:10.097515 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c19121d-e749-403c-b9e5-a56fe7b054cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:10.100134 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c19121d-e749-403c-b9e5-a56fe7b054cc admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:10.101885 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:10.182904 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1078/2157] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:24:10 2022] POST /identity/v3/users => generated 295 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:24:10.187079 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e2db1-2824-4dbe-92a5-8750ac201382 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:10.198381 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e2db1-2824-4dbe-92a5-8750ac201382 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:10.203316 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c26d44-91eb-4783-ba92-4f9c07fd0971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:10.204295 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c26d44-91eb-4783-ba92-4f9c07fd0971 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:10.204777 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c26d44-91eb-4783-ba92-4f9c07fd0971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:10.205124 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c26d44-91eb-4783-ba92-4f9c07fd0971 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:10.205957 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c26d44-91eb-4783-ba92-4f9c07fd0971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:10.207679 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c26d44-91eb-4783-ba92-4f9c07fd0971 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:10.222949 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1080/2158] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:24:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:24:10.232309 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19121d-e749-403c-b9e5-a56fe7b054cc admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:10.260755 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19121d-e749-403c-b9e5-a56fe7b054cc admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:10.269532 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca30b3a-c852-40c0-b0cc-574519a99315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:10.272458 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca30b3a-c852-40c0-b0cc-574519a99315 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:10.272774 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca30b3a-c852-40c0-b0cc-574519a99315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:10.273062 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca30b3a-c852-40c0-b0cc-574519a99315 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:10.273824 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca30b3a-c852-40c0-b0cc-574519a99315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:10.280646 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca30b3a-c852-40c0-b0cc-574519a99315 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:10.293044 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1079/2159] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:24:10 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:24:10.296959 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c26d44-91eb-4783-ba92-4f9c07fd0971 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:10.315711 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c26d44-91eb-4783-ba92-4f9c07fd0971 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:10.323710 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be2334-dedb-4459-8221-d42eee8ef564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:10.324705 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be2334-dedb-4459-8221-d42eee8ef564 admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:10.325555 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be2334-dedb-4459-8221-d42eee8ef564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:10.325842 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be2334-dedb-4459-8221-d42eee8ef564 admin admin] PATH_INFO: `/v3/projects/c58d0c6f9b5e4402b8c5c0470cb7f64f/users/39e779a25a36465381165ae3649aa724/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:10.342998 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be2334-dedb-4459-8221-d42eee8ef564 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c58d0c6f9b5e4402b8c5c0470cb7f64f, user_id=39e779a25a36465381165ae3649aa724, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:10.345744 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be2334-dedb-4459-8221-d42eee8ef564 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:10.463785 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1081/2160] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:24:10 2022] PUT /identity/v3/projects/c58d0c6f9b5e4402b8c5c0470cb7f64f/users/39e779a25a36465381165ae3649aa724/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:24:10.475547 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a28e96-a7f5-4e1f-9eb9-504c01047046 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:10.475848 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a28e96-a7f5-4e1f-9eb9-504c01047046 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:10.476135 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a28e96-a7f5-4e1f-9eb9-504c01047046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:10.510277 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-29a28e96-a7f5-4e1f-9eb9-504c01047046 None None] MFA Rules not processed for user `39e779a25a36465381165ae3649aa724`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:24:10.510915 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-29a28e96-a7f5-4e1f-9eb9-504c01047046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:10.585173 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1080/2161] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:24:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:24:10.589722 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be2334-dedb-4459-8221-d42eee8ef564 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:10.673548 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be2334-dedb-4459-8221-d42eee8ef564 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:10.679789 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08121544-8fba-49fe-b7e4-7022fda58a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:10.680713 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08121544-8fba-49fe-b7e4-7022fda58a22 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:10.681069 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08121544-8fba-49fe-b7e4-7022fda58a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:10.681520 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08121544-8fba-49fe-b7e4-7022fda58a22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:10.682292 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08121544-8fba-49fe-b7e4-7022fda58a22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:10.686945 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08121544-8fba-49fe-b7e4-7022fda58a22 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:10.775518 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1082/2162] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:24:10 2022] POST /identity/v3/projects => generated 387 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:24:10.779665 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a28e96-a7f5-4e1f-9eb9-504c01047046 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:10.792972 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a28e96-a7f5-4e1f-9eb9-504c01047046 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:10.866576 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453315d-32b0-4c96-a5a2-e0a773f03c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:10.867274 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453315d-32b0-4c96-a5a2-e0a773f03c9a admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:10.867560 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453315d-32b0-4c96-a5a2-e0a773f03c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:10.867840 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453315d-32b0-4c96-a5a2-e0a773f03c9a admin admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:10.868853 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d453315d-32b0-4c96-a5a2-e0a773f03c9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:10.871984 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d453315d-32b0-4c96-a5a2-e0a773f03c9a admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:10.883593 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:10.968290 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1081/2163] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:24:10 2022] POST /identity/v3/users => generated 300 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:24:10.971917 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08121544-8fba-49fe-b7e4-7022fda58a22 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:10.983193 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08121544-8fba-49fe-b7e4-7022fda58a22 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:11.001448 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4d487-1fb6-49c4-abe8-7d60fac8c6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:11.004752 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4d487-1fb6-49c4-abe8-7d60fac8c6a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:11.005109 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4d487-1fb6-49c4-abe8-7d60fac8c6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:11.006568 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4d487-1fb6-49c4-abe8-7d60fac8c6a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:11.006568 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4d487-1fb6-49c4-abe8-7d60fac8c6a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:11.009834 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4d487-1fb6-49c4-abe8-7d60fac8c6a4 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:11.024515 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1083/2164] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:24:10 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:24:11.028579 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453315d-32b0-4c96-a5a2-e0a773f03c9a admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:11.043360 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453315d-32b0-4c96-a5a2-e0a773f03c9a admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:11.045919 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e45dc-8080-4a5a-a5c9-de89a4f2e617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:11.046912 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e45dc-8080-4a5a-a5c9-de89a4f2e617 admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:11.047158 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e45dc-8080-4a5a-a5c9-de89a4f2e617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:11.047367 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e45dc-8080-4a5a-a5c9-de89a4f2e617 admin admin] PATH_INFO: `/v3/projects/60c7c86a86074036b0141c260e7e7c2e/users/59ae3ab3ce20498cb63a2a6579e95481/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:11.065021 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e45dc-8080-4a5a-a5c9-de89a4f2e617 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60c7c86a86074036b0141c260e7e7c2e, user_id=59ae3ab3ce20498cb63a2a6579e95481, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:11.068355 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e45dc-8080-4a5a-a5c9-de89a4f2e617 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:11.166133 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1082/2165] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:24:11 2022] PUT /identity/v3/projects/60c7c86a86074036b0141c260e7e7c2e/users/59ae3ab3ce20498cb63a2a6579e95481/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:24:11.169855 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4d487-1fb6-49c4-abe8-7d60fac8c6a4 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:11.182264 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4d487-1fb6-49c4-abe8-7d60fac8c6a4 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:11.246339 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb93f7b-9867-4e33-bac7-940a9ec76463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:11.247249 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb93f7b-9867-4e33-bac7-940a9ec76463 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:11.247606 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb93f7b-9867-4e33-bac7-940a9ec76463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:11.247959 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb93f7b-9867-4e33-bac7-940a9ec76463 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:11.248861 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb93f7b-9867-4e33-bac7-940a9ec76463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:11.250582 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb93f7b-9867-4e33-bac7-940a9ec76463 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:11.264869 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1084/2166] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:24:11.268813 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e45dc-8080-4a5a-a5c9-de89a4f2e617 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:11.281064 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e45dc-8080-4a5a-a5c9-de89a4f2e617 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:11.288402 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99fe827-9fce-45c7-9cbd-c5551954d48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:11.289758 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fe827-9fce-45c7-9cbd-c5551954d48b admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:11.289758 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fe827-9fce-45c7-9cbd-c5551954d48b admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:11.290040 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fe827-9fce-45c7-9cbd-c5551954d48b admin admin] PATH_INFO: `/v3/projects/60c7c86a86074036b0141c260e7e7c2e/users/59ae3ab3ce20498cb63a2a6579e95481/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:11.292001 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99fe827-9fce-45c7-9cbd-c5551954d48b admin admin] RBAC: Authorizing `identity:create_grant(project_id=60c7c86a86074036b0141c260e7e7c2e, user_id=59ae3ab3ce20498cb63a2a6579e95481, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:11.294839 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99fe827-9fce-45c7-9cbd-c5551954d48b admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:11.324198 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1083/2167] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:24:11 2022] PUT /identity/v3/projects/60c7c86a86074036b0141c260e7e7c2e/users/59ae3ab3ce20498cb63a2a6579e95481/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:24:11.344665 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66181a-e654-4c79-928d-150fd4b16036 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:11.344665 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66181a-e654-4c79-928d-150fd4b16036 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:11.345154 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66181a-e654-4c79-928d-150fd4b16036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:11.372418 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:11.398422 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-8e66181a-e654-4c79-928d-150fd4b16036 None None] MFA Rules not processed for user `59ae3ab3ce20498cb63a2a6579e95481`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:24:11.403357 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-8e66181a-e654-4c79-928d-150fd4b16036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:11.541489 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1085/2168] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:24:11 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:24:11.552731 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99fe827-9fce-45c7-9cbd-c5551954d48b admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:11.566091 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-b99fe827-9fce-45c7-9cbd-c5551954d48b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:11.647274 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e66181a-e654-4c79-928d-150fd4b16036 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:11.648839 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-8e66181a-e654-4c79-928d-150fd4b16036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:11.667268 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99fe827-9fce-45c7-9cbd-c5551954d48b admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:11.673137 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01a5db-a4e2-429e-b988-f09109b54476 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:11.673878 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01a5db-a4e2-429e-b988-f09109b54476 service cinder] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:11.674169 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01a5db-a4e2-429e-b988-f09109b54476 service cinder] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:11.674452 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01a5db-a4e2-429e-b988-f09109b54476 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:11.685785 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d01a5db-a4e2-429e-b988-f09109b54476 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:11.687268 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d01a5db-a4e2-429e-b988-f09109b54476 service cinder] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:11.710863 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1084/2169] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:24:11 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:24:11.737185 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e66181a-e654-4c79-928d-150fd4b16036 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:11.741059 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb5c8d-ddd1-430f-ba8b-4850c94d0eaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:11.741788 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb5c8d-ddd1-430f-ba8b-4850c94d0eaa service cinder] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:11.742043 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb5c8d-ddd1-430f-ba8b-4850c94d0eaa service cinder] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:11.742322 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb5c8d-ddd1-430f-ba8b-4850c94d0eaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:11.749215 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-2ebb5c8d-ddd1-430f-ba8b-4850c94d0eaa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:11.882113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb5c8d-ddd1-430f-ba8b-4850c94d0eaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:11.883946 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb5c8d-ddd1-430f-ba8b-4850c94d0eaa service cinder] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:11.896385 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1086/2170] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:24:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 13:24:11.903711 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01a5db-a4e2-429e-b988-f09109b54476 service cinder] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:12.004308 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01a5db-a4e2-429e-b988-f09109b54476 service cinder] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:12.011902 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77c5ae-7a70-4286-92c1-6adf49226062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:12.012899 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77c5ae-7a70-4286-92c1-6adf49226062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:12.013290 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77c5ae-7a70-4286-92c1-6adf49226062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:12.013789 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77c5ae-7a70-4286-92c1-6adf49226062 admin admin] PATH_INFO: `/v3/users/39e779a25a36465381165ae3649aa724` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:12.015486 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b77c5ae-7a70-4286-92c1-6adf49226062 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39e779a25a36465381165ae3649aa724)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:12.018119 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b77c5ae-7a70-4286-92c1-6adf49226062 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:12.255935 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-5b77c5ae-7a70-4286-92c1-6adf49226062 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39e779a25a36465381165ae3649aa724'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:12.266518 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:INSERT=5,keystone:SELECT=87,keystone:DELETE=8 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:12.276220 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-5b77c5ae-7a70-4286-92c1-6adf49226062 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39e779a25a36465381165ae3649aa724'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:12.277176 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-5b77c5ae-7a70-4286-92c1-6adf49226062 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39e779a25a36465381165ae3649aa724'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:12.284848 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-5b77c5ae-7a70-4286-92c1-6adf49226062 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39e779a25a36465381165ae3649aa724'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:12.286730 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-5b77c5ae-7a70-4286-92c1-6adf49226062 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39e779a25a36465381165ae3649aa724'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:12.420728 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1085/2171] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:24:11 2022] DELETE /identity/v3/users/39e779a25a36465381165ae3649aa724 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:24:12.429636 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba94024-db7b-47cd-a67c-b1621fbe9a77 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:12.434567 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba94024-db7b-47cd-a67c-b1621fbe9a77 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:12.434845 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba94024-db7b-47cd-a67c-b1621fbe9a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:12.458752 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-1ba94024-db7b-47cd-a67c-b1621fbe9a77 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:24:12.460227 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-1ba94024-db7b-47cd-a67c-b1621fbe9a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:12.508556 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:12.527522 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1087/2172] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:24:12.539414 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77c5ae-7a70-4286-92c1-6adf49226062 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:12.541169 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-5b77c5ae-7a70-4286-92c1-6adf49226062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:12.615769 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77c5ae-7a70-4286-92c1-6adf49226062 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:12.620948 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64d10a-d53b-4b12-b5e7-ad173de3befe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:12.621626 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64d10a-d53b-4b12-b5e7-ad173de3befe service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:12.621974 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64d10a-d53b-4b12-b5e7-ad173de3befe service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:12.622984 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64d10a-d53b-4b12-b5e7-ad173de3befe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:12.633808 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e64d10a-d53b-4b12-b5e7-ad173de3befe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:12.635417 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e64d10a-d53b-4b12-b5e7-ad173de3befe service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:12.647449 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1086/2173] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:24:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 13:24:12.972417 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbadbdd-81c0-47d5-a2e9-8e1babbc8393 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:12.972779 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbadbdd-81c0-47d5-a2e9-8e1babbc8393 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:12.972985 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbadbdd-81c0-47d5-a2e9-8e1babbc8393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:13.024965 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-4bbadbdd-81c0-47d5-a2e9-8e1babbc8393 None None] MFA Rules not processed for user `4d0490962ec743048ef924340c93de20`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:24:13.026563 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-4bbadbdd-81c0-47d5-a2e9-8e1babbc8393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:13.119178 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1088/2174] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:24:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:24:13.123566 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64d10a-d53b-4b12-b5e7-ad173de3befe service neutron] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:13.125027 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-7e64d10a-d53b-4b12-b5e7-ad173de3befe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:13.138515 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64d10a-d53b-4b12-b5e7-ad173de3befe service neutron] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:13.143177 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf673bf0-1bf4-4370-a4d7-efdca660386e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:13.144063 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf673bf0-1bf4-4370-a4d7-efdca660386e admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:13.144396 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf673bf0-1bf4-4370-a4d7-efdca660386e admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:13.144699 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf673bf0-1bf4-4370-a4d7-efdca660386e admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:13.145423 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf673bf0-1bf4-4370-a4d7-efdca660386e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:13.147362 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf673bf0-1bf4-4370-a4d7-efdca660386e admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:13.211548 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbadbdd-81c0-47d5-a2e9-8e1babbc8393 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:13.213021 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-4bbadbdd-81c0-47d5-a2e9-8e1babbc8393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:13.230811 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbadbdd-81c0-47d5-a2e9-8e1babbc8393 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:13.235518 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb3d62-d8dc-456b-83aa-3dc4eab7b143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:13.238574 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb3d62-d8dc-456b-83aa-3dc4eab7b143 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:13.238574 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb3d62-d8dc-456b-83aa-3dc4eab7b143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:13.238574 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb3d62-d8dc-456b-83aa-3dc4eab7b143 admin admin] PATH_INFO: `/v3/projects/c58d0c6f9b5e4402b8c5c0470cb7f64f` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:13.243159 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1087/2175] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:24:13 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:24:13.244037 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf673bf0-1bf4-4370-a4d7-efdca660386e admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:13.247107 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bb3d62-d8dc-456b-83aa-3dc4eab7b143 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c58d0c6f9b5e4402b8c5c0470cb7f64f)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:13.249118 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bb3d62-d8dc-456b-83aa-3dc4eab7b143 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:13.321333 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf673bf0-1bf4-4370-a4d7-efdca660386e admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:13.325988 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574d9e2-ac43-4da8-a81e-e0ef96597c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:13.326653 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574d9e2-ac43-4da8-a81e-e0ef96597c98 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:13.326936 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574d9e2-ac43-4da8-a81e-e0ef96597c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:13.327216 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574d9e2-ac43-4da8-a81e-e0ef96597c98 admin admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:13.327902 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7574d9e2-ac43-4da8-a81e-e0ef96597c98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:13.329878 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7574d9e2-ac43-4da8-a81e-e0ef96597c98 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:13.365361 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-30bb3d62-d8dc-456b-83aa-3dc4eab7b143 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c58d0c6f9b5e4402b8c5c0470cb7f64f', 'request_id': 'req-30bb3d62-d8dc-456b-83aa-3dc4eab7b143'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:13.436530 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1088/2176] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:24:13 2022] POST /identity/v3/users => generated 299 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:24:13.440489 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574d9e2-ac43-4da8-a81e-e0ef96597c98 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:13.451037 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574d9e2-ac43-4da8-a81e-e0ef96597c98 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:13.460105 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-30bb3d62-d8dc-456b-83aa-3dc4eab7b143 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c58d0c6f9b5e4402b8c5c0470cb7f64f', 'request_id': 'req-30bb3d62-d8dc-456b-83aa-3dc4eab7b143'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:13.475933 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-30bb3d62-d8dc-456b-83aa-3dc4eab7b143 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c58d0c6f9b5e4402b8c5c0470cb7f64f', 'request_id': 'req-30bb3d62-d8dc-456b-83aa-3dc4eab7b143'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:13.524506 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-30bb3d62-d8dc-456b-83aa-3dc4eab7b143 admin admin] The token cache is being invalidate because project c58d0c6f9b5e4402b8c5c0470cb7f64f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:24:13.524731 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-30bb3d62-d8dc-456b-83aa-3dc4eab7b143 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:13.532649 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-30bb3d62-d8dc-456b-83aa-3dc4eab7b143 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:13.545526 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1089/2177] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:24:13 2022] DELETE /identity/v3/projects/c58d0c6f9b5e4402b8c5c0470cb7f64f => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:24:13.545526 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb3d62-d8dc-456b-83aa-3dc4eab7b143 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:13.545526 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-30bb3d62-d8dc-456b-83aa-3dc4eab7b143 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:13.572999 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:13.610475 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7128f28-354a-4126-a921-7511d6a9d3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:13.611135 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7128f28-354a-4126-a921-7511d6a9d3fc admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:13.611420 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7128f28-354a-4126-a921-7511d6a9d3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:13.611693 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7128f28-354a-4126-a921-7511d6a9d3fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:13.612445 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7128f28-354a-4126-a921-7511d6a9d3fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:13.614295 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7128f28-354a-4126-a921-7511d6a9d3fc admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:13.636306 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1089/2178] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:24:13.638732 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7128f28-354a-4126-a921-7511d6a9d3fc admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:13.646995 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-b7128f28-354a-4126-a921-7511d6a9d3fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:13.647697 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb3d62-d8dc-456b-83aa-3dc4eab7b143 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:13.654827 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850f1e7-504a-408f-ac96-ce2856c2f490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:13.655791 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850f1e7-504a-408f-ac96-ce2856c2f490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:13.656172 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850f1e7-504a-408f-ac96-ce2856c2f490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:13.656506 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850f1e7-504a-408f-ac96-ce2856c2f490 admin admin] PATH_INFO: `/v3/users/59ae3ab3ce20498cb63a2a6579e95481` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:13.657741 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c850f1e7-504a-408f-ac96-ce2856c2f490 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59ae3ab3ce20498cb63a2a6579e95481)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:13.659784 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c850f1e7-504a-408f-ac96-ce2856c2f490 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:13.666643 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:13.679576 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7128f28-354a-4126-a921-7511d6a9d3fc admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:13.686582 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1691e3-42f6-4ed2-89dc-0d37e69cede1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:13.687588 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1691e3-42f6-4ed2-89dc-0d37e69cede1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:13.688076 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1691e3-42f6-4ed2-89dc-0d37e69cede1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:13.688470 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1691e3-42f6-4ed2-89dc-0d37e69cede1 admin admin] PATH_INFO: `/v3/projects/496b687b3f7e461a950f846ecf322b90/users/d43f464cc3ef44f6ba9fb34388ebb2cc/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:13.707431 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1691e3-42f6-4ed2-89dc-0d37e69cede1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=496b687b3f7e461a950f846ecf322b90, user_id=d43f464cc3ef44f6ba9fb34388ebb2cc, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:13.711473 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1691e3-42f6-4ed2-89dc-0d37e69cede1 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:13.791286 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1090/2179] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:24:13 2022] PUT /identity/v3/projects/496b687b3f7e461a950f846ecf322b90/users/d43f464cc3ef44f6ba9fb34388ebb2cc/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:24:13.792335 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1691e3-42f6-4ed2-89dc-0d37e69cede1 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:13.794003 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-bc1691e3-42f6-4ed2-89dc-0d37e69cede1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:13.852868 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1691e3-42f6-4ed2-89dc-0d37e69cede1 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:13.856846 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c43fc2-c37c-46d1-a5a1-c09d8043f2dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:13.857501 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c43fc2-c37c-46d1-a5a1-c09d8043f2dd service cinder] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:13.857793 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c43fc2-c37c-46d1-a5a1-c09d8043f2dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:13.858070 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c43fc2-c37c-46d1-a5a1-c09d8043f2dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:13.859924 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-18c43fc2-c37c-46d1-a5a1-c09d8043f2dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:13.892446 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-c850f1e7-504a-408f-ac96-ce2856c2f490 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59ae3ab3ce20498cb63a2a6579e95481'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:13.911069 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-c850f1e7-504a-408f-ac96-ce2856c2f490 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59ae3ab3ce20498cb63a2a6579e95481'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:13.912505 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-c850f1e7-504a-408f-ac96-ce2856c2f490 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59ae3ab3ce20498cb63a2a6579e95481'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:13.920304 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-c850f1e7-504a-408f-ac96-ce2856c2f490 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59ae3ab3ce20498cb63a2a6579e95481'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:13.920843 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-c850f1e7-504a-408f-ac96-ce2856c2f490 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59ae3ab3ce20498cb63a2a6579e95481'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:13.937276 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c43fc2-c37c-46d1-a5a1-c09d8043f2dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:13.937276 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c43fc2-c37c-46d1-a5a1-c09d8043f2dd service cinder] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:13.947742 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1091/2180] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:24:13 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:24:13.949007 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c43fc2-c37c-46d1-a5a1-c09d8043f2dd service cinder] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:13.992013 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1090/2181] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:24:13 2022] DELETE /identity/v3/users/59ae3ab3ce20498cb63a2a6579e95481 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:24:14.022825 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c43fc2-c37c-46d1-a5a1-c09d8043f2dd service cinder] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:14.088172 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80caa953-ae08-4e82-8423-2367f34a020e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:14.088938 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80caa953-ae08-4e82-8423-2367f34a020e admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:14.091141 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80caa953-ae08-4e82-8423-2367f34a020e admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:14.091141 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80caa953-ae08-4e82-8423-2367f34a020e admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:14.091141 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80caa953-ae08-4e82-8423-2367f34a020e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:14.091877 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80caa953-ae08-4e82-8423-2367f34a020e admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:14.103491 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1092/2182] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:24:14.108011 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850f1e7-504a-408f-ac96-ce2856c2f490 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:14.109873 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-c850f1e7-504a-408f-ac96-ce2856c2f490 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:14.123787 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850f1e7-504a-408f-ac96-ce2856c2f490 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:14.128399 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c20d177-892d-435f-9f1d-42261c754877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:14.129283 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c20d177-892d-435f-9f1d-42261c754877 admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:14.129597 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c20d177-892d-435f-9f1d-42261c754877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:14.129868 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c20d177-892d-435f-9f1d-42261c754877 admin admin] PATH_INFO: `/v3/projects/496b687b3f7e461a950f846ecf322b90/users/d43f464cc3ef44f6ba9fb34388ebb2cc/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:14.131828 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c20d177-892d-435f-9f1d-42261c754877 admin admin] RBAC: Authorizing `identity:create_grant(project_id=496b687b3f7e461a950f846ecf322b90, user_id=d43f464cc3ef44f6ba9fb34388ebb2cc, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:14.134482 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c20d177-892d-435f-9f1d-42261c754877 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:14.139202 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:14.144971 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1091/2183] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:24:14 2022] PUT /identity/v3/projects/496b687b3f7e461a950f846ecf322b90/users/d43f464cc3ef44f6ba9fb34388ebb2cc/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:24:14.517704 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80caa953-ae08-4e82-8423-2367f34a020e admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:14.519878 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-80caa953-ae08-4e82-8423-2367f34a020e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:14.534045 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80caa953-ae08-4e82-8423-2367f34a020e admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:14.610257 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c20353-1d5d-484b-b33b-555b17730116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:14.614043 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c20353-1d5d-484b-b33b-555b17730116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:14.614043 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c20353-1d5d-484b-b33b-555b17730116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:14.614043 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c20353-1d5d-484b-b33b-555b17730116 admin admin] PATH_INFO: `/v3/projects/60c7c86a86074036b0141c260e7e7c2e` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:14.614043 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c20353-1d5d-484b-b33b-555b17730116 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60c7c86a86074036b0141c260e7e7c2e)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:14.615197 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c20353-1d5d-484b-b33b-555b17730116 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:14.733515 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-54c20353-1d5d-484b-b33b-555b17730116 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60c7c86a86074036b0141c260e7e7c2e', 'request_id': 'req-54c20353-1d5d-484b-b33b-555b17730116'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:14.740787 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-54c20353-1d5d-484b-b33b-555b17730116 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60c7c86a86074036b0141c260e7e7c2e', 'request_id': 'req-54c20353-1d5d-484b-b33b-555b17730116'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:14.747617 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-54c20353-1d5d-484b-b33b-555b17730116 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60c7c86a86074036b0141c260e7e7c2e', 'request_id': 'req-54c20353-1d5d-484b-b33b-555b17730116'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:14.838784 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-54c20353-1d5d-484b-b33b-555b17730116 admin admin] The token cache is being invalidate because project 60c7c86a86074036b0141c260e7e7c2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:24:14.839059 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-54c20353-1d5d-484b-b33b-555b17730116 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:14.839702 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-54c20353-1d5d-484b-b33b-555b17730116 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:14.841284 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1093/2184] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:24:14 2022] DELETE /identity/v3/projects/60c7c86a86074036b0141c260e7e7c2e => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:24:14.846526 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8b9ae-6fa5-4ceb-a19e-3641af9047e0 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:14.847057 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8b9ae-6fa5-4ceb-a19e-3641af9047e0 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:14.847148 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8b9ae-6fa5-4ceb-a19e-3641af9047e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:14.867035 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-baf8b9ae-6fa5-4ceb-a19e-3641af9047e0 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:24:14.877704 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-baf8b9ae-6fa5-4ceb-a19e-3641af9047e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:14.931533 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1092/2185] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:24:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:24:14.939304 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49b818-d953-4185-869d-88cf5f988cb8 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:14.939597 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49b818-d953-4185-869d-88cf5f988cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:14.939878 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49b818-d953-4185-869d-88cf5f988cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:14.959029 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-3d49b818-d953-4185-869d-88cf5f988cb8 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:24:14.960291 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-3d49b818-d953-4185-869d-88cf5f988cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:14.968328 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1094/2186] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:24:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:24:14.972658 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8b9ae-6fa5-4ceb-a19e-3641af9047e0 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:14.982653 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8b9ae-6fa5-4ceb-a19e-3641af9047e0 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:14.987360 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51159865-b805-4da6-87f8-996e7d318b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:14.988278 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51159865-b805-4da6-87f8-996e7d318b40 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:14.988564 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51159865-b805-4da6-87f8-996e7d318b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:14.989335 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51159865-b805-4da6-87f8-996e7d318b40 admin admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:14.990393 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51159865-b805-4da6-87f8-996e7d318b40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:24:14.990702 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51159865-b805-4da6-87f8-996e7d318b40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:14.992329 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51159865-b805-4da6-87f8-996e7d318b40 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:15.009067 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1093/2187] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:24:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:24:15.015998 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49b818-d953-4185-869d-88cf5f988cb8 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:15.028594 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49b818-d953-4185-869d-88cf5f988cb8 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:15.033327 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ce4da-bc61-4eee-baaa-7787d34b087c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:15.033988 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ce4da-bc61-4eee-baaa-7787d34b087c admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:15.034276 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ce4da-bc61-4eee-baaa-7787d34b087c admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:15.034683 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ce4da-bc61-4eee-baaa-7787d34b087c admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:15.035409 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ce4da-bc61-4eee-baaa-7787d34b087c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:15.037724 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ce4da-bc61-4eee-baaa-7787d34b087c admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:15.163376 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1095/2188] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:24:15 2022] POST /identity/v3/projects => generated 367 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:24:15.164653 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51159865-b805-4da6-87f8-996e7d318b40 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:15.178653 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51159865-b805-4da6-87f8-996e7d318b40 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:15.245797 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:15.257968 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8349ea0-c983-46e0-bb0d-7017dbeda46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:15.258346 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8349ea0-c983-46e0-bb0d-7017dbeda46d admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:15.258633 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8349ea0-c983-46e0-bb0d-7017dbeda46d admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:15.259088 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8349ea0-c983-46e0-bb0d-7017dbeda46d admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:15.259792 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8349ea0-c983-46e0-bb0d-7017dbeda46d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:15.261972 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8349ea0-c983-46e0-bb0d-7017dbeda46d admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:15.368282 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1094/2189] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:24:15 2022] POST /identity/v3/users => generated 284 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:24:15.371534 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ce4da-bc61-4eee-baaa-7787d34b087c admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:15.389480 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ce4da-bc61-4eee-baaa-7787d34b087c admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:15.403623 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf7715-95ca-4098-97fe-0ac78ddb82c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:15.404505 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf7715-95ca-4098-97fe-0ac78ddb82c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:15.404843 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf7715-95ca-4098-97fe-0ac78ddb82c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:15.405124 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf7715-95ca-4098-97fe-0ac78ddb82c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:15.405857 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cf7715-95ca-4098-97fe-0ac78ddb82c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:15.407896 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cf7715-95ca-4098-97fe-0ac78ddb82c4 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:15.415534 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:15.421248 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1096/2190] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:24:15.425643 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8349ea0-c983-46e0-bb0d-7017dbeda46d admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:15.437209 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8349ea0-c983-46e0-bb0d-7017dbeda46d admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:15.444239 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007539a-54f1-49da-a235-bb2904b8fe0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:15.444239 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007539a-54f1-49da-a235-bb2904b8fe0f admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:15.444519 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007539a-54f1-49da-a235-bb2904b8fe0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:15.444793 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007539a-54f1-49da-a235-bb2904b8fe0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:15.445515 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0007539a-54f1-49da-a235-bb2904b8fe0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:15.447103 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0007539a-54f1-49da-a235-bb2904b8fe0f admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:15.458694 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1095/2191] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:24:15.464933 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf7715-95ca-4098-97fe-0ac78ddb82c4 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:15.480980 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf7715-95ca-4098-97fe-0ac78ddb82c4 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:15.486110 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bbb554-a9f6-402f-8949-a85a67cbdcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:15.487144 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bbb554-a9f6-402f-8949-a85a67cbdcf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:15.487525 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bbb554-a9f6-402f-8949-a85a67cbdcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:15.487874 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bbb554-a9f6-402f-8949-a85a67cbdcf2 admin admin] PATH_INFO: `/v3/projects/24ad2c4d8fe7437284627d37ce4f0fb3/users/2884ac72ac8d4b47b83f94a93b9c09fc/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:15.506268 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bbb554-a9f6-402f-8949-a85a67cbdcf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24ad2c4d8fe7437284627d37ce4f0fb3, user_id=2884ac72ac8d4b47b83f94a93b9c09fc, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:15.509149 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bbb554-a9f6-402f-8949-a85a67cbdcf2 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:15.604457 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1097/2192] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:24:15 2022] PUT /identity/v3/projects/24ad2c4d8fe7437284627d37ce4f0fb3/users/2884ac72ac8d4b47b83f94a93b9c09fc/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:24:15.604560 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c16e80-3e86-42d0-be54-89644d6c9b99 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:15.604560 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c16e80-3e86-42d0-be54-89644d6c9b99 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:15.604560 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c16e80-3e86-42d0-be54-89644d6c9b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:15.639056 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-c8c16e80-3e86-42d0-be54-89644d6c9b99 None None] MFA Rules not processed for user `2884ac72ac8d4b47b83f94a93b9c09fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:24:15.640604 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-c8c16e80-3e86-42d0-be54-89644d6c9b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:15.748735 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1096/2193] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:24:15 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:24:15.762189 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bbb554-a9f6-402f-8949-a85a67cbdcf2 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:15.763888 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-88bbb554-a9f6-402f-8949-a85a67cbdcf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:15.845099 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bbb554-a9f6-402f-8949-a85a67cbdcf2 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:15.849850 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd53f27f-3629-407c-96e0-e521b9410f6a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60eeb0b3e37a4604ab8f8b73c2b021f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:15.850685 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53f27f-3629-407c-96e0-e521b9410f6a service glance] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:15.851122 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53f27f-3629-407c-96e0-e521b9410f6a service glance] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:15.851405 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53f27f-3629-407c-96e0-e521b9410f6a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:15.861440 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd53f27f-3629-407c-96e0-e521b9410f6a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:15.862717 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd53f27f-3629-407c-96e0-e521b9410f6a service glance] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:15.873617 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1098/2194] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:24:15 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:24:19.862719 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522a58c-f321-49b4-85ef-e3686ef529d2 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:19.863224 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522a58c-f321-49b4-85ef-e3686ef529d2 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:19.863385 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522a58c-f321-49b4-85ef-e3686ef529d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:19.885190 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-2522a58c-f321-49b4-85ef-e3686ef529d2 None None] MFA Rules not processed for user `308bdbe63af5415d8e817bd9ba2fad3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:24:19.886414 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-2522a58c-f321-49b4-85ef-e3686ef529d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:19.969389 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1097/2195] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:24:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:24:20.200527 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd53f27f-3629-407c-96e0-e521b9410f6a service glance] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:20.203012 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-cd53f27f-3629-407c-96e0-e521b9410f6a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:20.297772 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd53f27f-3629-407c-96e0-e521b9410f6a service glance] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:20.303153 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e5fd2-9f10-4663-9925-46836ebe06a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:20.304103 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e5fd2-9f10-4663-9925-46836ebe06a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:20.304342 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e5fd2-9f10-4663-9925-46836ebe06a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:20.304620 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e5fd2-9f10-4663-9925-46836ebe06a0 admin admin] PATH_INFO: `/v3/users/4be47589351a489c8bd0c2ede4ccc235` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:20.305846 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e5fd2-9f10-4663-9925-46836ebe06a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4be47589351a489c8bd0c2ede4ccc235)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:20.307813 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e5fd2-9f10-4663-9925-46836ebe06a0 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:20.503134 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-9a6e5fd2-9f10-4663-9925-46836ebe06a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4be47589351a489c8bd0c2ede4ccc235'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:20.526095 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-9a6e5fd2-9f10-4663-9925-46836ebe06a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4be47589351a489c8bd0c2ede4ccc235'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:20.526912 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-9a6e5fd2-9f10-4663-9925-46836ebe06a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4be47589351a489c8bd0c2ede4ccc235'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:20.546988 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-9a6e5fd2-9f10-4663-9925-46836ebe06a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4be47589351a489c8bd0c2ede4ccc235'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:20.550132 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-9a6e5fd2-9f10-4663-9925-46836ebe06a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4be47589351a489c8bd0c2ede4ccc235'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:20.659607 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:20.666172 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1099/2196] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:24:20 2022] DELETE /identity/v3/users/4be47589351a489c8bd0c2ede4ccc235 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:24:20.671566 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d04921-e9a3-4a4a-9db9-ce6209758ea1 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:20.676279 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d04921-e9a3-4a4a-9db9-ce6209758ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:20.676279 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d04921-e9a3-4a4a-9db9-ce6209758ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:20.706827 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-c6d04921-e9a3-4a4a-9db9-ce6209758ea1 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:24:20.708882 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-c6d04921-e9a3-4a4a-9db9-ce6209758ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:20.814408 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1098/2197] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:24:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:24:20.825057 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e5fd2-9f10-4663-9925-46836ebe06a0 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:20.827041 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-9a6e5fd2-9f10-4663-9925-46836ebe06a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:20.883547 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd66f3-ec3e-448b-8934-b129e9e5d7b2 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:20.884493 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd66f3-ec3e-448b-8934-b129e9e5d7b2 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:20.885075 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd66f3-ec3e-448b-8934-b129e9e5d7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:20.919939 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:20.921875 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e5fd2-9f10-4663-9925-46836ebe06a0 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:20.926676 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17704393-d351-428a-b302-9e126af9157c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:20.927400 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17704393-d351-428a-b302-9e126af9157c service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:20.927729 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17704393-d351-428a-b302-9e126af9157c service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:20.928079 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17704393-d351-428a-b302-9e126af9157c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:20.930671 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-8cbd66f3-ec3e-448b-8934-b129e9e5d7b2 None None] MFA Rules not processed for user `d43f464cc3ef44f6ba9fb34388ebb2cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:24:20.932388 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-8cbd66f3-ec3e-448b-8934-b129e9e5d7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:20.941000 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17704393-d351-428a-b302-9e126af9157c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:20.944588 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17704393-d351-428a-b302-9e126af9157c service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:20.953187 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1100/2198] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:24:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:24:21.056228 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1099/2199] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:24:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:24:21.069137 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17704393-d351-428a-b302-9e126af9157c service neutron] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:21.071096 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-17704393-d351-428a-b302-9e126af9157c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:21.184869 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17704393-d351-428a-b302-9e126af9157c service neutron] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:21.192856 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e52ee7-031d-4c9d-947b-49042ba89cbb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60eeb0b3e37a4604ab8f8b73c2b021f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:21.192856 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e52ee7-031d-4c9d-947b-49042ba89cbb service glance] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:21.192856 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e52ee7-031d-4c9d-947b-49042ba89cbb service glance] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:21.192856 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e52ee7-031d-4c9d-947b-49042ba89cbb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:21.196955 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-60e52ee7-031d-4c9d-947b-49042ba89cbb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:21.275353 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e52ee7-031d-4c9d-947b-49042ba89cbb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:21.277343 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e52ee7-031d-4c9d-947b-49042ba89cbb service glance] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:21.288513 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1101/2200] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:24:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:24:21.511382 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd66f3-ec3e-448b-8934-b129e9e5d7b2 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:21.513049 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-8cbd66f3-ec3e-448b-8934-b129e9e5d7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:21.537737 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd66f3-ec3e-448b-8934-b129e9e5d7b2 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:21.543245 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1eee91-c854-455c-83be-4b1c9b20f93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:21.544258 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1eee91-c854-455c-83be-4b1c9b20f93c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:21.544570 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1eee91-c854-455c-83be-4b1c9b20f93c admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:21.544892 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1eee91-c854-455c-83be-4b1c9b20f93c admin admin] PATH_INFO: `/v3/projects/b9f5846d73bc465ba3009a1600e6ca95` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:21.546067 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1eee91-c854-455c-83be-4b1c9b20f93c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9f5846d73bc465ba3009a1600e6ca95)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:21.548079 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1eee91-c854-455c-83be-4b1c9b20f93c admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:21.643839 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28070f-0283-4034-8fe9-0f3cf3fae7d6 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:21.643839 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28070f-0283-4034-8fe9-0f3cf3fae7d6 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:21.643839 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28070f-0283-4034-8fe9-0f3cf3fae7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:21.671842 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-8b28070f-0283-4034-8fe9-0f3cf3fae7d6 None None] MFA Rules not processed for user `06c55d0ea52f40ae9125d2efe1d159a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:24:21.673188 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-8b28070f-0283-4034-8fe9-0f3cf3fae7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:21.685839 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-ec1eee91-c854-455c-83be-4b1c9b20f93c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9f5846d73bc465ba3009a1600e6ca95', 'request_id': 'req-ec1eee91-c854-455c-83be-4b1c9b20f93c'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:21.747236 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1102/2201] 10.222.0.61 () {58 vars in 1009 bytes} [Fri Jun 3 13:24:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:24:21.769783 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-ec1eee91-c854-455c-83be-4b1c9b20f93c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9f5846d73bc465ba3009a1600e6ca95', 'request_id': 'req-ec1eee91-c854-455c-83be-4b1c9b20f93c'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:21.778257 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-ec1eee91-c854-455c-83be-4b1c9b20f93c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9f5846d73bc465ba3009a1600e6ca95', 'request_id': 'req-ec1eee91-c854-455c-83be-4b1c9b20f93c'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:21.792047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-ec1eee91-c854-455c-83be-4b1c9b20f93c admin admin] The token cache is being invalidate because project b9f5846d73bc465ba3009a1600e6ca95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:24:21.792366 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-ec1eee91-c854-455c-83be-4b1c9b20f93c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:21.793019 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-ec1eee91-c854-455c-83be-4b1c9b20f93c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:21.796336 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1100/2202] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:24:21 2022] DELETE /identity/v3/projects/b9f5846d73bc465ba3009a1600e6ca95 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:24:21.796488 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b28070f-0283-4034-8fe9-0f3cf3fae7d6 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:21.797443 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-8b28070f-0283-4034-8fe9-0f3cf3fae7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:21.799923 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1eee91-c854-455c-83be-4b1c9b20f93c admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:21.802454 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-ec1eee91-c854-455c-83be-4b1c9b20f93c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:21.885303 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1eee91-c854-455c-83be-4b1c9b20f93c admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:21.890791 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03908754-dd5b-470b-a81d-22d54a19015b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:21.891744 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03908754-dd5b-470b-a81d-22d54a19015b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:21.892292 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03908754-dd5b-470b-a81d-22d54a19015b admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:21.892802 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03908754-dd5b-470b-a81d-22d54a19015b admin admin] PATH_INFO: `/v3/users/2fda441de0a54b9990b30c851bcd5516` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:21.894292 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03908754-dd5b-470b-a81d-22d54a19015b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fda441de0a54b9990b30c851bcd5516)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:21.897780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03908754-dd5b-470b-a81d-22d54a19015b admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:21.919405 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b28070f-0283-4034-8fe9-0f3cf3fae7d6 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:21.925202 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303fb6bd-dd6b-42ab-9ee4-ad45b5f50ec5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07ad3dd7477497ea25c2a01bff35712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:21.925993 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303fb6bd-dd6b-42ab-9ee4-ad45b5f50ec5 service swift] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:21.926544 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303fb6bd-dd6b-42ab-9ee4-ad45b5f50ec5 service swift] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:21.926747 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303fb6bd-dd6b-42ab-9ee4-ad45b5f50ec5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:21.929048 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-303fb6bd-dd6b-42ab-9ee4-ad45b5f50ec5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:21.944430 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303fb6bd-dd6b-42ab-9ee4-ad45b5f50ec5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:21.946131 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303fb6bd-dd6b-42ab-9ee4-ad45b5f50ec5 service swift] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:21.955068 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1103/2203] 10.222.0.61 () {60 vars in 1384 bytes} [Fri Jun 3 13:24:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 13:24:22.189187 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:22.207369 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-03908754-dd5b-470b-a81d-22d54a19015b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fda441de0a54b9990b30c851bcd5516'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:22.233664 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-03908754-dd5b-470b-a81d-22d54a19015b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fda441de0a54b9990b30c851bcd5516'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:22.235213 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-03908754-dd5b-470b-a81d-22d54a19015b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fda441de0a54b9990b30c851bcd5516'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:22.243736 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-03908754-dd5b-470b-a81d-22d54a19015b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fda441de0a54b9990b30c851bcd5516'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:22.244734 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-03908754-dd5b-470b-a81d-22d54a19015b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fda441de0a54b9990b30c851bcd5516'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:22.328975 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1101/2204] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:24:21 2022] DELETE /identity/v3/users/2fda441de0a54b9990b30c851bcd5516 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:24:22.944817 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:23.141653 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303fb6bd-dd6b-42ab-9ee4-ad45b5f50ec5 service swift] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:23.155424 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303fb6bd-dd6b-42ab-9ee4-ad45b5f50ec5 service swift] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:23.301674 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e3b71-4576-432d-ac86-01bce3ec53be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:23.307415 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e3b71-4576-432d-ac86-01bce3ec53be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:23.307739 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e3b71-4576-432d-ac86-01bce3ec53be admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:23.310832 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e3b71-4576-432d-ac86-01bce3ec53be admin admin] PATH_INFO: `/v3/projects/fe7b201f7b044bf3b59e6190d6a8328b` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:23.316771 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e3b71-4576-432d-ac86-01bce3ec53be admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe7b201f7b044bf3b59e6190d6a8328b)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:23.319426 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e3b71-4576-432d-ac86-01bce3ec53be admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:23.529806 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-f24e3b71-4576-432d-ac86-01bce3ec53be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe7b201f7b044bf3b59e6190d6a8328b', 'request_id': 'req-f24e3b71-4576-432d-ac86-01bce3ec53be'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:23.547270 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-f24e3b71-4576-432d-ac86-01bce3ec53be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe7b201f7b044bf3b59e6190d6a8328b', 'request_id': 'req-f24e3b71-4576-432d-ac86-01bce3ec53be'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:23.554688 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-f24e3b71-4576-432d-ac86-01bce3ec53be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe7b201f7b044bf3b59e6190d6a8328b', 'request_id': 'req-f24e3b71-4576-432d-ac86-01bce3ec53be'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:23.647237 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-f24e3b71-4576-432d-ac86-01bce3ec53be admin admin] The token cache is being invalidate because project fe7b201f7b044bf3b59e6190d6a8328b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:24:23.648269 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-f24e3b71-4576-432d-ac86-01bce3ec53be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:23.648762 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-f24e3b71-4576-432d-ac86-01bce3ec53be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:23.653707 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1104/2205] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:24:23 2022] DELETE /identity/v3/projects/fe7b201f7b044bf3b59e6190d6a8328b => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:24:23.654727 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03908754-dd5b-470b-a81d-22d54a19015b admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:23.656772 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-03908754-dd5b-470b-a81d-22d54a19015b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:23.671223 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03908754-dd5b-470b-a81d-22d54a19015b admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:23.769801 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4889316-672c-4371-8670-0de5ab7bfc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:23.771371 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4889316-672c-4371-8670-0de5ab7bfc12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:23.771667 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4889316-672c-4371-8670-0de5ab7bfc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:23.771938 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4889316-672c-4371-8670-0de5ab7bfc12 admin admin] PATH_INFO: `/v3/users/880394d24f50410c9714cbed60986c10` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:23.773233 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4889316-672c-4371-8670-0de5ab7bfc12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=880394d24f50410c9714cbed60986c10)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:23.775410 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4889316-672c-4371-8670-0de5ab7bfc12 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:24.097673 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-b4889316-672c-4371-8670-0de5ab7bfc12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '880394d24f50410c9714cbed60986c10'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:24.168349 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-b4889316-672c-4371-8670-0de5ab7bfc12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '880394d24f50410c9714cbed60986c10'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:24.172137 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-b4889316-672c-4371-8670-0de5ab7bfc12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '880394d24f50410c9714cbed60986c10'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:24.201175 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-b4889316-672c-4371-8670-0de5ab7bfc12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '880394d24f50410c9714cbed60986c10'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:24.204206 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-b4889316-672c-4371-8670-0de5ab7bfc12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '880394d24f50410c9714cbed60986c10'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:24.303993 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1102/2206] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:24:23 2022] DELETE /identity/v3/users/880394d24f50410c9714cbed60986c10 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:24:25.368006 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e3b71-4576-432d-ac86-01bce3ec53be admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:25.368982 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-f24e3b71-4576-432d-ac86-01bce3ec53be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:25.384799 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:25.396431 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e3b71-4576-432d-ac86-01bce3ec53be admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:25.524383 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3efb5fc-0c00-4835-acc8-b19601d997bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:25.525389 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3efb5fc-0c00-4835-acc8-b19601d997bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:25.525676 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3efb5fc-0c00-4835-acc8-b19601d997bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:25.525953 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3efb5fc-0c00-4835-acc8-b19601d997bb admin admin] PATH_INFO: `/v3/projects/43a6dcdb8f49469aa19e0869045a7964` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:25.527239 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3efb5fc-0c00-4835-acc8-b19601d997bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=43a6dcdb8f49469aa19e0869045a7964)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:25.529284 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3efb5fc-0c00-4835-acc8-b19601d997bb admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:25.697977 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-b3efb5fc-0c00-4835-acc8-b19601d997bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43a6dcdb8f49469aa19e0869045a7964', 'request_id': 'req-b3efb5fc-0c00-4835-acc8-b19601d997bb'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:25.729638 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-b3efb5fc-0c00-4835-acc8-b19601d997bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43a6dcdb8f49469aa19e0869045a7964', 'request_id': 'req-b3efb5fc-0c00-4835-acc8-b19601d997bb'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:25.755486 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-b3efb5fc-0c00-4835-acc8-b19601d997bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43a6dcdb8f49469aa19e0869045a7964', 'request_id': 'req-b3efb5fc-0c00-4835-acc8-b19601d997bb'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:25.876326 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-b3efb5fc-0c00-4835-acc8-b19601d997bb admin admin] The token cache is being invalidate because project 43a6dcdb8f49469aa19e0869045a7964 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:24:25.877269 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-b3efb5fc-0c00-4835-acc8-b19601d997bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:25.878434 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-b3efb5fc-0c00-4835-acc8-b19601d997bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:25.881937 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1105/2207] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:24:25 2022] DELETE /identity/v3/projects/43a6dcdb8f49469aa19e0869045a7964 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:24:25.887485 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b68fca-373f-4c10-a236-a7dd9daffd35 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:25.888031 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b68fca-373f-4c10-a236-a7dd9daffd35 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:25.888031 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b68fca-373f-4c10-a236-a7dd9daffd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:25.933992 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-12b68fca-373f-4c10-a236-a7dd9daffd35 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:24:25.935880 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-12b68fca-373f-4c10-a236-a7dd9daffd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:25.974691 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:26.078730 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1103/2208] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:24:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:24:26.096240 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaffaa2-3fdf-48a1-b651-0a30031be519 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:26.096240 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaffaa2-3fdf-48a1-b651-0a30031be519 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:26.096240 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaffaa2-3fdf-48a1-b651-0a30031be519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:26.118813 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-dcaffaa2-3fdf-48a1-b651-0a30031be519 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:24:26.129317 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-dcaffaa2-3fdf-48a1-b651-0a30031be519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:26.139826 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b68fca-373f-4c10-a236-a7dd9daffd35 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:26.148307 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1106/2209] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:24:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:24:26.156684 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b68fca-373f-4c10-a236-a7dd9daffd35 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:26.173491 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cee884f-cfa1-484e-abcb-b5e2053bdbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:26.208383 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee884f-cfa1-484e-abcb-b5e2053bdbd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:26.208383 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee884f-cfa1-484e-abcb-b5e2053bdbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:26.208383 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee884f-cfa1-484e-abcb-b5e2053bdbd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:26.208383 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cee884f-cfa1-484e-abcb-b5e2053bdbd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:24:26.208383 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cee884f-cfa1-484e-abcb-b5e2053bdbd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:26.208383 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cee884f-cfa1-484e-abcb-b5e2053bdbd5 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:26.209713 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaffaa2-3fdf-48a1-b651-0a30031be519 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:26.217829 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1104/2210] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:24:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:24:26.228173 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaffaa2-3fdf-48a1-b651-0a30031be519 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:26.261131 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f2d19-e808-4c36-8545-7272e18fbac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:26.262030 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f2d19-e808-4c36-8545-7272e18fbac2 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:26.262326 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f2d19-e808-4c36-8545-7272e18fbac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:26.263407 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f2d19-e808-4c36-8545-7272e18fbac2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:26.264826 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941f2d19-e808-4c36-8545-7272e18fbac2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:26.266693 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941f2d19-e808-4c36-8545-7272e18fbac2 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:26.705680 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1107/2211] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:24:26 2022] POST /identity/v3/projects => generated 383 bytes in 496 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:24:26.709164 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cee884f-cfa1-484e-abcb-b5e2053bdbd5 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:26.719247 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cee884f-cfa1-484e-abcb-b5e2053bdbd5 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:26.777881 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8e0d0-0c05-44cc-8556-f4059438ee82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:26.778590 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8e0d0-0c05-44cc-8556-f4059438ee82 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:26.778874 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8e0d0-0c05-44cc-8556-f4059438ee82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:26.779261 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8e0d0-0c05-44cc-8556-f4059438ee82 admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:26.780076 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f8e0d0-0c05-44cc-8556-f4059438ee82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:26.782028 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f8e0d0-0c05-44cc-8556-f4059438ee82 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:26.920136 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1105/2212] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:24:26 2022] POST /identity/v3/users => generated 292 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:24:26.924544 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f2d19-e808-4c36-8545-7272e18fbac2 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:26.947394 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f2d19-e808-4c36-8545-7272e18fbac2 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:26.962444 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049270c-7d7e-4860-a0ad-bd2da495808f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:26.962444 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049270c-7d7e-4860-a0ad-bd2da495808f admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:26.962444 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049270c-7d7e-4860-a0ad-bd2da495808f admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:26.962444 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049270c-7d7e-4860-a0ad-bd2da495808f admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:26.962936 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049270c-7d7e-4860-a0ad-bd2da495808f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:26.963133 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049270c-7d7e-4860-a0ad-bd2da495808f admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:26.998983 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1108/2213] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:24:27.002871 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8e0d0-0c05-44cc-8556-f4059438ee82 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:27.016507 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8e0d0-0c05-44cc-8556-f4059438ee82 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:27.023540 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351da46a-cf87-44ed-8b9f-e303f1d18dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:27.024587 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351da46a-cf87-44ed-8b9f-e303f1d18dbd admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:27.025062 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351da46a-cf87-44ed-8b9f-e303f1d18dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:27.025525 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351da46a-cf87-44ed-8b9f-e303f1d18dbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:27.026467 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351da46a-cf87-44ed-8b9f-e303f1d18dbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:27.028359 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351da46a-cf87-44ed-8b9f-e303f1d18dbd admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:27.040342 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1106/2214] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:24:27.044197 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049270c-7d7e-4860-a0ad-bd2da495808f admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:27.059406 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049270c-7d7e-4860-a0ad-bd2da495808f admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:27.068388 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a6158-6536-4897-b79e-12e2184920a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:27.069836 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a6158-6536-4897-b79e-12e2184920a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:27.070126 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a6158-6536-4897-b79e-12e2184920a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:27.070402 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a6158-6536-4897-b79e-12e2184920a6 admin admin] PATH_INFO: `/v3/projects/aa528a5708c14acbbb7fc9f084b30f59/users/10ac45862245486692519894e31e7b87/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:27.092404 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a6158-6536-4897-b79e-12e2184920a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa528a5708c14acbbb7fc9f084b30f59, user_id=10ac45862245486692519894e31e7b87, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:27.095029 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a6158-6536-4897-b79e-12e2184920a6 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:27.208084 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1109/2215] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:24:27 2022] PUT /identity/v3/projects/aa528a5708c14acbbb7fc9f084b30f59/users/10ac45862245486692519894e31e7b87/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:24:27.222727 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60378d71-250b-4fb5-b312-2cf5cfa33a3b None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:27.223558 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60378d71-250b-4fb5-b312-2cf5cfa33a3b None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:27.223791 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60378d71-250b-4fb5-b312-2cf5cfa33a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:27.296349 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-60378d71-250b-4fb5-b312-2cf5cfa33a3b None None] MFA Rules not processed for user `10ac45862245486692519894e31e7b87`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:24:27.297589 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-60378d71-250b-4fb5-b312-2cf5cfa33a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:27.471587 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1107/2216] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:24:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:24:27.476775 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a6158-6536-4897-b79e-12e2184920a6 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:27.576741 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:27.655667 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a6158-6536-4897-b79e-12e2184920a6 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:27.679876 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e12de2-3924-4cad-b2a3-8c67b022a29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:27.680735 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e12de2-3924-4cad-b2a3-8c67b022a29c admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:27.681118 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e12de2-3924-4cad-b2a3-8c67b022a29c admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:27.681485 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e12de2-3924-4cad-b2a3-8c67b022a29c admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:27.682274 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e12de2-3924-4cad-b2a3-8c67b022a29c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:27.685331 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e12de2-3924-4cad-b2a3-8c67b022a29c admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:27.843662 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1110/2217] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:24:27 2022] POST /identity/v3/projects => generated 385 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:24:27.847741 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60378d71-250b-4fb5-b312-2cf5cfa33a3b None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:27.868448 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60378d71-250b-4fb5-b312-2cf5cfa33a3b None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:27.885674 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:28.002346 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae8c1da-1a3d-4af8-9ce8-af677ee16611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:28.002996 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8c1da-1a3d-4af8-9ce8-af677ee16611 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:28.003222 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8c1da-1a3d-4af8-9ce8-af677ee16611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:28.003497 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8c1da-1a3d-4af8-9ce8-af677ee16611 admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:28.005052 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae8c1da-1a3d-4af8-9ce8-af677ee16611 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:28.007099 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae8c1da-1a3d-4af8-9ce8-af677ee16611 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:28.175942 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1108/2218] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:24:27 2022] POST /identity/v3/users => generated 293 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:24:28.180136 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e12de2-3924-4cad-b2a3-8c67b022a29c admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:28.193385 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e12de2-3924-4cad-b2a3-8c67b022a29c admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:28.201895 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fa2006-b19f-4778-9af4-efe91d7e65b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:28.202961 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa2006-b19f-4778-9af4-efe91d7e65b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:28.203503 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa2006-b19f-4778-9af4-efe91d7e65b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:28.204000 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa2006-b19f-4778-9af4-efe91d7e65b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:28.204977 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fa2006-b19f-4778-9af4-efe91d7e65b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:28.208350 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fa2006-b19f-4778-9af4-efe91d7e65b8 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:28.236536 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae8c1da-1a3d-4af8-9ce8-af677ee16611 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:28.247143 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1111/2219] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:24:28.252316 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae8c1da-1a3d-4af8-9ce8-af677ee16611 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:28.259657 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a9a6fd-9784-45fd-8d44-cf1c7afbb54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:28.260306 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9a6fd-9784-45fd-8d44-cf1c7afbb54a admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:28.260780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9a6fd-9784-45fd-8d44-cf1c7afbb54a admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:28.261555 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9a6fd-9784-45fd-8d44-cf1c7afbb54a admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:28.262447 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a9a6fd-9784-45fd-8d44-cf1c7afbb54a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:28.264555 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a9a6fd-9784-45fd-8d44-cf1c7afbb54a admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:28.288232 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fa2006-b19f-4778-9af4-efe91d7e65b8 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:28.299522 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fa2006-b19f-4778-9af4-efe91d7e65b8 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:28.300510 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1109/2220] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:24:28.308416 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e499a2-52b4-4de5-bf06-c5cec7ee3d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:28.310057 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e499a2-52b4-4de5-bf06-c5cec7ee3d7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:28.310347 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e499a2-52b4-4de5-bf06-c5cec7ee3d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:28.310626 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e499a2-52b4-4de5-bf06-c5cec7ee3d7c admin admin] PATH_INFO: `/v3/projects/818d1cd4218147f68126b76a3b8cbc6a/users/73399e8c558b422d8e724a81869dac48/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:28.329527 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e499a2-52b4-4de5-bf06-c5cec7ee3d7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=818d1cd4218147f68126b76a3b8cbc6a, user_id=73399e8c558b422d8e724a81869dac48, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:28.332222 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e499a2-52b4-4de5-bf06-c5cec7ee3d7c admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:28.413687 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1112/2221] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:24:28 2022] PUT /identity/v3/projects/818d1cd4218147f68126b76a3b8cbc6a/users/73399e8c558b422d8e724a81869dac48/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:24:28.427084 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc14d82-e60b-4216-97cc-614150985618 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:28.429857 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc14d82-e60b-4216-97cc-614150985618 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:28.429857 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc14d82-e60b-4216-97cc-614150985618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:28.467234 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-9fc14d82-e60b-4216-97cc-614150985618 None None] MFA Rules not processed for user `73399e8c558b422d8e724a81869dac48`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:24:28.468641 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-9fc14d82-e60b-4216-97cc-614150985618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:28.551613 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1110/2222] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:24:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:24:28.555859 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e499a2-52b4-4de5-bf06-c5cec7ee3d7c admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:28.646254 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e499a2-52b4-4de5-bf06-c5cec7ee3d7c admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:28.651500 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e099703-4a4f-4019-861b-b3bcc180f6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:28.652404 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e099703-4a4f-4019-861b-b3bcc180f6f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:28.653193 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e099703-4a4f-4019-861b-b3bcc180f6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:28.653632 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e099703-4a4f-4019-861b-b3bcc180f6f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:28.656297 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e099703-4a4f-4019-861b-b3bcc180f6f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:28.660190 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e099703-4a4f-4019-861b-b3bcc180f6f5 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:28.834996 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1113/2223] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:24:28 2022] POST /identity/v3/projects => generated 385 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:24:28.838755 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc14d82-e60b-4216-97cc-614150985618 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:28.856635 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc14d82-e60b-4216-97cc-614150985618 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:28.938074 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0dcf1e-eefb-46b4-bb04-a9046fc79f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:28.940927 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0dcf1e-eefb-46b4-bb04-a9046fc79f91 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:28.941388 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0dcf1e-eefb-46b4-bb04-a9046fc79f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:28.942434 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0dcf1e-eefb-46b4-bb04-a9046fc79f91 admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:28.943204 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0dcf1e-eefb-46b4-bb04-a9046fc79f91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:28.947937 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0dcf1e-eefb-46b4-bb04-a9046fc79f91 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:29.024077 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1111/2224] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:24:28 2022] POST /identity/v3/users => generated 299 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:24:29.028306 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e099703-4a4f-4019-861b-b3bcc180f6f5 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:29.045880 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e099703-4a4f-4019-861b-b3bcc180f6f5 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:29.053606 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b9437-84d0-4beb-9873-d5d46052ae8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:29.054359 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b9437-84d0-4beb-9873-d5d46052ae8b admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:29.054735 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b9437-84d0-4beb-9873-d5d46052ae8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:29.055059 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b9437-84d0-4beb-9873-d5d46052ae8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:29.056051 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b9437-84d0-4beb-9873-d5d46052ae8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:29.057992 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b9437-84d0-4beb-9873-d5d46052ae8b admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:29.076182 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1114/2225] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:24:29.080237 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0dcf1e-eefb-46b4-bb04-a9046fc79f91 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:29.092381 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0dcf1e-eefb-46b4-bb04-a9046fc79f91 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:29.101772 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bbe23b-eea4-4d5b-98b1-f788ba99fc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:29.102894 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bbe23b-eea4-4d5b-98b1-f788ba99fc71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:29.103339 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bbe23b-eea4-4d5b-98b1-f788ba99fc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:29.103763 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bbe23b-eea4-4d5b-98b1-f788ba99fc71 admin admin] PATH_INFO: `/v3/projects/27d65c3431be449aa5a4509a4fbfccc3/users/7dbbdf35cb45455fb36ec5d39cc4a4f1/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:29.107901 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:29.128046 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bbe23b-eea4-4d5b-98b1-f788ba99fc71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27d65c3431be449aa5a4509a4fbfccc3, user_id=7dbbdf35cb45455fb36ec5d39cc4a4f1, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:29.130868 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bbe23b-eea4-4d5b-98b1-f788ba99fc71 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:29.211732 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1112/2226] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:24:29 2022] PUT /identity/v3/projects/27d65c3431be449aa5a4509a4fbfccc3/users/7dbbdf35cb45455fb36ec5d39cc4a4f1/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:24:29.215323 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b9437-84d0-4beb-9873-d5d46052ae8b admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:29.226556 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b9437-84d0-4beb-9873-d5d46052ae8b admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:29.293462 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:29.302871 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d8f0a-bf01-4b79-999b-6b5942e9b0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:29.304064 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d8f0a-bf01-4b79-999b-6b5942e9b0d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:29.304501 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d8f0a-bf01-4b79-999b-6b5942e9b0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:29.304903 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d8f0a-bf01-4b79-999b-6b5942e9b0d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:29.305637 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d8f0a-bf01-4b79-999b-6b5942e9b0d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:29.307245 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d8f0a-bf01-4b79-999b-6b5942e9b0d2 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:29.322906 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1115/2227] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:24:29.323423 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bbe23b-eea4-4d5b-98b1-f788ba99fc71 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:29.334996 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bbe23b-eea4-4d5b-98b1-f788ba99fc71 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:29.339961 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1537869-6d20-4aec-ba07-454425ef2951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:29.340956 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1537869-6d20-4aec-ba07-454425ef2951 admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:29.341311 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1537869-6d20-4aec-ba07-454425ef2951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:29.341658 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1537869-6d20-4aec-ba07-454425ef2951 admin admin] PATH_INFO: `/v3/projects/27d65c3431be449aa5a4509a4fbfccc3/users/7dbbdf35cb45455fb36ec5d39cc4a4f1/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:29.343964 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1537869-6d20-4aec-ba07-454425ef2951 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27d65c3431be449aa5a4509a4fbfccc3, user_id=7dbbdf35cb45455fb36ec5d39cc4a4f1, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:29.346704 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1537869-6d20-4aec-ba07-454425ef2951 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:29.370616 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1113/2228] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:24:29 2022] PUT /identity/v3/projects/27d65c3431be449aa5a4509a4fbfccc3/users/7dbbdf35cb45455fb36ec5d39cc4a4f1/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:24:29.372201 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb6312-16f9-40a6-9b0a-94c591023e40 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:29.372949 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb6312-16f9-40a6-9b0a-94c591023e40 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:29.373306 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb6312-16f9-40a6-9b0a-94c591023e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:29.406144 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-edcb6312-16f9-40a6-9b0a-94c591023e40 None None] MFA Rules not processed for user `7dbbdf35cb45455fb36ec5d39cc4a4f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:24:29.407627 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-edcb6312-16f9-40a6-9b0a-94c591023e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:29.501777 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1116/2229] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:24:29 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:24:29.515385 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1537869-6d20-4aec-ba07-454425ef2951 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:29.517112 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-b1537869-6d20-4aec-ba07-454425ef2951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:29.640055 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1537869-6d20-4aec-ba07-454425ef2951 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:29.644497 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d025e-4772-42ad-b722-58e669affe18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:29.645863 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d025e-4772-42ad-b722-58e669affe18 service cinder] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:29.646343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d025e-4772-42ad-b722-58e669affe18 service cinder] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:29.646634 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d025e-4772-42ad-b722-58e669affe18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:29.718574 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d025e-4772-42ad-b722-58e669affe18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:29.720057 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d025e-4772-42ad-b722-58e669affe18 service cinder] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:29.730390 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1114/2230] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:24:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 13:24:33.242878 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb6312-16f9-40a6-9b0a-94c591023e40 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:33.244346 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-edcb6312-16f9-40a6-9b0a-94c591023e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:33.257970 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb6312-16f9-40a6-9b0a-94c591023e40 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:33.261591 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc4b64-b22b-478c-857d-8d79d4e3cefa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:33.262261 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc4b64-b22b-478c-857d-8d79d4e3cefa service cinder] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:33.262540 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc4b64-b22b-478c-857d-8d79d4e3cefa service cinder] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:33.262811 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc4b64-b22b-478c-857d-8d79d4e3cefa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:33.345257 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc4b64-b22b-478c-857d-8d79d4e3cefa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:33.346982 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc4b64-b22b-478c-857d-8d79d4e3cefa service cinder] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:33.358132 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1117/2231] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:24:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:24:35.178421 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0371f8-2d47-43eb-b9c4-751dcbe5179e None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:35.179001 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0371f8-2d47-43eb-b9c4-751dcbe5179e None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:35.179098 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0371f8-2d47-43eb-b9c4-751dcbe5179e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:35.195735 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-9c0371f8-2d47-43eb-b9c4-751dcbe5179e None None] MFA Rules not processed for user `4d0490962ec743048ef924340c93de20`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:24:35.196950 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-9c0371f8-2d47-43eb-b9c4-751dcbe5179e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:35.257635 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1115/2232] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:24:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:24:35.498668 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc4b64-b22b-478c-857d-8d79d4e3cefa service cinder] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:35.508319 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc4b64-b22b-478c-857d-8d79d4e3cefa service cinder] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:35.511939 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f231c8-38b5-4b51-894a-65a2e1fea3be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:35.512622 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f231c8-38b5-4b51-894a-65a2e1fea3be service cinder] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:35.512909 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f231c8-38b5-4b51-894a-65a2e1fea3be service cinder] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:35.513234 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f231c8-38b5-4b51-894a-65a2e1fea3be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:35.523668 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f231c8-38b5-4b51-894a-65a2e1fea3be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:35.525150 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f231c8-38b5-4b51-894a-65a2e1fea3be service cinder] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:35.534732 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1118/2233] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:24:35 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:24:40.415246 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41444f1-499a-4096-97b7-facbae9024f4 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:40.415839 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41444f1-499a-4096-97b7-facbae9024f4 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:40.415839 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41444f1-499a-4096-97b7-facbae9024f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:40.434607 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-c41444f1-499a-4096-97b7-facbae9024f4 None None] MFA Rules not processed for user `06c55d0ea52f40ae9125d2efe1d159a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:24:40.435967 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-c41444f1-499a-4096-97b7-facbae9024f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:40.442732 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:40.497554 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1116/2234] 10.222.0.61 () {58 vars in 1009 bytes} [Fri Jun 3 13:24:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:24:40.509621 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f231c8-38b5-4b51-894a-65a2e1fea3be service cinder] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:40.511181 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-e6f231c8-38b5-4b51-894a-65a2e1fea3be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:40.584897 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:40.589832 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f231c8-38b5-4b51-894a-65a2e1fea3be service cinder] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:40.595289 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c9dad6-fa8d-45b0-9cff-6deb065c669a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07ad3dd7477497ea25c2a01bff35712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:40.595988 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9dad6-fa8d-45b0-9cff-6deb065c669a service swift] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:40.596316 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9dad6-fa8d-45b0-9cff-6deb065c669a service swift] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:40.596601 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9dad6-fa8d-45b0-9cff-6deb065c669a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:40.606298 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c9dad6-fa8d-45b0-9cff-6deb065c669a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:40.607923 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c9dad6-fa8d-45b0-9cff-6deb065c669a service swift] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:40.617893 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1119/2235] 10.222.0.61 () {60 vars in 1384 bytes} [Fri Jun 3 13:24:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 13:24:41.251107 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41444f1-499a-4096-97b7-facbae9024f4 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:41.316783 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41444f1-499a-4096-97b7-facbae9024f4 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:41.321505 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb11a1-c4dc-4191-b664-443367ff6f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:41.322365 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb11a1-c4dc-4191-b664-443367ff6f10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:41.322644 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb11a1-c4dc-4191-b664-443367ff6f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:41.323041 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb11a1-c4dc-4191-b664-443367ff6f10 admin admin] PATH_INFO: `/v3/users/10ac45862245486692519894e31e7b87` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:41.324255 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb11a1-c4dc-4191-b664-443367ff6f10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10ac45862245486692519894e31e7b87)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:41.326178 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb11a1-c4dc-4191-b664-443367ff6f10 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:41.544005 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-21eb11a1-c4dc-4191-b664-443367ff6f10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10ac45862245486692519894e31e7b87'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:41.573475 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-21eb11a1-c4dc-4191-b664-443367ff6f10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10ac45862245486692519894e31e7b87'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:41.577017 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-21eb11a1-c4dc-4191-b664-443367ff6f10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10ac45862245486692519894e31e7b87'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:41.587602 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-21eb11a1-c4dc-4191-b664-443367ff6f10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10ac45862245486692519894e31e7b87'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:41.589205 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-21eb11a1-c4dc-4191-b664-443367ff6f10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10ac45862245486692519894e31e7b87'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:41.671013 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1117/2236] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:24:41 2022] DELETE /identity/v3/users/10ac45862245486692519894e31e7b87 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:24:41.675482 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9dcf27-9558-43e5-aaed-cede1f9e4fca None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:41.675995 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9dcf27-9558-43e5-aaed-cede1f9e4fca None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:41.675995 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9dcf27-9558-43e5-aaed-cede1f9e4fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:41.697920 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-4f9dcf27-9558-43e5-aaed-cede1f9e4fca None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:24:41.699179 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-4f9dcf27-9558-43e5-aaed-cede1f9e4fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:41.793205 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1120/2237] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:24:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:24:41.804330 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb11a1-c4dc-4191-b664-443367ff6f10 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:41.805755 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-21eb11a1-c4dc-4191-b664-443367ff6f10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:41.861385 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:41.881379 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb11a1-c4dc-4191-b664-443367ff6f10 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:41.886442 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5be75-6554-4b4b-90d1-cb86e1ba779c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:41.887229 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5be75-6554-4b4b-90d1-cb86e1ba779c service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:41.887606 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5be75-6554-4b4b-90d1-cb86e1ba779c service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:41.887977 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5be75-6554-4b4b-90d1-cb86e1ba779c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:41.899594 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb5be75-6554-4b4b-90d1-cb86e1ba779c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:41.902981 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb5be75-6554-4b4b-90d1-cb86e1ba779c service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:41.912929 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1118/2238] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:24:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:24:42.486694 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9dcf27-9558-43e5-aaed-cede1f9e4fca None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:42.486694 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-4f9dcf27-9558-43e5-aaed-cede1f9e4fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:42.504242 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9dcf27-9558-43e5-aaed-cede1f9e4fca None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:42.509610 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c42879-d329-4fe2-9076-09bea50c637d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:42.511115 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c42879-d329-4fe2-9076-09bea50c637d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:42.511557 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c42879-d329-4fe2-9076-09bea50c637d admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:42.511984 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c42879-d329-4fe2-9076-09bea50c637d admin admin] PATH_INFO: `/v3/projects/aa528a5708c14acbbb7fc9f084b30f59` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:42.515073 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c42879-d329-4fe2-9076-09bea50c637d admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa528a5708c14acbbb7fc9f084b30f59)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:42.517459 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c42879-d329-4fe2-9076-09bea50c637d admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:42.675670 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-30c42879-d329-4fe2-9076-09bea50c637d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa528a5708c14acbbb7fc9f084b30f59', 'request_id': 'req-30c42879-d329-4fe2-9076-09bea50c637d'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:42.710930 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-30c42879-d329-4fe2-9076-09bea50c637d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa528a5708c14acbbb7fc9f084b30f59', 'request_id': 'req-30c42879-d329-4fe2-9076-09bea50c637d'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:42.724965 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-30c42879-d329-4fe2-9076-09bea50c637d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa528a5708c14acbbb7fc9f084b30f59', 'request_id': 'req-30c42879-d329-4fe2-9076-09bea50c637d'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:42.868832 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-30c42879-d329-4fe2-9076-09bea50c637d admin admin] The token cache is being invalidate because project aa528a5708c14acbbb7fc9f084b30f59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:24:42.868832 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-30c42879-d329-4fe2-9076-09bea50c637d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:42.868832 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-30c42879-d329-4fe2-9076-09bea50c637d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:42.873809 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1121/2239] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:24:42 2022] DELETE /identity/v3/projects/aa528a5708c14acbbb7fc9f084b30f59 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:24:42.874930 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5be75-6554-4b4b-90d1-cb86e1ba779c service neutron] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:42.891233 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5be75-6554-4b4b-90d1-cb86e1ba779c service neutron] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:42.973389 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d2a72-8b33-45e8-8085-5059ebe2868e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:42.973389 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d2a72-8b33-45e8-8085-5059ebe2868e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:42.973389 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d2a72-8b33-45e8-8085-5059ebe2868e admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:42.973389 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d2a72-8b33-45e8-8085-5059ebe2868e admin admin] PATH_INFO: `/v3/users/73399e8c558b422d8e724a81869dac48` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:42.974302 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745d2a72-8b33-45e8-8085-5059ebe2868e admin admin] RBAC: Authorizing `identity:delete_user(user_id=73399e8c558b422d8e724a81869dac48)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:42.976298 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745d2a72-8b33-45e8-8085-5059ebe2868e admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:43.196419 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-745d2a72-8b33-45e8-8085-5059ebe2868e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73399e8c558b422d8e724a81869dac48'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:43.209248 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-745d2a72-8b33-45e8-8085-5059ebe2868e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73399e8c558b422d8e724a81869dac48'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:43.209935 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-745d2a72-8b33-45e8-8085-5059ebe2868e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73399e8c558b422d8e724a81869dac48'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:43.217025 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-745d2a72-8b33-45e8-8085-5059ebe2868e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73399e8c558b422d8e724a81869dac48'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:43.217693 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-745d2a72-8b33-45e8-8085-5059ebe2868e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73399e8c558b422d8e724a81869dac48'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:43.310098 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1119/2240] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:24:42 2022] DELETE /identity/v3/users/73399e8c558b422d8e724a81869dac48 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:24:43.792317 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c42879-d329-4fe2-9076-09bea50c637d admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:43.793827 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-30c42879-d329-4fe2-9076-09bea50c637d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:43.807984 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c42879-d329-4fe2-9076-09bea50c637d admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:43.875638 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51272a-8140-423b-b4b3-6f81a13774b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:43.876559 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51272a-8140-423b-b4b3-6f81a13774b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:43.876888 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51272a-8140-423b-b4b3-6f81a13774b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:43.877160 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51272a-8140-423b-b4b3-6f81a13774b6 admin admin] PATH_INFO: `/v3/projects/818d1cd4218147f68126b76a3b8cbc6a` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:43.878348 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea51272a-8140-423b-b4b3-6f81a13774b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=818d1cd4218147f68126b76a3b8cbc6a)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:43.880972 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea51272a-8140-423b-b4b3-6f81a13774b6 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:43.902888 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:44.054221 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-ea51272a-8140-423b-b4b3-6f81a13774b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '818d1cd4218147f68126b76a3b8cbc6a', 'request_id': 'req-ea51272a-8140-423b-b4b3-6f81a13774b6'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:44.061790 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-ea51272a-8140-423b-b4b3-6f81a13774b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '818d1cd4218147f68126b76a3b8cbc6a', 'request_id': 'req-ea51272a-8140-423b-b4b3-6f81a13774b6'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:44.068878 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-ea51272a-8140-423b-b4b3-6f81a13774b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '818d1cd4218147f68126b76a3b8cbc6a', 'request_id': 'req-ea51272a-8140-423b-b4b3-6f81a13774b6'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:44.144450 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-ea51272a-8140-423b-b4b3-6f81a13774b6 admin admin] The token cache is being invalidate because project 818d1cd4218147f68126b76a3b8cbc6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:24:44.144739 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-ea51272a-8140-423b-b4b3-6f81a13774b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:44.145675 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-ea51272a-8140-423b-b4b3-6f81a13774b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:44.147457 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1122/2241] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:24:43 2022] DELETE /identity/v3/projects/818d1cd4218147f68126b76a3b8cbc6a => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:24:44.151380 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d2a72-8b33-45e8-8085-5059ebe2868e admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:44.152831 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-745d2a72-8b33-45e8-8085-5059ebe2868e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:44.166288 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d2a72-8b33-45e8-8085-5059ebe2868e admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:44.219991 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:44.226030 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd129da-4e9d-4684-b4cf-f9b8f16156ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:44.226902 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd129da-4e9d-4684-b4cf-f9b8f16156ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:44.227183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd129da-4e9d-4684-b4cf-f9b8f16156ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:44.227459 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd129da-4e9d-4684-b4cf-f9b8f16156ea admin admin] PATH_INFO: `/v3/users/7dbbdf35cb45455fb36ec5d39cc4a4f1` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:44.232228 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd129da-4e9d-4684-b4cf-f9b8f16156ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dbbdf35cb45455fb36ec5d39cc4a4f1)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:44.232228 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd129da-4e9d-4684-b4cf-f9b8f16156ea admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:44.383621 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-6cd129da-4e9d-4684-b4cf-f9b8f16156ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dbbdf35cb45455fb36ec5d39cc4a4f1'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:44.395185 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-6cd129da-4e9d-4684-b4cf-f9b8f16156ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dbbdf35cb45455fb36ec5d39cc4a4f1'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:44.395873 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-6cd129da-4e9d-4684-b4cf-f9b8f16156ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dbbdf35cb45455fb36ec5d39cc4a4f1'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:44.402524 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-6cd129da-4e9d-4684-b4cf-f9b8f16156ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dbbdf35cb45455fb36ec5d39cc4a4f1'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:44.403138 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-6cd129da-4e9d-4684-b4cf-f9b8f16156ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dbbdf35cb45455fb36ec5d39cc4a4f1'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:44.454781 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1120/2242] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:24:44 2022] DELETE /identity/v3/users/7dbbdf35cb45455fb36ec5d39cc4a4f1 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:24:44.975482 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51272a-8140-423b-b4b3-6f81a13774b6 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:44.977097 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-ea51272a-8140-423b-b4b3-6f81a13774b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:45.007975 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51272a-8140-423b-b4b3-6f81a13774b6 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:45.087147 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c33183-60d0-4f30-8f78-e4dc845450b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:45.088914 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c33183-60d0-4f30-8f78-e4dc845450b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:45.089263 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c33183-60d0-4f30-8f78-e4dc845450b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:45.089607 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c33183-60d0-4f30-8f78-e4dc845450b3 admin admin] PATH_INFO: `/v3/projects/27d65c3431be449aa5a4509a4fbfccc3` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:45.090980 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c33183-60d0-4f30-8f78-e4dc845450b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27d65c3431be449aa5a4509a4fbfccc3)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:45.093007 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c33183-60d0-4f30-8f78-e4dc845450b3 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:45.231522 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-33c33183-60d0-4f30-8f78-e4dc845450b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27d65c3431be449aa5a4509a4fbfccc3', 'request_id': 'req-33c33183-60d0-4f30-8f78-e4dc845450b3'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:45.248847 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-33c33183-60d0-4f30-8f78-e4dc845450b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27d65c3431be449aa5a4509a4fbfccc3', 'request_id': 'req-33c33183-60d0-4f30-8f78-e4dc845450b3'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:45.261032 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-33c33183-60d0-4f30-8f78-e4dc845450b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27d65c3431be449aa5a4509a4fbfccc3', 'request_id': 'req-33c33183-60d0-4f30-8f78-e4dc845450b3'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:45.352485 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-33c33183-60d0-4f30-8f78-e4dc845450b3 admin admin] The token cache is being invalidate because project 27d65c3431be449aa5a4509a4fbfccc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:24:45.352777 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-33c33183-60d0-4f30-8f78-e4dc845450b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:45.353442 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-33c33183-60d0-4f30-8f78-e4dc845450b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:24:45.356202 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1123/2243] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:24:44 2022] DELETE /identity/v3/projects/27d65c3431be449aa5a4509a4fbfccc3 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:24:45.359966 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703c340-320e-4414-afa6-538c56c5a2f4 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:45.360546 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703c340-320e-4414-afa6-538c56c5a2f4 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:45.360546 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703c340-320e-4414-afa6-538c56c5a2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:45.381722 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-0703c340-320e-4414-afa6-538c56c5a2f4 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:24:45.382957 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-0703c340-320e-4414-afa6-538c56c5a2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:45.457253 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1121/2244] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:24:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:24:45.465610 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4771f61-ea03-494d-a521-bcac3ce0347e None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:45.465990 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4771f61-ea03-494d-a521-bcac3ce0347e None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:45.466335 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4771f61-ea03-494d-a521-bcac3ce0347e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:45.493192 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-d4771f61-ea03-494d-a521-bcac3ce0347e None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:24:45.494426 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-d4771f61-ea03-494d-a521-bcac3ce0347e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:45.504927 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1124/2245] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:24:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:24:45.507782 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0703c340-320e-4414-afa6-538c56c5a2f4 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:45.517909 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0703c340-320e-4414-afa6-538c56c5a2f4 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:45.523542 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2f3bd-3c46-49aa-9e83-1620cb6bccee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:45.524339 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2f3bd-3c46-49aa-9e83-1620cb6bccee admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:45.524627 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2f3bd-3c46-49aa-9e83-1620cb6bccee admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:45.524903 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2f3bd-3c46-49aa-9e83-1620cb6bccee admin admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:45.525630 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f2f3bd-3c46-49aa-9e83-1620cb6bccee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:24:45.525939 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f2f3bd-3c46-49aa-9e83-1620cb6bccee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:45.527551 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f2f3bd-3c46-49aa-9e83-1620cb6bccee admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:45.539576 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1122/2246] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:24:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:24:45.544273 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4771f61-ea03-494d-a521-bcac3ce0347e None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:45.553631 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4771f61-ea03-494d-a521-bcac3ce0347e None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:45.558314 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c4e1e-3815-42c8-80fe-1734536cec1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:45.558998 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c4e1e-3815-42c8-80fe-1734536cec1c admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:45.559245 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c4e1e-3815-42c8-80fe-1734536cec1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:45.559518 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c4e1e-3815-42c8-80fe-1734536cec1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:45.560231 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c4e1e-3815-42c8-80fe-1734536cec1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:45.562141 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c4e1e-3815-42c8-80fe-1734536cec1c admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:45.651060 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1125/2247] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:24:45 2022] POST /identity/v3/projects => generated 363 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:24:45.655436 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2f3bd-3c46-49aa-9e83-1620cb6bccee admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:45.665928 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2f3bd-3c46-49aa-9e83-1620cb6bccee admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:45.721662 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cfa7a2-b88d-4c69-b010-2b58f0e901fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:45.722336 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfa7a2-b88d-4c69-b010-2b58f0e901fd admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:45.722618 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfa7a2-b88d-4c69-b010-2b58f0e901fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:45.722895 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfa7a2-b88d-4c69-b010-2b58f0e901fd admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:45.723890 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cfa7a2-b88d-4c69-b010-2b58f0e901fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:45.725844 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cfa7a2-b88d-4c69-b010-2b58f0e901fd admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:45.734386 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:45.864602 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1123/2248] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:24:45 2022] POST /identity/v3/users => generated 282 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:24:45.868695 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c4e1e-3815-42c8-80fe-1734536cec1c admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:45.879119 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c4e1e-3815-42c8-80fe-1734536cec1c admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:45.884401 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36607c4-5ba6-4738-b9a3-523046019565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:45.885064 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36607c4-5ba6-4738-b9a3-523046019565 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:45.885344 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36607c4-5ba6-4738-b9a3-523046019565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:45.885618 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36607c4-5ba6-4738-b9a3-523046019565 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:45.886337 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36607c4-5ba6-4738-b9a3-523046019565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:45.887935 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36607c4-5ba6-4738-b9a3-523046019565 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:45.889289 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:45.898990 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1126/2249] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:24:45.906170 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cfa7a2-b88d-4c69-b010-2b58f0e901fd admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:45.916486 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cfa7a2-b88d-4c69-b010-2b58f0e901fd admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:45.921296 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d6a5a-6ac4-4e8c-a8be-881a5a2980d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:45.921987 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d6a5a-6ac4-4e8c-a8be-881a5a2980d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:45.922475 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d6a5a-6ac4-4e8c-a8be-881a5a2980d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:45.922754 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d6a5a-6ac4-4e8c-a8be-881a5a2980d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:45.923472 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d6a5a-6ac4-4e8c-a8be-881a5a2980d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:45.925140 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d6a5a-6ac4-4e8c-a8be-881a5a2980d0 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:45.936453 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1124/2250] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:24:45.940592 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36607c4-5ba6-4738-b9a3-523046019565 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:45.952035 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36607c4-5ba6-4738-b9a3-523046019565 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:45.956644 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbeb1be-c420-4441-b844-ae711e35b63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:45.957649 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbeb1be-c420-4441-b844-ae711e35b63a admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:45.957870 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbeb1be-c420-4441-b844-ae711e35b63a admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:45.958150 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbeb1be-c420-4441-b844-ae711e35b63a admin admin] PATH_INFO: `/v3/projects/fd0e816503a64c78a3fd84d613778866/users/1aa445221ba1427ab7d4e1aa73dc46c8/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:45.972620 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbeb1be-c420-4441-b844-ae711e35b63a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd0e816503a64c78a3fd84d613778866, user_id=1aa445221ba1427ab7d4e1aa73dc46c8, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:45.975723 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbeb1be-c420-4441-b844-ae711e35b63a admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:46.072912 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1127/2251] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:24:45 2022] PUT /identity/v3/projects/fd0e816503a64c78a3fd84d613778866/users/1aa445221ba1427ab7d4e1aa73dc46c8/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:24:46.084133 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83dc792-c945-47bb-9a1d-6de225c22120 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:46.084484 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83dc792-c945-47bb-9a1d-6de225c22120 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:46.084762 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83dc792-c945-47bb-9a1d-6de225c22120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:46.111724 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-b83dc792-c945-47bb-9a1d-6de225c22120 None None] MFA Rules not processed for user `1aa445221ba1427ab7d4e1aa73dc46c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:24:46.113023 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-b83dc792-c945-47bb-9a1d-6de225c22120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:46.175863 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1125/2252] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:24:46 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:24:46.187820 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbeb1be-c420-4441-b844-ae711e35b63a admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:24:46.189523 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-8bbeb1be-c420-4441-b844-ae711e35b63a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:24:46.245644 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbeb1be-c420-4441-b844-ae711e35b63a admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:24:46.249154 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1782b0-b596-4b9d-9073-7a72344a0410 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:24:46.249786 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1782b0-b596-4b9d-9073-7a72344a0410 service cinder] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:24:46.250089 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1782b0-b596-4b9d-9073-7a72344a0410 service cinder] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:24:46.250364 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1782b0-b596-4b9d-9073-7a72344a0410 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:24:46.258524 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1782b0-b596-4b9d-9073-7a72344a0410 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:24:46.259948 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1782b0-b596-4b9d-9073-7a72344a0410 service cinder] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:24:46.268618 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1128/2253] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:24:46 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:24:56.173665 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:INSERT=1,keystone:SELECT=39 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:56.264704 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=38,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:25:00.073214 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83dc792-c945-47bb-9a1d-6de225c22120 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:25:00.074668 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-b83dc792-c945-47bb-9a1d-6de225c22120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:25:00.172590 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83dc792-c945-47bb-9a1d-6de225c22120 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:25:00.178118 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb36b2-f37b-4298-844d-11274fbe7707 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5c4ad16c9454b74ae8445b115cf0af4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:25:00.178766 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb36b2-f37b-4298-844d-11274fbe7707 service placement] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:00.179047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb36b2-f37b-4298-844d-11274fbe7707 service placement] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:00.179321 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb36b2-f37b-4298-844d-11274fbe7707 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:00.181248 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-5ceb36b2-f37b-4298-844d-11274fbe7707 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:25:00.193417 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceb36b2-f37b-4298-844d-11274fbe7707 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:25:00.195104 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceb36b2-f37b-4298-844d-11274fbe7707 service placement] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:25:00.206124 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1126/2254] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:25:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:25:10.201269 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=41 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:25:18.261933 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1782b0-b596-4b9d-9073-7a72344a0410 service cinder] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:25:18.263347 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-0c1782b0-b596-4b9d-9073-7a72344a0410 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:25:18.334510 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1782b0-b596-4b9d-9073-7a72344a0410 service cinder] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:25:18.339361 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49d1c9-8be0-48f7-abd8-e5677bc50f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:25:18.340317 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49d1c9-8be0-48f7-abd8-e5677bc50f02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:18.340599 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49d1c9-8be0-48f7-abd8-e5677bc50f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:18.340880 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49d1c9-8be0-48f7-abd8-e5677bc50f02 admin admin] PATH_INFO: `/v3/users/2884ac72ac8d4b47b83f94a93b9c09fc` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:18.342066 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c49d1c9-8be0-48f7-abd8-e5677bc50f02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2884ac72ac8d4b47b83f94a93b9c09fc)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:25:18.343992 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c49d1c9-8be0-48f7-abd8-e5677bc50f02 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:25:18.547831 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-4c49d1c9-8be0-48f7-abd8-e5677bc50f02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2884ac72ac8d4b47b83f94a93b9c09fc'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:25:18.560280 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-4c49d1c9-8be0-48f7-abd8-e5677bc50f02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2884ac72ac8d4b47b83f94a93b9c09fc'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:25:18.560956 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-4c49d1c9-8be0-48f7-abd8-e5677bc50f02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2884ac72ac8d4b47b83f94a93b9c09fc'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:25:18.568094 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-4c49d1c9-8be0-48f7-abd8-e5677bc50f02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2884ac72ac8d4b47b83f94a93b9c09fc'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:25:18.568806 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-4c49d1c9-8be0-48f7-abd8-e5677bc50f02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2884ac72ac8d4b47b83f94a93b9c09fc'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:25:18.677948 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1129/2255] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:25:18 2022] DELETE /identity/v3/users/2884ac72ac8d4b47b83f94a93b9c09fc => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:25:18.683217 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb231d-0ce6-4bda-9db0-81c14b2dc688 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:18.683709 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb231d-0ce6-4bda-9db0-81c14b2dc688 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:18.683803 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb231d-0ce6-4bda-9db0-81c14b2dc688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:18.703385 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-15fb231d-0ce6-4bda-9db0-81c14b2dc688 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:25:18.704640 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-15fb231d-0ce6-4bda-9db0-81c14b2dc688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:25:18.765904 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1127/2256] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:25:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:25:18.776557 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49d1c9-8be0-48f7-abd8-e5677bc50f02 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:25:18.778032 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-4c49d1c9-8be0-48f7-abd8-e5677bc50f02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:25:18.841557 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49d1c9-8be0-48f7-abd8-e5677bc50f02 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:25:18.845278 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7940787-c2ef-4ba5-aad5-fddd55d8fbba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:25:18.845918 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7940787-c2ef-4ba5-aad5-fddd55d8fbba service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:18.846197 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7940787-c2ef-4ba5-aad5-fddd55d8fbba service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:18.846511 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7940787-c2ef-4ba5-aad5-fddd55d8fbba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:18.857296 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7940787-c2ef-4ba5-aad5-fddd55d8fbba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:25:18.858789 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7940787-c2ef-4ba5-aad5-fddd55d8fbba service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:25:18.869338 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1130/2257] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:25:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:25:19.290740 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb231d-0ce6-4bda-9db0-81c14b2dc688 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:25:19.292367 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-15fb231d-0ce6-4bda-9db0-81c14b2dc688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:25:19.307086 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb231d-0ce6-4bda-9db0-81c14b2dc688 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:25:19.312310 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa224c29-a7c2-4032-9cf7-63efb96e1505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:25:19.313178 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa224c29-a7c2-4032-9cf7-63efb96e1505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:19.313461 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa224c29-a7c2-4032-9cf7-63efb96e1505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:19.313737 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa224c29-a7c2-4032-9cf7-63efb96e1505 admin admin] PATH_INFO: `/v3/projects/24ad2c4d8fe7437284627d37ce4f0fb3` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:19.315112 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa224c29-a7c2-4032-9cf7-63efb96e1505 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24ad2c4d8fe7437284627d37ce4f0fb3)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:25:19.317170 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa224c29-a7c2-4032-9cf7-63efb96e1505 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:25:19.432593 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-aa224c29-a7c2-4032-9cf7-63efb96e1505 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24ad2c4d8fe7437284627d37ce4f0fb3', 'request_id': 'req-aa224c29-a7c2-4032-9cf7-63efb96e1505'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:25:19.500577 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-aa224c29-a7c2-4032-9cf7-63efb96e1505 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24ad2c4d8fe7437284627d37ce4f0fb3', 'request_id': 'req-aa224c29-a7c2-4032-9cf7-63efb96e1505'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:25:19.515542 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-aa224c29-a7c2-4032-9cf7-63efb96e1505 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24ad2c4d8fe7437284627d37ce4f0fb3', 'request_id': 'req-aa224c29-a7c2-4032-9cf7-63efb96e1505'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:25:19.529407 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-aa224c29-a7c2-4032-9cf7-63efb96e1505 admin admin] The token cache is being invalidate because project 24ad2c4d8fe7437284627d37ce4f0fb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:25:19.529690 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-aa224c29-a7c2-4032-9cf7-63efb96e1505 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:25:19.531982 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-aa224c29-a7c2-4032-9cf7-63efb96e1505 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:25:19.533949 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1128/2258] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:25:19 2022] DELETE /identity/v3/projects/24ad2c4d8fe7437284627d37ce4f0fb3 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:25:19.539378 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061ba05-90f9-463f-8cb4-66de9119ab54 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:19.539841 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061ba05-90f9-463f-8cb4-66de9119ab54 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:19.539841 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061ba05-90f9-463f-8cb4-66de9119ab54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:19.559927 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-f061ba05-90f9-463f-8cb4-66de9119ab54 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:25:19.561187 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-f061ba05-90f9-463f-8cb4-66de9119ab54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:25:19.584728 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:25:19.641149 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1131/2259] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:25:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:25:19.649662 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f612035-54ec-4cde-bb80-04f0334994f4 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:19.650018 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f612035-54ec-4cde-bb80-04f0334994f4 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:19.650390 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f612035-54ec-4cde-bb80-04f0334994f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:19.669560 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-4f612035-54ec-4cde-bb80-04f0334994f4 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:25:19.673432 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-4f612035-54ec-4cde-bb80-04f0334994f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:25:19.679072 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1129/2260] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:25:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:25:19.683520 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061ba05-90f9-463f-8cb4-66de9119ab54 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:25:19.693430 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061ba05-90f9-463f-8cb4-66de9119ab54 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:25:19.700235 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474798da-f75a-4570-8591-bf17b8e57f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:25:19.701007 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474798da-f75a-4570-8591-bf17b8e57f0a admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:19.701292 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474798da-f75a-4570-8591-bf17b8e57f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:19.701572 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474798da-f75a-4570-8591-bf17b8e57f0a admin admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:19.702301 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474798da-f75a-4570-8591-bf17b8e57f0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:25:19.702608 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474798da-f75a-4570-8591-bf17b8e57f0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:25:19.704274 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474798da-f75a-4570-8591-bf17b8e57f0a admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:25:19.718261 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1132/2261] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:25:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:25:19.723048 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f612035-54ec-4cde-bb80-04f0334994f4 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:25:19.733252 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f612035-54ec-4cde-bb80-04f0334994f4 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:25:19.738480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8701946-dedc-43a0-a339-d1e9297f64a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:25:19.739136 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8701946-dedc-43a0-a339-d1e9297f64a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:19.739416 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8701946-dedc-43a0-a339-d1e9297f64a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:19.739732 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8701946-dedc-43a0-a339-d1e9297f64a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:19.740438 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8701946-dedc-43a0-a339-d1e9297f64a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:25:19.742446 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8701946-dedc-43a0-a339-d1e9297f64a4 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:25:19.828613 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1130/2262] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:25:19 2022] POST /identity/v3/projects => generated 369 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:25:19.829758 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474798da-f75a-4570-8591-bf17b8e57f0a admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:25:19.841657 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474798da-f75a-4570-8591-bf17b8e57f0a admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:25:19.901735 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c9528-242f-4472-9c33-d81b6812b095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:25:19.902423 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c9528-242f-4472-9c33-d81b6812b095 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:19.902724 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c9528-242f-4472-9c33-d81b6812b095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:19.903075 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c9528-242f-4472-9c33-d81b6812b095 admin admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:19.903769 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c9528-242f-4472-9c33-d81b6812b095 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:25:19.905716 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c9528-242f-4472-9c33-d81b6812b095 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:25:20.049400 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1133/2263] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:25:19 2022] POST /identity/v3/users => generated 285 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:25:20.074905 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8701946-dedc-43a0-a339-d1e9297f64a4 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:25:20.084135 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8701946-dedc-43a0-a339-d1e9297f64a4 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:25:20.089859 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa22ef1-e73e-4ec8-b9c4-6ab2baf61447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:25:20.090624 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa22ef1-e73e-4ec8-b9c4-6ab2baf61447 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:20.090942 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa22ef1-e73e-4ec8-b9c4-6ab2baf61447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:20.091217 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa22ef1-e73e-4ec8-b9c4-6ab2baf61447 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:20.091944 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa22ef1-e73e-4ec8-b9c4-6ab2baf61447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:25:20.095627 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa22ef1-e73e-4ec8-b9c4-6ab2baf61447 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:25:20.107072 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1131/2264] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:25:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:25:20.111163 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c9528-242f-4472-9c33-d81b6812b095 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:25:20.123092 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c9528-242f-4472-9c33-d81b6812b095 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:25:20.127755 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0780e-9834-45f3-b751-5e091ea96bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:25:20.128434 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0780e-9834-45f3-b751-5e091ea96bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:20.128716 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0780e-9834-45f3-b751-5e091ea96bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:20.128987 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0780e-9834-45f3-b751-5e091ea96bf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:20.129761 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad0780e-9834-45f3-b751-5e091ea96bf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:25:20.131359 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad0780e-9834-45f3-b751-5e091ea96bf0 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:25:20.142190 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1134/2265] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:25:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:25:20.146247 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa22ef1-e73e-4ec8-b9c4-6ab2baf61447 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:25:20.156578 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa22ef1-e73e-4ec8-b9c4-6ab2baf61447 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:25:20.161130 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2994379a-24ad-499f-88fe-340f9d4d01c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:25:20.162000 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994379a-24ad-499f-88fe-340f9d4d01c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:20.162281 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994379a-24ad-499f-88fe-340f9d4d01c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:20.162555 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994379a-24ad-499f-88fe-340f9d4d01c9 admin admin] PATH_INFO: `/v3/projects/4c28908b00bc460781a48826aee418a7/users/32ef923cbe984f11aacd83f6bebea57e/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:20.177992 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2994379a-24ad-499f-88fe-340f9d4d01c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c28908b00bc460781a48826aee418a7, user_id=32ef923cbe984f11aacd83f6bebea57e, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:25:20.181570 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2994379a-24ad-499f-88fe-340f9d4d01c9 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:25:20.776172 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1132/2266] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:25:20 2022] PUT /identity/v3/projects/4c28908b00bc460781a48826aee418a7/users/32ef923cbe984f11aacd83f6bebea57e/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:25:20.788521 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86cc75-d96e-4372-9004-5403527c4264 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:20.788974 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86cc75-d96e-4372-9004-5403527c4264 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:20.789121 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86cc75-d96e-4372-9004-5403527c4264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:20.815540 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-1f86cc75-d96e-4372-9004-5403527c4264 None None] MFA Rules not processed for user `32ef923cbe984f11aacd83f6bebea57e`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:25:20.816778 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-1f86cc75-d96e-4372-9004-5403527c4264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:25:20.886638 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1135/2267] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:25:20 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:25:20.948105 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2994379a-24ad-499f-88fe-340f9d4d01c9 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:25:20.949821 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-2994379a-24ad-499f-88fe-340f9d4d01c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:25:20.972248 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:25:21.011273 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2994379a-24ad-499f-88fe-340f9d4d01c9 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:25:21.018070 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd775999-1f38-47ad-ba71-326144e00d98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:25:21.018070 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd775999-1f38-47ad-ba71-326144e00d98 service cinder] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:21.018070 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd775999-1f38-47ad-ba71-326144e00d98 service cinder] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:21.018070 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd775999-1f38-47ad-ba71-326144e00d98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:21.025502 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd775999-1f38-47ad-ba71-326144e00d98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:25:21.026931 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd775999-1f38-47ad-ba71-326144e00d98 service cinder] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:25:21.035616 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1133/2268] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:25:20 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:25:24.335862 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157778c-778f-457f-961a-f22c000bff9d None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:24.337277 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157778c-778f-457f-961a-f22c000bff9d None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:24.337277 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157778c-778f-457f-961a-f22c000bff9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:24.356390 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-8157778c-778f-457f-961a-f22c000bff9d None None] MFA Rules not processed for user `32ef923cbe984f11aacd83f6bebea57e`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:25:24.357664 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-8157778c-778f-457f-961a-f22c000bff9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:25:24.364641 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1136/2269] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:25:24 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:25:31.332354 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=17 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:25:34.349972 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:25:41.543653 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee727453-0672-461b-ba70-de99f01535bf None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:41.544136 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee727453-0672-461b-ba70-de99f01535bf None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:41.544269 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee727453-0672-461b-ba70-de99f01535bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:41.594671 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-ee727453-0672-461b-ba70-de99f01535bf None None] MFA Rules not processed for user `06c55d0ea52f40ae9125d2efe1d159a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:25:41.595997 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-ee727453-0672-461b-ba70-de99f01535bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:25:41.667363 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1134/2270] 10.222.0.61 () {58 vars in 1009 bytes} [Fri Jun 3 13:25:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:25:41.709124 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157778c-778f-457f-961a-f22c000bff9d None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:25:41.710566 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-8157778c-778f-457f-961a-f22c000bff9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:25:41.811586 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157778c-778f-457f-961a-f22c000bff9d None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:25:41.816875 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4257d85-92c8-4a33-9b24-79b6b5bbfa74 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07ad3dd7477497ea25c2a01bff35712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:25:41.817533 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4257d85-92c8-4a33-9b24-79b6b5bbfa74 service swift] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:41.817820 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4257d85-92c8-4a33-9b24-79b6b5bbfa74 service swift] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:41.818096 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4257d85-92c8-4a33-9b24-79b6b5bbfa74 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:41.829086 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4257d85-92c8-4a33-9b24-79b6b5bbfa74 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:25:41.831057 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4257d85-92c8-4a33-9b24-79b6b5bbfa74 service swift] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:25:41.842738 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1137/2271] 10.222.0.61 () {60 vars in 1384 bytes} [Fri Jun 3 13:25:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 13:25:45.932876 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee727453-0672-461b-ba70-de99f01535bf None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:25:45.934393 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-ee727453-0672-461b-ba70-de99f01535bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:25:46.027283 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee727453-0672-461b-ba70-de99f01535bf None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:25:46.031748 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf77d6b-b7d3-411d-8ecf-81c93a46a61d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:25:46.032434 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf77d6b-b7d3-411d-8ecf-81c93a46a61d service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:46.032723 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf77d6b-b7d3-411d-8ecf-81c93a46a61d service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:46.033149 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf77d6b-b7d3-411d-8ecf-81c93a46a61d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:46.035061 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-adf77d6b-b7d3-411d-8ecf-81c93a46a61d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:25:46.115824 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf77d6b-b7d3-411d-8ecf-81c93a46a61d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:25:46.117300 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf77d6b-b7d3-411d-8ecf-81c93a46a61d service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:25:46.128495 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1135/2272] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:25:45 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:25:51.837049 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=41 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:25:54.567695 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505668c-6a63-4019-b0d8-e90f10d32391 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:54.568849 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505668c-6a63-4019-b0d8-e90f10d32391 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:54.569302 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505668c-6a63-4019-b0d8-e90f10d32391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:54.610980 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-7505668c-6a63-4019-b0d8-e90f10d32391 None None] MFA Rules not processed for user `06c55d0ea52f40ae9125d2efe1d159a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:25:54.614217 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-7505668c-6a63-4019-b0d8-e90f10d32391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:25:54.625494 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1138/2273] 10.222.0.61 () {58 vars in 1009 bytes} [Fri Jun 3 13:25:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:25:54.673942 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf77d6b-b7d3-411d-8ecf-81c93a46a61d service neutron] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:25:54.693965 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf77d6b-b7d3-411d-8ecf-81c93a46a61d service neutron] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:25:54.713104 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33333c-7780-4a3d-8c88-f92d0297ca17 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07ad3dd7477497ea25c2a01bff35712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:25:54.714380 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33333c-7780-4a3d-8c88-f92d0297ca17 service swift] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:54.714913 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33333c-7780-4a3d-8c88-f92d0297ca17 service swift] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:54.715700 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33333c-7780-4a3d-8c88-f92d0297ca17 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:54.740262 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f33333c-7780-4a3d-8c88-f92d0297ca17 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:25:54.742353 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f33333c-7780-4a3d-8c88-f92d0297ca17 service swift] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:25:54.753445 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1136/2274] 10.222.0.61 () {60 vars in 1384 bytes} [Fri Jun 3 13:25:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 13:25:56.062683 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01915114-1041-4c14-a6f9-55278248c8dd None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:56.063160 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01915114-1041-4c14-a6f9-55278248c8dd None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:56.063260 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01915114-1041-4c14-a6f9-55278248c8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:56.085934 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-01915114-1041-4c14-a6f9-55278248c8dd None None] MFA Rules not processed for user `06c55d0ea52f40ae9125d2efe1d159a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:25:56.089867 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-01915114-1041-4c14-a6f9-55278248c8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:25:56.099860 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1139/2275] 10.222.0.61 () {58 vars in 967 bytes} [Fri Jun 3 13:25:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:25:56.115913 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33333c-7780-4a3d-8c88-f92d0297ca17 service swift] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:25:56.137403 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33333c-7780-4a3d-8c88-f92d0297ca17 service swift] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:25:56.142818 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dbfbab-0b72-4605-a1a6-b715c94b5810 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07ad3dd7477497ea25c2a01bff35712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:25:56.143556 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbfbab-0b72-4605-a1a6-b715c94b5810 service swift] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:56.143920 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbfbab-0b72-4605-a1a6-b715c94b5810 service swift] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:56.144297 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbfbab-0b72-4605-a1a6-b715c94b5810 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:56.152213 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:25:56.156125 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dbfbab-0b72-4605-a1a6-b715c94b5810 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:25:56.158660 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dbfbab-0b72-4605-a1a6-b715c94b5810 service swift] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:25:56.175391 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1137/2276] 10.222.0.61 () {60 vars in 1384 bytes} [Fri Jun 3 13:25:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 03 13:25:57.595131 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a9c59-2cee-49e9-b268-9208c78e858c None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:57.595776 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a9c59-2cee-49e9-b268-9208c78e858c None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:57.595901 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a9c59-2cee-49e9-b268-9208c78e858c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:57.627417 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-6e6a9c59-2cee-49e9-b268-9208c78e858c None None] MFA Rules not processed for user `06c55d0ea52f40ae9125d2efe1d159a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:25:57.629270 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-6e6a9c59-2cee-49e9-b268-9208c78e858c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:25:57.640430 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1140/2277] 10.222.0.61 () {58 vars in 1009 bytes} [Fri Jun 3 13:25:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:25:57.654449 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dbfbab-0b72-4605-a1a6-b715c94b5810 service swift] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:25:57.670093 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dbfbab-0b72-4605-a1a6-b715c94b5810 service swift] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:25:57.690879 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ff881-2306-45c3-a87d-30765bd49f6a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07ad3dd7477497ea25c2a01bff35712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:25:57.691558 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ff881-2306-45c3-a87d-30765bd49f6a service swift] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:57.691845 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ff881-2306-45c3-a87d-30765bd49f6a service swift] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:57.693772 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ff881-2306-45c3-a87d-30765bd49f6a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:57.704129 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ff881-2306-45c3-a87d-30765bd49f6a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:25:57.705887 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ff881-2306-45c3-a87d-30765bd49f6a service swift] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:25:57.717301 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1138/2278] 10.222.0.61 () {60 vars in 1384 bytes} [Fri Jun 3 13:25:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 13:25:58.558803 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eaa4df-48b0-4151-be9f-ebf809863920 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:58.559335 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eaa4df-48b0-4151-be9f-ebf809863920 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:58.559787 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eaa4df-48b0-4151-be9f-ebf809863920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:58.585580 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-f9eaa4df-48b0-4151-be9f-ebf809863920 None None] MFA Rules not processed for user `06c55d0ea52f40ae9125d2efe1d159a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:25:58.586809 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-f9eaa4df-48b0-4151-be9f-ebf809863920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:25:58.594893 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1141/2279] 10.222.0.61 () {58 vars in 967 bytes} [Fri Jun 3 13:25:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:25:58.608078 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ff881-2306-45c3-a87d-30765bd49f6a service swift] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:25:58.618734 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ff881-2306-45c3-a87d-30765bd49f6a service swift] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:25:58.624055 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d1fb7-9849-4546-b7b4-6903ca3b085d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07ad3dd7477497ea25c2a01bff35712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:25:58.635098 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d1fb7-9849-4546-b7b4-6903ca3b085d service swift] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:58.635098 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d1fb7-9849-4546-b7b4-6903ca3b085d service swift] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:58.635098 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d1fb7-9849-4546-b7b4-6903ca3b085d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:58.635098 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d1fb7-9849-4546-b7b4-6903ca3b085d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:25:58.635995 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d1fb7-9849-4546-b7b4-6903ca3b085d service swift] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:25:58.644409 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1139/2280] 10.222.0.61 () {60 vars in 1384 bytes} [Fri Jun 3 13:25:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 13:25:58.769078 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eaa4df-48b0-4151-be9f-ebf809863920 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:25:58.770489 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-f9eaa4df-48b0-4151-be9f-ebf809863920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:25:58.842789 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eaa4df-48b0-4151-be9f-ebf809863920 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:25:58.847553 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a9818-41f0-4f0e-9052-0df379d7c131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:25:58.848446 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a9818-41f0-4f0e-9052-0df379d7c131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:58.848732 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a9818-41f0-4f0e-9052-0df379d7c131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:58.849008 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a9818-41f0-4f0e-9052-0df379d7c131 admin admin] PATH_INFO: `/v3/users/1aa445221ba1427ab7d4e1aa73dc46c8` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:58.850222 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5a9818-41f0-4f0e-9052-0df379d7c131 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aa445221ba1427ab7d4e1aa73dc46c8)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:25:58.852167 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5a9818-41f0-4f0e-9052-0df379d7c131 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:25:58.856447 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94456daf-8874-4c72-85d9-b9b9ffb83038 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:58.857294 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94456daf-8874-4c72-85d9-b9b9ffb83038 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:58.857742 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94456daf-8874-4c72-85d9-b9b9ffb83038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:58.879648 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-94456daf-8874-4c72-85d9-b9b9ffb83038 None None] MFA Rules not processed for user `267a2b59a70245dfb7ec1b779f7fdd51`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:25:58.883051 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-94456daf-8874-4c72-85d9-b9b9ffb83038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:25:58.944286 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1140/2281] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:25:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:25:59.227392 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-4a5a9818-41f0-4f0e-9052-0df379d7c131 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aa445221ba1427ab7d4e1aa73dc46c8'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:25:59.246638 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-4a5a9818-41f0-4f0e-9052-0df379d7c131 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aa445221ba1427ab7d4e1aa73dc46c8'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:25:59.247377 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-4a5a9818-41f0-4f0e-9052-0df379d7c131 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aa445221ba1427ab7d4e1aa73dc46c8'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:25:59.254920 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-4a5a9818-41f0-4f0e-9052-0df379d7c131 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aa445221ba1427ab7d4e1aa73dc46c8'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:25:59.255763 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-4a5a9818-41f0-4f0e-9052-0df379d7c131 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aa445221ba1427ab7d4e1aa73dc46c8'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:25:59.332465 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1142/2282] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:25:58 2022] DELETE /identity/v3/users/1aa445221ba1427ab7d4e1aa73dc46c8 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:25:59.337193 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d2d43-7ee5-4b64-8b5b-3c28a6e4d74f None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:59.345204 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d2d43-7ee5-4b64-8b5b-3c28a6e4d74f None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:59.345204 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d2d43-7ee5-4b64-8b5b-3c28a6e4d74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:59.366637 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-f26d2d43-7ee5-4b64-8b5b-3c28a6e4d74f None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:25:59.367942 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-f26d2d43-7ee5-4b64-8b5b-3c28a6e4d74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:25:59.479747 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1141/2283] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:25:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:25:59.491747 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a9818-41f0-4f0e-9052-0df379d7c131 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:25:59.501126 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-4a5a9818-41f0-4f0e-9052-0df379d7c131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:25:59.604630 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a9818-41f0-4f0e-9052-0df379d7c131 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:25:59.608723 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143be85-90b0-46b4-a382-5a1c8f4c09b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:25:59.609379 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143be85-90b0-46b4-a382-5a1c8f4c09b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:25:59.609665 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143be85-90b0-46b4-a382-5a1c8f4c09b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:25:59.609941 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143be85-90b0-46b4-a382-5a1c8f4c09b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:25:59.617441 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:25:59.620098 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6143be85-90b0-46b4-a382-5a1c8f4c09b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:25:59.621723 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6143be85-90b0-46b4-a382-5a1c8f4c09b5 service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:25:59.631784 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1143/2284] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:25:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:26:00.079432 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d2d43-7ee5-4b64-8b5b-3c28a6e4d74f None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:26:00.080874 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-f26d2d43-7ee5-4b64-8b5b-3c28a6e4d74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:26:00.095386 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d2d43-7ee5-4b64-8b5b-3c28a6e4d74f None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:26:00.101155 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff94da4-a9c1-4bf0-bede-d502215d871f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:26:00.102468 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff94da4-a9c1-4bf0-bede-d502215d871f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:26:00.102468 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff94da4-a9c1-4bf0-bede-d502215d871f admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:26:00.102686 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff94da4-a9c1-4bf0-bede-d502215d871f admin admin] PATH_INFO: `/v3/projects/fd0e816503a64c78a3fd84d613778866` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:26:00.105051 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff94da4-a9c1-4bf0-bede-d502215d871f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd0e816503a64c78a3fd84d613778866)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:26:00.106979 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff94da4-a9c1-4bf0-bede-d502215d871f admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:26:00.268029 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-6ff94da4-a9c1-4bf0-bede-d502215d871f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd0e816503a64c78a3fd84d613778866', 'request_id': 'req-6ff94da4-a9c1-4bf0-bede-d502215d871f'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:26:00.356788 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-6ff94da4-a9c1-4bf0-bede-d502215d871f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd0e816503a64c78a3fd84d613778866', 'request_id': 'req-6ff94da4-a9c1-4bf0-bede-d502215d871f'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:26:00.363243 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-6ff94da4-a9c1-4bf0-bede-d502215d871f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd0e816503a64c78a3fd84d613778866', 'request_id': 'req-6ff94da4-a9c1-4bf0-bede-d502215d871f'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:26:00.371788 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:26:00.376758 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-6ff94da4-a9c1-4bf0-bede-d502215d871f admin admin] The token cache is being invalidate because project fd0e816503a64c78a3fd84d613778866 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:26:00.377049 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-6ff94da4-a9c1-4bf0-bede-d502215d871f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:26:00.377725 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-6ff94da4-a9c1-4bf0-bede-d502215d871f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:26:00.386424 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1142/2285] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:26:00 2022] DELETE /identity/v3/projects/fd0e816503a64c78a3fd84d613778866 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:26:01.608859 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143be85-90b0-46b4-a382-5a1c8f4c09b5 service neutron] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:26:01.610336 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-6143be85-90b0-46b4-a382-5a1c8f4c09b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:26:01.623797 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143be85-90b0-46b4-a382-5a1c8f4c09b5 service neutron] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:26:01.678669 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9148a1-4e70-47a6-882c-87a8afd0acf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:26:01.679526 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9148a1-4e70-47a6-882c-87a8afd0acf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:26:01.679807 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9148a1-4e70-47a6-882c-87a8afd0acf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:26:01.680083 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9148a1-4e70-47a6-882c-87a8afd0acf7 admin admin] PATH_INFO: `/v3/users/32ef923cbe984f11aacd83f6bebea57e` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:26:01.681893 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9148a1-4e70-47a6-882c-87a8afd0acf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32ef923cbe984f11aacd83f6bebea57e)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:26:01.683943 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9148a1-4e70-47a6-882c-87a8afd0acf7 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:26:01.899708 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-cd9148a1-4e70-47a6-882c-87a8afd0acf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32ef923cbe984f11aacd83f6bebea57e'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:26:01.913297 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-cd9148a1-4e70-47a6-882c-87a8afd0acf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32ef923cbe984f11aacd83f6bebea57e'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:26:01.914620 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-cd9148a1-4e70-47a6-882c-87a8afd0acf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32ef923cbe984f11aacd83f6bebea57e'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:26:01.921432 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-cd9148a1-4e70-47a6-882c-87a8afd0acf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32ef923cbe984f11aacd83f6bebea57e'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:26:01.922229 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-cd9148a1-4e70-47a6-882c-87a8afd0acf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32ef923cbe984f11aacd83f6bebea57e'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:26:02.008698 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1144/2286] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:26:01 2022] DELETE /identity/v3/users/32ef923cbe984f11aacd83f6bebea57e => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:26:02.015031 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae6d9a-92b1-413f-96a7-e53817300627 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:26:02.015577 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae6d9a-92b1-413f-96a7-e53817300627 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:26:02.015577 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae6d9a-92b1-413f-96a7-e53817300627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:26:02.036859 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-5bae6d9a-92b1-413f-96a7-e53817300627 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:26:02.037994 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-5bae6d9a-92b1-413f-96a7-e53817300627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:26:02.099383 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1143/2287] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:26:02.109710 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9148a1-4e70-47a6-882c-87a8afd0acf7 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:26:02.111115 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-cd9148a1-4e70-47a6-882c-87a8afd0acf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:26:02.169506 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9148a1-4e70-47a6-882c-87a8afd0acf7 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:26:02.173109 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf8e751-469f-4749-abdc-0c06087b6156 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:26:02.173751 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8e751-469f-4749-abdc-0c06087b6156 service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:26:02.174035 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8e751-469f-4749-abdc-0c06087b6156 service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:26:02.174309 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8e751-469f-4749-abdc-0c06087b6156 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:26:02.184026 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf8e751-469f-4749-abdc-0c06087b6156 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:26:02.185542 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf8e751-469f-4749-abdc-0c06087b6156 service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:26:02.194989 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1145/2288] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:26:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:26:02.461271 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bae6d9a-92b1-413f-96a7-e53817300627 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:26:02.463937 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-5bae6d9a-92b1-413f-96a7-e53817300627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:26:02.477702 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bae6d9a-92b1-413f-96a7-e53817300627 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:26:02.483181 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfdf701-b41d-40dc-a51d-4403ea29f220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:26:02.484115 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfdf701-b41d-40dc-a51d-4403ea29f220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:26:02.484522 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfdf701-b41d-40dc-a51d-4403ea29f220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:26:02.484920 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfdf701-b41d-40dc-a51d-4403ea29f220 admin admin] PATH_INFO: `/v3/projects/4c28908b00bc460781a48826aee418a7` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:26:02.486374 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfdf701-b41d-40dc-a51d-4403ea29f220 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c28908b00bc460781a48826aee418a7)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:26:02.488323 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfdf701-b41d-40dc-a51d-4403ea29f220 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:26:02.622947 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-adfdf701-b41d-40dc-a51d-4403ea29f220 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c28908b00bc460781a48826aee418a7', 'request_id': 'req-adfdf701-b41d-40dc-a51d-4403ea29f220'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:26:02.739975 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-adfdf701-b41d-40dc-a51d-4403ea29f220 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c28908b00bc460781a48826aee418a7', 'request_id': 'req-adfdf701-b41d-40dc-a51d-4403ea29f220'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:26:02.747435 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-adfdf701-b41d-40dc-a51d-4403ea29f220 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c28908b00bc460781a48826aee418a7', 'request_id': 'req-adfdf701-b41d-40dc-a51d-4403ea29f220'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:26:02.760029 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-adfdf701-b41d-40dc-a51d-4403ea29f220 admin admin] The token cache is being invalidate because project 4c28908b00bc460781a48826aee418a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:26:02.760402 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-adfdf701-b41d-40dc-a51d-4403ea29f220 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:26:02.761174 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-adfdf701-b41d-40dc-a51d-4403ea29f220 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:26:02.763258 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1144/2289] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:26:02 2022] DELETE /identity/v3/projects/4c28908b00bc460781a48826aee418a7 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:26:02.768349 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04dd9a-844d-4e88-8bc9-bfd0a647de86 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:26:02.768834 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04dd9a-844d-4e88-8bc9-bfd0a647de86 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:26:02.768919 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04dd9a-844d-4e88-8bc9-bfd0a647de86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:26:02.788566 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-7c04dd9a-844d-4e88-8bc9-bfd0a647de86 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:26:02.794469 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-7c04dd9a-844d-4e88-8bc9-bfd0a647de86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:26:02.802178 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:26:02.850172 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1146/2290] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:26:02.858116 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669ebd9-947e-4980-a2d8-a9e210c3dff2 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:26:02.858765 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669ebd9-947e-4980-a2d8-a9e210c3dff2 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:26:02.859213 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669ebd9-947e-4980-a2d8-a9e210c3dff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:26:02.878886 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-d669ebd9-947e-4980-a2d8-a9e210c3dff2 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:26:02.880103 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-d669ebd9-947e-4980-a2d8-a9e210c3dff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:26:02.888687 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1145/2291] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:26:02.892959 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04dd9a-844d-4e88-8bc9-bfd0a647de86 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:26:02.903702 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04dd9a-844d-4e88-8bc9-bfd0a647de86 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:26:02.915874 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4002bb7-fee7-4276-a5d5-98663aa6a684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:26:02.915874 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4002bb7-fee7-4276-a5d5-98663aa6a684 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:26:02.915874 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4002bb7-fee7-4276-a5d5-98663aa6a684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:26:02.915874 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4002bb7-fee7-4276-a5d5-98663aa6a684 admin admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:26:02.916304 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4002bb7-fee7-4276-a5d5-98663aa6a684 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:26:02.916304 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4002bb7-fee7-4276-a5d5-98663aa6a684 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:26:02.916304 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4002bb7-fee7-4276-a5d5-98663aa6a684 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:26:02.927402 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1147/2292] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:26:02.928550 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669ebd9-947e-4980-a2d8-a9e210c3dff2 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:26:02.938008 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669ebd9-947e-4980-a2d8-a9e210c3dff2 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:26:02.942591 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b06cbc-a36e-41ed-aa7a-c1631e647a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:26:02.943237 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b06cbc-a36e-41ed-aa7a-c1631e647a60 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:26:02.943520 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b06cbc-a36e-41ed-aa7a-c1631e647a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:26:02.943809 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b06cbc-a36e-41ed-aa7a-c1631e647a60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:26:02.944558 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b06cbc-a36e-41ed-aa7a-c1631e647a60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:26:02.946467 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b06cbc-a36e-41ed-aa7a-c1631e647a60 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:26:03.076969 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1146/2293] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:26:02 2022] POST /identity/v3/projects => generated 377 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:26:03.079521 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4002bb7-fee7-4276-a5d5-98663aa6a684 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:26:03.092071 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4002bb7-fee7-4276-a5d5-98663aa6a684 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:26:03.155236 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8de0d-dc18-4a93-bfda-91d21f58b31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:26:03.155947 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8de0d-dc18-4a93-bfda-91d21f58b31b admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:26:03.156340 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8de0d-dc18-4a93-bfda-91d21f58b31b admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:26:03.156630 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8de0d-dc18-4a93-bfda-91d21f58b31b admin admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:26:03.157297 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d8de0d-dc18-4a93-bfda-91d21f58b31b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:26:03.159314 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d8de0d-dc18-4a93-bfda-91d21f58b31b admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:26:03.277067 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1148/2294] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:26:03 2022] POST /identity/v3/users => generated 289 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:26:03.281287 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b06cbc-a36e-41ed-aa7a-c1631e647a60 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:26:03.291453 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b06cbc-a36e-41ed-aa7a-c1631e647a60 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:26:03.296011 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af87b7-4a1a-4ee5-a972-da0dcae2ec6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:26:03.296681 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af87b7-4a1a-4ee5-a972-da0dcae2ec6b admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:26:03.296963 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af87b7-4a1a-4ee5-a972-da0dcae2ec6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:26:03.297258 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af87b7-4a1a-4ee5-a972-da0dcae2ec6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:26:03.297948 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af87b7-4a1a-4ee5-a972-da0dcae2ec6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:26:03.299510 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af87b7-4a1a-4ee5-a972-da0dcae2ec6b admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:26:03.311983 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1147/2295] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:26:03.317387 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8de0d-dc18-4a93-bfda-91d21f58b31b admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:26:03.327795 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8de0d-dc18-4a93-bfda-91d21f58b31b admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:26:03.332847 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be41f62-0b80-4cd9-8e6e-8a7276795857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:26:03.333645 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be41f62-0b80-4cd9-8e6e-8a7276795857 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:26:03.333996 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be41f62-0b80-4cd9-8e6e-8a7276795857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:26:03.334281 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be41f62-0b80-4cd9-8e6e-8a7276795857 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:26:03.335012 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be41f62-0b80-4cd9-8e6e-8a7276795857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:26:03.336698 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be41f62-0b80-4cd9-8e6e-8a7276795857 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:26:03.351468 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1149/2296] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:26:03.353342 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af87b7-4a1a-4ee5-a972-da0dcae2ec6b admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:26:03.364872 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af87b7-4a1a-4ee5-a972-da0dcae2ec6b admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:26:03.370107 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad9ec79-6e51-45ca-932c-69fbd7f07d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:26:03.370985 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9ec79-6e51-45ca-932c-69fbd7f07d7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:26:03.371269 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9ec79-6e51-45ca-932c-69fbd7f07d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:26:03.372568 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9ec79-6e51-45ca-932c-69fbd7f07d7d admin admin] PATH_INFO: `/v3/projects/c880a17cc9844081bee38006d5b92f86/users/77c56945d1d74a1eaa5e0c8f9e43f086/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:26:03.386972 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad9ec79-6e51-45ca-932c-69fbd7f07d7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c880a17cc9844081bee38006d5b92f86, user_id=77c56945d1d74a1eaa5e0c8f9e43f086, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:26:03.389662 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad9ec79-6e51-45ca-932c-69fbd7f07d7d admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:26:03.517485 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1148/2297] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:26:03 2022] PUT /identity/v3/projects/c880a17cc9844081bee38006d5b92f86/users/77c56945d1d74a1eaa5e0c8f9e43f086/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:26:03.522915 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc82c1-895f-4a96-a0cd-2bddc1c0952e None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:26:03.523207 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc82c1-895f-4a96-a0cd-2bddc1c0952e None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:26:03.523510 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc82c1-895f-4a96-a0cd-2bddc1c0952e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:26:03.542183 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-0cdc82c1-895f-4a96-a0cd-2bddc1c0952e None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:26:03.543389 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-0cdc82c1-895f-4a96-a0cd-2bddc1c0952e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:26:03.615956 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1150/2298] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:26:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:26:03.627109 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad9ec79-6e51-45ca-932c-69fbd7f07d7d admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:26:03.628830 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-9ad9ec79-6e51-45ca-932c-69fbd7f07d7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:26:03.649927 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:26:03.688975 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad9ec79-6e51-45ca-932c-69fbd7f07d7d admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:26:03.696007 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f022b0e0-090e-4d3e-a4d3-50f401e4af7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:26:03.697579 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022b0e0-090e-4d3e-a4d3-50f401e4af7e service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:26:03.698073 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022b0e0-090e-4d3e-a4d3-50f401e4af7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:26:03.698720 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022b0e0-090e-4d3e-a4d3-50f401e4af7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:26:03.714987 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f022b0e0-090e-4d3e-a4d3-50f401e4af7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:26:03.716519 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f022b0e0-090e-4d3e-a4d3-50f401e4af7e service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:26:03.726804 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1149/2299] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:26:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:26:04.873312 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4b289-52ed-45e3-9216-aa02d2b40251 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:26:04.873846 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4b289-52ed-45e3-9216-aa02d2b40251 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:26:04.874165 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4b289-52ed-45e3-9216-aa02d2b40251 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:26:04.875635 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1151/2300] 10.222.0.61 () {54 vars in 921 bytes} [Fri Jun 3 13:26:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:26:04.881774 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a83a10-d9f8-4267-a8d6-a9f247797c79 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:26:04.882280 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a83a10-d9f8-4267-a8d6-a9f247797c79 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:26:04.882390 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a83a10-d9f8-4267-a8d6-a9f247797c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:26:04.935880 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-50a83a10-d9f8-4267-a8d6-a9f247797c79 None None] MFA Rules not processed for user `066aaba3e9af4f85ab0cba89a3d32e34`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:26:04.937212 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-50a83a10-d9f8-4267-a8d6-a9f247797c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:26:05.028649 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1150/2301] 10.222.0.61 () {58 vars in 1018 bytes} [Fri Jun 3 13:26:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:26:05.040622 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4b289-52ed-45e3-9216-aa02d2b40251 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:26:05.042437 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-80c4b289-52ed-45e3-9216-aa02d2b40251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:26:05.069695 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:26:05.125031 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4b289-52ed-45e3-9216-aa02d2b40251 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:26:05.128819 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf44cc3-8898-486c-b0f4-4fda6d57f353 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60eeb0b3e37a4604ab8f8b73c2b021f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:26:05.129471 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf44cc3-8898-486c-b0f4-4fda6d57f353 service glance] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:26:05.129759 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf44cc3-8898-486c-b0f4-4fda6d57f353 service glance] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:26:05.130047 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf44cc3-8898-486c-b0f4-4fda6d57f353 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:26:05.141384 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf44cc3-8898-486c-b0f4-4fda6d57f353 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:26:05.142839 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf44cc3-8898-486c-b0f4-4fda6d57f353 service glance] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:26:05.154983 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1152/2302] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:26:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:26:05.392859 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f96d05-63c1-4fb1-96a0-aea348245e12 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:26:05.393170 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f96d05-63c1-4fb1-96a0-aea348245e12 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:26:05.393799 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f96d05-63c1-4fb1-96a0-aea348245e12 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:26:05.395005 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1151/2303] 10.222.0.61 () {54 vars in 921 bytes} [Fri Jun 3 13:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:26:05.400721 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba36489-8d1b-41eb-a825-9747593e5427 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:26:05.403022 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba36489-8d1b-41eb-a825-9747593e5427 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:26:05.403022 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba36489-8d1b-41eb-a825-9747593e5427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:26:05.427138 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-8ba36489-8d1b-41eb-a825-9747593e5427 None None] MFA Rules not processed for user `bdb5b24bd01c405c93e32ab4b329bcf1`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:26:05.428615 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-8ba36489-8d1b-41eb-a825-9747593e5427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:26:05.442904 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1153/2304] 10.222.0.61 () {58 vars in 1018 bytes} [Fri Jun 3 13:26:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:26:05.452285 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f96d05-63c1-4fb1-96a0-aea348245e12 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:26:05.468941 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f96d05-63c1-4fb1-96a0-aea348245e12 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:26:05.473119 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969abba7-3491-4a7f-9737-4637dbc92513 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:26:05.473834 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969abba7-3491-4a7f-9737-4637dbc92513 service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:26:05.474188 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969abba7-3491-4a7f-9737-4637dbc92513 service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:26:05.474987 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969abba7-3491-4a7f-9737-4637dbc92513 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:26:05.483333 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969abba7-3491-4a7f-9737-4637dbc92513 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:26:05.485154 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969abba7-3491-4a7f-9737-4637dbc92513 service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:26:05.496710 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1152/2305] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:26:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:26:05.921751 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44d719-cf43-45db-8678-4e4ed079913c None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:26:05.923174 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44d719-cf43-45db-8678-4e4ed079913c None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:26:05.923694 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44d719-cf43-45db-8678-4e4ed079913c None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:26:05.927657 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1154/2306] 10.222.0.61 () {54 vars in 921 bytes} [Fri Jun 3 13:26:05 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:26:05.935326 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f66798-3458-4221-88c0-b186b0a0d472 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:26:05.935835 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f66798-3458-4221-88c0-b186b0a0d472 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:26:05.936179 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f66798-3458-4221-88c0-b186b0a0d472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:26:05.956636 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-34f66798-3458-4221-88c0-b186b0a0d472 None None] MFA Rules not processed for user `066aaba3e9af4f85ab0cba89a3d32e34`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:26:05.958425 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-34f66798-3458-4221-88c0-b186b0a0d472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:26:05.970458 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1153/2307] 10.222.0.61 () {58 vars in 1018 bytes} [Fri Jun 3 13:26:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:26:05.982117 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44d719-cf43-45db-8678-4e4ed079913c None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:26:05.983884 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-bd44d719-cf43-45db-8678-4e4ed079913c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:26:06.009970 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44d719-cf43-45db-8678-4e4ed079913c None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:26:06.015527 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84310915-e529-4fe3-a705-89c1d78d2130 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:26:06.016237 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84310915-e529-4fe3-a705-89c1d78d2130 service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:26:06.016514 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84310915-e529-4fe3-a705-89c1d78d2130 service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:26:06.016976 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84310915-e529-4fe3-a705-89c1d78d2130 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:26:06.035627 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84310915-e529-4fe3-a705-89c1d78d2130 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:26:06.038715 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84310915-e529-4fe3-a705-89c1d78d2130 service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:26:06.061809 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1155/2308] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:26:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:26:10.677693 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288b12a-e484-48cf-b112-83e2d2d85b04 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:26:10.678258 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288b12a-e484-48cf-b112-83e2d2d85b04 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:26:10.678390 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288b12a-e484-48cf-b112-83e2d2d85b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:26:10.710329 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-3288b12a-e484-48cf-b112-83e2d2d85b04 None None] MFA Rules not processed for user `77c56945d1d74a1eaa5e0c8f9e43f086`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:26:10.711781 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-3288b12a-e484-48cf-b112-83e2d2d85b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:26:10.780882 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:26:10.805170 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1154/2309] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:26:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:26:10.811100 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84310915-e529-4fe3-a705-89c1d78d2130 service neutron] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:26:10.825899 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84310915-e529-4fe3-a705-89c1d78d2130 service neutron] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:26:10.830801 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b18540c-8bfb-4b90-9626-8b9a2fbab4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:26:10.831546 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b18540c-8bfb-4b90-9626-8b9a2fbab4e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:26:10.831885 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b18540c-8bfb-4b90-9626-8b9a2fbab4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:26:10.832228 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b18540c-8bfb-4b90-9626-8b9a2fbab4e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:26:10.832865 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b18540c-8bfb-4b90-9626-8b9a2fbab4e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:26:10.834967 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b18540c-8bfb-4b90-9626-8b9a2fbab4e1 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:26:10.956780 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1156/2310] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:26:10 2022] POST /identity/v3/projects => generated 377 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:26:10.960831 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288b12a-e484-48cf-b112-83e2d2d85b04 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:26:10.972349 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288b12a-e484-48cf-b112-83e2d2d85b04 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:26:11.039427 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f0e658-47e3-415b-a8a8-297f23edad95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:26:11.040342 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0e658-47e3-415b-a8a8-297f23edad95 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:26:11.040630 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0e658-47e3-415b-a8a8-297f23edad95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:26:11.043501 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0e658-47e3-415b-a8a8-297f23edad95 admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:26:11.043501 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f0e658-47e3-415b-a8a8-297f23edad95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:26:11.043679 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f0e658-47e3-415b-a8a8-297f23edad95 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:26:11.089025 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1155/2311] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:26:10 2022] POST /identity/v3/users => generated 295 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:26:11.093203 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b18540c-8bfb-4b90-9626-8b9a2fbab4e1 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:26:11.103986 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b18540c-8bfb-4b90-9626-8b9a2fbab4e1 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:26:11.108731 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f5d49-7fbd-4822-841d-1176fe26af7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:26:11.109570 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f5d49-7fbd-4822-841d-1176fe26af7d admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:26:11.110681 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f5d49-7fbd-4822-841d-1176fe26af7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:26:11.110961 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f5d49-7fbd-4822-841d-1176fe26af7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:26:11.111696 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f5d49-7fbd-4822-841d-1176fe26af7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:26:11.113338 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f5d49-7fbd-4822-841d-1176fe26af7d admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:26:11.125200 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1157/2312] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:26:11.129356 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f0e658-47e3-415b-a8a8-297f23edad95 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:26:11.140782 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f0e658-47e3-415b-a8a8-297f23edad95 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:26:11.145475 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34e7f3-f8e7-49fc-82f3-0e94b3a5a73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:26:11.146662 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34e7f3-f8e7-49fc-82f3-0e94b3a5a73a admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:26:11.146819 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34e7f3-f8e7-49fc-82f3-0e94b3a5a73a admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:26:11.147097 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34e7f3-f8e7-49fc-82f3-0e94b3a5a73a admin admin] PATH_INFO: `/v3/projects/6e5784114df74a6e953cc6d2cc01f508/users/aba7a12472bd458b9c81e4a18bf2f96e/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:26:11.163899 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f34e7f3-f8e7-49fc-82f3-0e94b3a5a73a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e5784114df74a6e953cc6d2cc01f508, user_id=aba7a12472bd458b9c81e4a18bf2f96e, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:26:11.166635 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f34e7f3-f8e7-49fc-82f3-0e94b3a5a73a admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:26:11.241701 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1156/2313] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:26:11 2022] PUT /identity/v3/projects/6e5784114df74a6e953cc6d2cc01f508/users/aba7a12472bd458b9c81e4a18bf2f96e/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:26:11.245800 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f5d49-7fbd-4822-841d-1176fe26af7d admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:26:11.256517 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f5d49-7fbd-4822-841d-1176fe26af7d admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:26:11.315192 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095ff817-d576-41d4-99d3-318301f27e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:26:11.315902 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ff817-d576-41d4-99d3-318301f27e28 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:26:11.316215 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ff817-d576-41d4-99d3-318301f27e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:26:11.316496 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ff817-d576-41d4-99d3-318301f27e28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:26:11.317227 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095ff817-d576-41d4-99d3-318301f27e28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:26:11.318846 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095ff817-d576-41d4-99d3-318301f27e28 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:26:11.329931 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1158/2314] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:26:11.334198 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34e7f3-f8e7-49fc-82f3-0e94b3a5a73a admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:26:11.345178 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34e7f3-f8e7-49fc-82f3-0e94b3a5a73a admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:26:11.349851 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b572df-1fff-4d4c-aca3-4c62cff055c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:26:11.350727 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b572df-1fff-4d4c-aca3-4c62cff055c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:26:11.351007 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b572df-1fff-4d4c-aca3-4c62cff055c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:26:11.351285 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b572df-1fff-4d4c-aca3-4c62cff055c7 admin admin] PATH_INFO: `/v3/projects/6e5784114df74a6e953cc6d2cc01f508/users/aba7a12472bd458b9c81e4a18bf2f96e/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:26:11.353511 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b572df-1fff-4d4c-aca3-4c62cff055c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e5784114df74a6e953cc6d2cc01f508, user_id=aba7a12472bd458b9c81e4a18bf2f96e, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:26:11.356256 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b572df-1fff-4d4c-aca3-4c62cff055c7 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:26:11.367311 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1157/2315] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:26:11 2022] PUT /identity/v3/projects/6e5784114df74a6e953cc6d2cc01f508/users/aba7a12472bd458b9c81e4a18bf2f96e/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:26:12.515411 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed0883-596f-4719-9c86-594c645b0556 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:26:12.516425 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed0883-596f-4719-9c86-594c645b0556 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:26:12.516875 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed0883-596f-4719-9c86-594c645b0556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:26:12.535089 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-c8ed0883-596f-4719-9c86-594c645b0556 None None] MFA Rules not processed for user `06c55d0ea52f40ae9125d2efe1d159a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:26:12.536352 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-c8ed0883-596f-4719-9c86-594c645b0556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:26:12.585268 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:26:12.596119 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1159/2316] 10.222.0.61 () {58 vars in 1009 bytes} [Fri Jun 3 13:26:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:26:12.608586 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b572df-1fff-4d4c-aca3-4c62cff055c7 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:26:12.610312 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-b1b572df-1fff-4d4c-aca3-4c62cff055c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:26:12.712447 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b572df-1fff-4d4c-aca3-4c62cff055c7 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:26:12.720783 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d60f3-13dd-47a6-8caf-865cff58d1d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07ad3dd7477497ea25c2a01bff35712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:26:12.721619 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d60f3-13dd-47a6-8caf-865cff58d1d5 service swift] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:26:12.722016 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d60f3-13dd-47a6-8caf-865cff58d1d5 service swift] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:26:12.722403 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d60f3-13dd-47a6-8caf-865cff58d1d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:26:12.732763 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d60f3-13dd-47a6-8caf-865cff58d1d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:26:12.735946 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d60f3-13dd-47a6-8caf-865cff58d1d5 service swift] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:26:12.745074 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1158/2317] 10.222.0.61 () {60 vars in 1384 bytes} [Fri Jun 3 13:26:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 13:26:19.533825 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6539e1-1d75-460e-9b3f-323d96dea8a0 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:26:19.534363 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6539e1-1d75-460e-9b3f-323d96dea8a0 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:26:19.534363 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6539e1-1d75-460e-9b3f-323d96dea8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:26:19.595314 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-1a6539e1-1d75-460e-9b3f-323d96dea8a0 None None] MFA Rules not processed for user `aba7a12472bd458b9c81e4a18bf2f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:26:19.599136 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-1a6539e1-1d75-460e-9b3f-323d96dea8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:26:19.750059 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1160/2318] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:26:19 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:26:19.767478 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d60f3-13dd-47a6-8caf-865cff58d1d5 service swift] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:26:19.769090 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-ed3d60f3-13dd-47a6-8caf-865cff58d1d5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:26:19.817731 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:26:19.909316 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d60f3-13dd-47a6-8caf-865cff58d1d5 service swift] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:26:19.916338 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b7b27-ca0e-4e57-94e9-a7ef06f1ce53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066aaba3e9af4f85ab0cba89a3d32e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:26:19.917107 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b7b27-ca0e-4e57-94e9-a7ef06f1ce53 service nova] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:26:19.917460 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b7b27-ca0e-4e57-94e9-a7ef06f1ce53 service nova] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:26:19.917805 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b7b27-ca0e-4e57-94e9-a7ef06f1ce53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:26:19.980124 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b7b27-ca0e-4e57-94e9-a7ef06f1ce53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:26:19.981812 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b7b27-ca0e-4e57-94e9-a7ef06f1ce53 service nova] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:26:19.992027 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1159/2319] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:26:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:26:29.745413 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=36 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:26:29.987927 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=42 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:26:43.383576 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6539e1-1d75-460e-9b3f-323d96dea8a0 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:26:43.441328 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6539e1-1d75-460e-9b3f-323d96dea8a0 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:26:43.445104 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db680049-b05b-480e-a85b-b6409fd8504a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:26:43.445783 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db680049-b05b-480e-a85b-b6409fd8504a service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:26:43.446066 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db680049-b05b-480e-a85b-b6409fd8504a service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:26:43.446392 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db680049-b05b-480e-a85b-b6409fd8504a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:26:43.448763 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-db680049-b05b-480e-a85b-b6409fd8504a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:26:43.462667 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db680049-b05b-480e-a85b-b6409fd8504a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:26:43.464891 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db680049-b05b-480e-a85b-b6409fd8504a service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:26:43.475542 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1161/2320] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:26:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:26:43.644367 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b7b27-ca0e-4e57-94e9-a7ef06f1ce53 service nova] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:26:43.655272 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b7b27-ca0e-4e57-94e9-a7ef06f1ce53 service nova] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:26:43.658925 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc733221-ab63-4d56-b05a-5836d096c514 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:26:43.659588 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc733221-ab63-4d56-b05a-5836d096c514 service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:26:43.659871 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc733221-ab63-4d56-b05a-5836d096c514 service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:26:43.660178 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc733221-ab63-4d56-b05a-5836d096c514 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:26:43.661984 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-bc733221-ab63-4d56-b05a-5836d096c514 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:26:43.676304 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc733221-ab63-4d56-b05a-5836d096c514 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:26:43.677759 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc733221-ab63-4d56-b05a-5836d096c514 service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:26:43.690004 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1160/2321] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:26:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:26:44.661454 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e228a9-1bf9-4eed-aa33-323dfc24a10c None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:26:44.661922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e228a9-1bf9-4eed-aa33-323dfc24a10c None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:26:44.662027 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e228a9-1bf9-4eed-aa33-323dfc24a10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:26:44.680758 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-f8e228a9-1bf9-4eed-aa33-323dfc24a10c None None] MFA Rules not processed for user `06c55d0ea52f40ae9125d2efe1d159a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:26:44.681987 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-f8e228a9-1bf9-4eed-aa33-323dfc24a10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:26:44.690072 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1162/2322] 10.222.0.61 () {58 vars in 967 bytes} [Fri Jun 3 13:26:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:26:44.715572 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc733221-ab63-4d56-b05a-5836d096c514 service neutron] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:26:44.726969 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc733221-ab63-4d56-b05a-5836d096c514 service neutron] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:26:44.732527 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31025fce-05a1-434b-a271-e4083401a652 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07ad3dd7477497ea25c2a01bff35712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:26:44.733250 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31025fce-05a1-434b-a271-e4083401a652 service swift] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:26:44.733606 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31025fce-05a1-434b-a271-e4083401a652 service swift] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:26:44.733978 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31025fce-05a1-434b-a271-e4083401a652 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:26:44.742555 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31025fce-05a1-434b-a271-e4083401a652 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:26:44.744233 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31025fce-05a1-434b-a271-e4083401a652 service swift] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:26:44.754090 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1161/2323] 10.222.0.61 () {60 vars in 1384 bytes} [Fri Jun 3 13:26:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 13:26:49.818667 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aedc17-4be1-4f19-adff-ad3b891b6772 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:26:49.819202 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aedc17-4be1-4f19-adff-ad3b891b6772 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:26:49.819202 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aedc17-4be1-4f19-adff-ad3b891b6772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:26:49.837441 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-a3aedc17-4be1-4f19-adff-ad3b891b6772 None None] MFA Rules not processed for user `77c56945d1d74a1eaa5e0c8f9e43f086`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:26:49.839250 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-a3aedc17-4be1-4f19-adff-ad3b891b6772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:26:49.846115 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1163/2324] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:26:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:26:50.156244 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31025fce-05a1-434b-a271-e4083401a652 service swift] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:26:50.165272 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31025fce-05a1-434b-a271-e4083401a652 service swift] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:26:50.169338 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c82dcf-c3ec-4c54-b077-f8e9445a409d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:26:50.169962 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c82dcf-c3ec-4c54-b077-f8e9445a409d service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:26:50.170252 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c82dcf-c3ec-4c54-b077-f8e9445a409d service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:26:50.170509 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c82dcf-c3ec-4c54-b077-f8e9445a409d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:26:50.172254 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-f8c82dcf-c3ec-4c54-b077-f8e9445a409d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:26:50.181319 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c82dcf-c3ec-4c54-b077-f8e9445a409d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:26:50.182809 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c82dcf-c3ec-4c54-b077-f8e9445a409d service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:26:50.190513 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1162/2325] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:26:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:26:50.858502 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aedc17-4be1-4f19-adff-ad3b891b6772 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:26:50.860000 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-a3aedc17-4be1-4f19-adff-ad3b891b6772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:26:50.932918 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aedc17-4be1-4f19-adff-ad3b891b6772 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:26:50.937820 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5070d07f-3705-401f-946a-b4602c5e8540 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5c4ad16c9454b74ae8445b115cf0af4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:26:50.938468 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070d07f-3705-401f-946a-b4602c5e8540 service placement] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:26:50.938749 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070d07f-3705-401f-946a-b4602c5e8540 service placement] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:26:50.939024 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070d07f-3705-401f-946a-b4602c5e8540 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:26:50.940796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-5070d07f-3705-401f-946a-b4602c5e8540 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:26:50.951853 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5070d07f-3705-401f-946a-b4602c5e8540 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:26:50.953471 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5070d07f-3705-401f-946a-b4602c5e8540 service placement] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:26:50.963096 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1164/2326] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:26:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:27:00.187083 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=18 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:27:00.958958 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=64 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:27:01.274252 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c82dcf-c3ec-4c54-b077-f8e9445a409d service neutron] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:27:01.275666 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-f8c82dcf-c3ec-4c54-b077-f8e9445a409d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:27:01.291543 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c82dcf-c3ec-4c54-b077-f8e9445a409d service neutron] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:27:01.297773 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c5221a-5bae-471f-8b0c-913a4cac1e4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066aaba3e9af4f85ab0cba89a3d32e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:27:01.307099 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c5221a-5bae-471f-8b0c-913a4cac1e4f service nova] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:27:01.307099 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c5221a-5bae-471f-8b0c-913a4cac1e4f service nova] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:27:01.307099 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c5221a-5bae-471f-8b0c-913a4cac1e4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:27:01.307099 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-f0c5221a-5bae-471f-8b0c-913a4cac1e4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:27:01.363339 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c5221a-5bae-471f-8b0c-913a4cac1e4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:27:01.365007 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c5221a-5bae-471f-8b0c-913a4cac1e4f service nova] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:27:01.375071 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1163/2327] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:27:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:27:02.718083 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b89f1-3240-466e-a138-5d8968fb06ca None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:27:02.718617 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b89f1-3240-466e-a138-5d8968fb06ca None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:27:02.718720 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b89f1-3240-466e-a138-5d8968fb06ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:27:02.737392 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-ee9b89f1-3240-466e-a138-5d8968fb06ca None None] MFA Rules not processed for user `308bdbe63af5415d8e817bd9ba2fad3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:27:02.738638 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-ee9b89f1-3240-466e-a138-5d8968fb06ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:27:02.745443 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1165/2328] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:27:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:27:03.863260 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c5221a-5bae-471f-8b0c-913a4cac1e4f service nova] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:27:03.872432 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c5221a-5bae-471f-8b0c-913a4cac1e4f service nova] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:27:03.876448 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547cdcd5-fe74-44b6-9708-3be396b33181 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:27:03.877098 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547cdcd5-fe74-44b6-9708-3be396b33181 service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:27:03.877375 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547cdcd5-fe74-44b6-9708-3be396b33181 service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:27:03.877648 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547cdcd5-fe74-44b6-9708-3be396b33181 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:27:03.879454 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-547cdcd5-fe74-44b6-9708-3be396b33181 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:27:03.889729 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547cdcd5-fe74-44b6-9708-3be396b33181 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:27:03.891153 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547cdcd5-fe74-44b6-9708-3be396b33181 service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:27:03.899512 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1164/2329] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:27:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:27:12.244600 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b89f1-3240-466e-a138-5d8968fb06ca None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:27:12.254946 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b89f1-3240-466e-a138-5d8968fb06ca None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:27:12.258536 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7ad97-6b05-4a51-930f-f36eb77f3cf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:27:12.259180 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7ad97-6b05-4a51-930f-f36eb77f3cf0 service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:27:12.259464 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7ad97-6b05-4a51-930f-f36eb77f3cf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:27:12.259738 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7ad97-6b05-4a51-930f-f36eb77f3cf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:27:12.269287 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a7ad97-6b05-4a51-930f-f36eb77f3cf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:27:12.270726 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a7ad97-6b05-4a51-930f-f36eb77f3cf0 service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:27:12.281712 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1166/2330] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:27:12 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 13:27:13.895954 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=34 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:27:18.380397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547cdcd5-fe74-44b6-9708-3be396b33181 service neutron] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:27:18.394160 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547cdcd5-fe74-44b6-9708-3be396b33181 service neutron] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:27:18.399738 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9d406-fece-4ad7-9c19-0eac0721223d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066aaba3e9af4f85ab0cba89a3d32e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:27:18.400428 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9d406-fece-4ad7-9c19-0eac0721223d service nova] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:27:18.401059 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9d406-fece-4ad7-9c19-0eac0721223d service nova] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:27:18.401059 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9d406-fece-4ad7-9c19-0eac0721223d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:27:18.402754 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-d8e9d406-fece-4ad7-9c19-0eac0721223d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:27:18.461896 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e9d406-fece-4ad7-9c19-0eac0721223d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:27:18.463476 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e9d406-fece-4ad7-9c19-0eac0721223d service nova] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:27:18.472842 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1165/2331] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:27:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:27:22.276383 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=9 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:27:28.468456 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=28 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:27:54.359867 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7ad97-6b05-4a51-930f-f36eb77f3cf0 service neutron] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:27:54.371818 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7ad97-6b05-4a51-930f-f36eb77f3cf0 service neutron] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:27:54.378648 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0957097c-9c1d-442b-91ed-7e5828fa83a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066aaba3e9af4f85ab0cba89a3d32e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:27:54.378648 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957097c-9c1d-442b-91ed-7e5828fa83a7 service nova] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:27:54.378648 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957097c-9c1d-442b-91ed-7e5828fa83a7 service nova] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:27:54.378970 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957097c-9c1d-442b-91ed-7e5828fa83a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:27:54.380739 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-0957097c-9c1d-442b-91ed-7e5828fa83a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:27:54.443228 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0957097c-9c1d-442b-91ed-7e5828fa83a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:27:54.445536 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0957097c-9c1d-442b-91ed-7e5828fa83a7 service nova] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:27:54.455147 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1167/2332] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:27:54 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:28:00.887122 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9d406-fece-4ad7-9c19-0eac0721223d service nova] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:28:00.899262 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9d406-fece-4ad7-9c19-0eac0721223d service nova] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:28:00.906021 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5ae76-2d19-4b59-af80-4791930643cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066aaba3e9af4f85ab0cba89a3d32e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:28:00.906671 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5ae76-2d19-4b59-af80-4791930643cd service nova] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:28:00.906952 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5ae76-2d19-4b59-af80-4791930643cd service nova] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:28:00.907224 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5ae76-2d19-4b59-af80-4791930643cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:28:00.909032 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-58a5ae76-2d19-4b59-af80-4791930643cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:28:00.922768 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5ae76-2d19-4b59-af80-4791930643cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:28:00.928729 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5ae76-2d19-4b59-af80-4791930643cd service nova] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:28:00.941250 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1166/2333] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:28:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:28:03.033199 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0957097c-9c1d-442b-91ed-7e5828fa83a7 service nova] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:28:03.045019 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0957097c-9c1d-442b-91ed-7e5828fa83a7 service nova] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:28:03.051209 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babdfcc-b9b6-4a42-b31c-5757214ea078 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066aaba3e9af4f85ab0cba89a3d32e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:28:03.052084 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babdfcc-b9b6-4a42-b31c-5757214ea078 service nova] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:28:03.052427 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babdfcc-b9b6-4a42-b31c-5757214ea078 service nova] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:28:03.053437 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babdfcc-b9b6-4a42-b31c-5757214ea078 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:28:03.055451 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-6babdfcc-b9b6-4a42-b31c-5757214ea078 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:28:03.132930 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6babdfcc-b9b6-4a42-b31c-5757214ea078 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:28:03.134638 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6babdfcc-b9b6-4a42-b31c-5757214ea078 service nova] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:28:03.153172 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1168/2334] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:28:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:28:05.379066 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f83e0f-05f0-41ca-99c7-ce23bb2e7724 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:28:05.379590 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f83e0f-05f0-41ca-99c7-ce23bb2e7724 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:28:05.379590 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f83e0f-05f0-41ca-99c7-ce23bb2e7724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:28:05.397642 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-d7f83e0f-05f0-41ca-99c7-ce23bb2e7724 None None] MFA Rules not processed for user `965645bc86f44cf38c5f571406722e32`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:28:05.398845 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-d7f83e0f-05f0-41ca-99c7-ce23bb2e7724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:28:05.405807 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1167/2335] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:28:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:28:13.148300 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=56 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:28:15.391951 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=9 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:28:15.812227 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babdfcc-b9b6-4a42-b31c-5757214ea078 service nova] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:28:15.823934 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babdfcc-b9b6-4a42-b31c-5757214ea078 service nova] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:28:15.829514 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce085786-12e0-46d8-836b-d80ef4b1c438 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066aaba3e9af4f85ab0cba89a3d32e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:28:15.830171 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce085786-12e0-46d8-836b-d80ef4b1c438 service nova] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:28:15.830456 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce085786-12e0-46d8-836b-d80ef4b1c438 service nova] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:28:15.830734 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce085786-12e0-46d8-836b-d80ef4b1c438 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:28:15.832598 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-ce085786-12e0-46d8-836b-d80ef4b1c438 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:28:15.846213 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce085786-12e0-46d8-836b-d80ef4b1c438 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:28:15.847969 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce085786-12e0-46d8-836b-d80ef4b1c438 service nova] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:28:15.859136 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1169/2336] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:28:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:28:20.582163 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f83e0f-05f0-41ca-99c7-ce23bb2e7724 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:28:20.596949 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f83e0f-05f0-41ca-99c7-ce23bb2e7724 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:28:20.603927 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf05f2-25b5-4c15-92f8-42b644676d00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066aaba3e9af4f85ab0cba89a3d32e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:28:20.605172 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf05f2-25b5-4c15-92f8-42b644676d00 service nova] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:28:20.605630 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf05f2-25b5-4c15-92f8-42b644676d00 service nova] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:28:20.606063 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf05f2-25b5-4c15-92f8-42b644676d00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:28:20.608009 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-3cdf05f2-25b5-4c15-92f8-42b644676d00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:28:20.622188 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdf05f2-25b5-4c15-92f8-42b644676d00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:28:20.624416 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdf05f2-25b5-4c15-92f8-42b644676d00 service nova] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:28:20.637772 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1168/2337] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:28:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:28:22.493235 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8582a9-bd09-4612-8c2f-477b7eb7ed0e None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:28:22.493784 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8582a9-bd09-4612-8c2f-477b7eb7ed0e None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:28:22.493784 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8582a9-bd09-4612-8c2f-477b7eb7ed0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:28:22.512443 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-9a8582a9-bd09-4612-8c2f-477b7eb7ed0e None None] MFA Rules not processed for user `267a2b59a70245dfb7ec1b779f7fdd51`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:28:22.513686 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-9a8582a9-bd09-4612-8c2f-477b7eb7ed0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:28:22.522605 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1170/2338] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:28:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:28:22.831742 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf05f2-25b5-4c15-92f8-42b644676d00 service nova] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:28:22.841812 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf05f2-25b5-4c15-92f8-42b644676d00 service nova] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:28:22.845387 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56276449-4282-4094-a814-049b6c1278da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:28:22.846020 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56276449-4282-4094-a814-049b6c1278da service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:28:22.846297 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56276449-4282-4094-a814-049b6c1278da service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:28:22.846571 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56276449-4282-4094-a814-049b6c1278da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:28:22.848317 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-56276449-4282-4094-a814-049b6c1278da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:28:22.857893 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56276449-4282-4094-a814-049b6c1278da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:28:22.859294 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56276449-4282-4094-a814-049b6c1278da service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:28:22.867288 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1169/2339] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:28:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:28:32.506748 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=9 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:28:32.863519 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=12 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:28:42.785983 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8582a9-bd09-4612-8c2f-477b7eb7ed0e None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:28:42.796552 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8582a9-bd09-4612-8c2f-477b7eb7ed0e None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:28:42.800358 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a053e-c96c-4aae-9f86-23074f6d633e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:28:42.801115 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a053e-c96c-4aae-9f86-23074f6d633e service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:28:42.801472 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a053e-c96c-4aae-9f86-23074f6d633e service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:28:42.801750 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a053e-c96c-4aae-9f86-23074f6d633e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:28:42.803505 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-235a053e-c96c-4aae-9f86-23074f6d633e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:28:42.866517 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235a053e-c96c-4aae-9f86-23074f6d633e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:28:42.867956 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235a053e-c96c-4aae-9f86-23074f6d633e service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:28:42.878399 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1171/2340] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:28:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:28:46.632138 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56276449-4282-4094-a814-049b6c1278da service neutron] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:28:46.633717 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-56276449-4282-4094-a814-049b6c1278da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:28:46.650333 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56276449-4282-4094-a814-049b6c1278da service neutron] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:28:46.655537 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8c0a6d-3760-4e59-b88f-2adfc0c116da service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5c4ad16c9454b74ae8445b115cf0af4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:28:46.656273 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c0a6d-3760-4e59-b88f-2adfc0c116da service placement] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:28:46.662760 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c0a6d-3760-4e59-b88f-2adfc0c116da service placement] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:28:46.662760 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c0a6d-3760-4e59-b88f-2adfc0c116da service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:28:46.662760 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-5d8c0a6d-3760-4e59-b88f-2adfc0c116da service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:28:46.673185 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8c0a6d-3760-4e59-b88f-2adfc0c116da service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:28:46.674849 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8c0a6d-3760-4e59-b88f-2adfc0c116da service placement] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:28:46.685760 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1170/2341] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:28:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:28:46.784761 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a053e-c96c-4aae-9f86-23074f6d633e service neutron] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:28:46.786847 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-235a053e-c96c-4aae-9f86-23074f6d633e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:28:46.802938 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a053e-c96c-4aae-9f86-23074f6d633e service neutron] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:28:46.807879 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abe0cf-086f-4503-8b76-ee68c34ba5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:28:46.808817 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abe0cf-086f-4503-8b76-ee68c34ba5c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:28:46.809595 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abe0cf-086f-4503-8b76-ee68c34ba5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:28:46.809595 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abe0cf-086f-4503-8b76-ee68c34ba5c1 admin admin] PATH_INFO: `/v3/users/308bdbe63af5415d8e817bd9ba2fad3e` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:28:46.810687 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14abe0cf-086f-4503-8b76-ee68c34ba5c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=308bdbe63af5415d8e817bd9ba2fad3e)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:28:46.812677 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14abe0cf-086f-4503-8b76-ee68c34ba5c1 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:28:47.031211 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-14abe0cf-086f-4503-8b76-ee68c34ba5c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '308bdbe63af5415d8e817bd9ba2fad3e'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:28:47.043104 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-14abe0cf-086f-4503-8b76-ee68c34ba5c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '308bdbe63af5415d8e817bd9ba2fad3e'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:28:47.043779 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-14abe0cf-086f-4503-8b76-ee68c34ba5c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '308bdbe63af5415d8e817bd9ba2fad3e'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:28:47.056638 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-14abe0cf-086f-4503-8b76-ee68c34ba5c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '308bdbe63af5415d8e817bd9ba2fad3e'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:28:47.056638 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-14abe0cf-086f-4503-8b76-ee68c34ba5c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '308bdbe63af5415d8e817bd9ba2fad3e'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:28:47.137911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1172/2342] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:28:46 2022] DELETE /identity/v3/users/308bdbe63af5415d8e817bd9ba2fad3e => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:28:47.378851 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8c0a6d-3760-4e59-b88f-2adfc0c116da service placement] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:28:47.398160 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8c0a6d-3760-4e59-b88f-2adfc0c116da service placement] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:28:47.459623 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04597d5-d37d-448c-b45a-1bff87da3635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:28:47.460601 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04597d5-d37d-448c-b45a-1bff87da3635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:28:47.460885 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04597d5-d37d-448c-b45a-1bff87da3635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:28:47.461155 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04597d5-d37d-448c-b45a-1bff87da3635 admin admin] PATH_INFO: `/v3/projects/422fdba5c8474b93b285700c07e9304c` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:28:47.462449 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04597d5-d37d-448c-b45a-1bff87da3635 admin admin] RBAC: Authorizing `identity:delete_project(project_id=422fdba5c8474b93b285700c07e9304c)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:28:47.464420 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04597d5-d37d-448c-b45a-1bff87da3635 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:28:47.573498 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-d04597d5-d37d-448c-b45a-1bff87da3635 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '422fdba5c8474b93b285700c07e9304c', 'request_id': 'req-d04597d5-d37d-448c-b45a-1bff87da3635'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:28:47.674764 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-d04597d5-d37d-448c-b45a-1bff87da3635 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '422fdba5c8474b93b285700c07e9304c', 'request_id': 'req-d04597d5-d37d-448c-b45a-1bff87da3635'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:28:47.681718 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-d04597d5-d37d-448c-b45a-1bff87da3635 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '422fdba5c8474b93b285700c07e9304c', 'request_id': 'req-d04597d5-d37d-448c-b45a-1bff87da3635'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:28:47.694969 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-d04597d5-d37d-448c-b45a-1bff87da3635 admin admin] The token cache is being invalidate because project 422fdba5c8474b93b285700c07e9304c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:28:47.695251 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-d04597d5-d37d-448c-b45a-1bff87da3635 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:28:47.695902 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-d04597d5-d37d-448c-b45a-1bff87da3635 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:28:47.698114 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1171/2343] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:28:47 2022] DELETE /identity/v3/projects/422fdba5c8474b93b285700c07e9304c => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:28:47.703513 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e3229-fccf-4da9-8b54-44b550bcd381 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:28:47.703870 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e3229-fccf-4da9-8b54-44b550bcd381 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:28:47.704177 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e3229-fccf-4da9-8b54-44b550bcd381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:28:47.722309 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-890e3229-fccf-4da9-8b54-44b550bcd381 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:28:47.723498 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-890e3229-fccf-4da9-8b54-44b550bcd381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:28:47.783089 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1173/2344] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:28:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:28:47.791589 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a7e1b-f515-4d92-be3e-d21b58c50a0e None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:28:47.791923 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a7e1b-f515-4d92-be3e-d21b58c50a0e None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:28:47.792241 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a7e1b-f515-4d92-be3e-d21b58c50a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:28:47.809737 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-f39a7e1b-f515-4d92-be3e-d21b58c50a0e None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:28:47.810875 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-f39a7e1b-f515-4d92-be3e-d21b58c50a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:28:47.818921 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1172/2345] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:28:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:28:47.823119 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e3229-fccf-4da9-8b54-44b550bcd381 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:28:47.832978 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e3229-fccf-4da9-8b54-44b550bcd381 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:28:47.838079 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22789226-84e1-4672-b496-468245da3b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:28:47.838724 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22789226-84e1-4672-b496-468245da3b4a admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:28:47.839006 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22789226-84e1-4672-b496-468245da3b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:28:47.839281 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22789226-84e1-4672-b496-468245da3b4a admin admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:28:47.840029 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22789226-84e1-4672-b496-468245da3b4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:28:47.840372 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22789226-84e1-4672-b496-468245da3b4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:28:47.842013 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22789226-84e1-4672-b496-468245da3b4a admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:28:47.843474 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:28:47.854824 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1174/2346] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:28:47.859090 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a7e1b-f515-4d92-be3e-d21b58c50a0e None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:28:47.868244 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a7e1b-f515-4d92-be3e-d21b58c50a0e None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:28:47.872939 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90df990-76f1-4b04-bb0e-ebef4480610d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:28:47.873770 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90df990-76f1-4b04-bb0e-ebef4480610d admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:28:47.874225 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90df990-76f1-4b04-bb0e-ebef4480610d admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:28:47.874761 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90df990-76f1-4b04-bb0e-ebef4480610d admin admin] PATH_INFO: `/v3/projects` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:28:47.875457 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90df990-76f1-4b04-bb0e-ebef4480610d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:28:47.877413 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90df990-76f1-4b04-bb0e-ebef4480610d admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:28:47.967994 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1173/2347] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:28:47 2022] POST /identity/v3/projects => generated 353 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:28:47.972105 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22789226-84e1-4672-b496-468245da3b4a admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:28:47.982594 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22789226-84e1-4672-b496-468245da3b4a admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:28:48.039648 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9ff46-f46c-4e8a-8509-89e9780b2391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:28:48.040350 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9ff46-f46c-4e8a-8509-89e9780b2391 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:28:48.040634 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9ff46-f46c-4e8a-8509-89e9780b2391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:28:48.040908 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9ff46-f46c-4e8a-8509-89e9780b2391 admin admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:28:48.042873 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab9ff46-f46c-4e8a-8509-89e9780b2391 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:28:48.044918 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab9ff46-f46c-4e8a-8509-89e9780b2391 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:28:48.114208 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1175/2348] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:28:47 2022] POST /identity/v3/users => generated 277 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:28:48.118152 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90df990-76f1-4b04-bb0e-ebef4480610d admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:28:48.129234 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90df990-76f1-4b04-bb0e-ebef4480610d admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:28:48.133785 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617bbac-9497-4456-aedf-0c4e08fe0e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:28:48.134437 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617bbac-9497-4456-aedf-0c4e08fe0e50 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:28:48.134720 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617bbac-9497-4456-aedf-0c4e08fe0e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:28:48.135510 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617bbac-9497-4456-aedf-0c4e08fe0e50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:28:48.136223 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a617bbac-9497-4456-aedf-0c4e08fe0e50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:28:48.137821 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a617bbac-9497-4456-aedf-0c4e08fe0e50 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:28:48.147787 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1174/2349] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:28:48.152334 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9ff46-f46c-4e8a-8509-89e9780b2391 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:28:48.162311 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9ff46-f46c-4e8a-8509-89e9780b2391 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:28:48.167322 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0037b02b-5c0a-46c3-a79d-b9397c045658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:28:48.167982 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037b02b-5c0a-46c3-a79d-b9397c045658 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:28:48.168301 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037b02b-5c0a-46c3-a79d-b9397c045658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:28:48.168582 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037b02b-5c0a-46c3-a79d-b9397c045658 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:28:48.169415 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0037b02b-5c0a-46c3-a79d-b9397c045658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:28:48.171018 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0037b02b-5c0a-46c3-a79d-b9397c045658 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:28:48.181785 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1176/2350] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:28:48.185967 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617bbac-9497-4456-aedf-0c4e08fe0e50 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:28:48.203096 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617bbac-9497-4456-aedf-0c4e08fe0e50 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:28:48.208467 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c60ddd4-b1ce-43f5-ab43-285e756bb624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:28:48.209352 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60ddd4-b1ce-43f5-ab43-285e756bb624 admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:28:48.209631 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60ddd4-b1ce-43f5-ab43-285e756bb624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:28:48.209907 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60ddd4-b1ce-43f5-ab43-285e756bb624 admin admin] PATH_INFO: `/v3/projects/8f19b9ca2f0a4ea583b91951aa6df374/users/9a55a815eb3a4d9491693f7f1cf96533/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:28:48.227274 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c60ddd4-b1ce-43f5-ab43-285e756bb624 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f19b9ca2f0a4ea583b91951aa6df374, user_id=9a55a815eb3a4d9491693f7f1cf96533, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:28:48.229948 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c60ddd4-b1ce-43f5-ab43-285e756bb624 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:28:48.288598 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1175/2351] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:28:48 2022] PUT /identity/v3/projects/8f19b9ca2f0a4ea583b91951aa6df374/users/9a55a815eb3a4d9491693f7f1cf96533/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:28:48.291997 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e0b0e-4816-48b7-b3a5-76bce7d6b81c None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:28:48.292398 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e0b0e-4816-48b7-b3a5-76bce7d6b81c None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:28:48.292737 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e0b0e-4816-48b7-b3a5-76bce7d6b81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:28:48.298191 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be4089-5ca5-479f-ad70-e69b14621543 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:28:48.298507 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be4089-5ca5-479f-ad70-e69b14621543 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:28:48.298785 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be4089-5ca5-479f-ad70-e69b14621543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:28:48.306996 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:28:48.312279 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-f86e0b0e-4816-48b7-b3a5-76bce7d6b81c None None] MFA Rules not processed for user `06c55d0ea52f40ae9125d2efe1d159a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:28:48.313471 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-f86e0b0e-4816-48b7-b3a5-76bce7d6b81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:28:48.327515 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-43be4089-5ca5-479f-ad70-e69b14621543 None None] MFA Rules not processed for user `9a55a815eb3a4d9491693f7f1cf96533`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:28:48.328771 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-43be4089-5ca5-479f-ad70-e69b14621543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:28:48.376771 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1177/2352] 10.222.0.61 () {58 vars in 967 bytes} [Fri Jun 3 13:28:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:28:48.403466 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1176/2353] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:28:48 2022] POST /identity/v3/auth/tokens => generated 3220 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:28:48.408061 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e0b0e-4816-48b7-b3a5-76bce7d6b81c None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:28:48.471119 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e0b0e-4816-48b7-b3a5-76bce7d6b81c None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:28:48.475731 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ca9f9-6a61-4b26-af4c-a04d04186793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:28:48.476408 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ca9f9-6a61-4b26-af4c-a04d04186793 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:28:48.476693 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ca9f9-6a61-4b26-af4c-a04d04186793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:28:48.476980 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ca9f9-6a61-4b26-af4c-a04d04186793 admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:28:48.477657 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ca9f9-6a61-4b26-af4c-a04d04186793 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:28:48.479740 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ca9f9-6a61-4b26-af4c-a04d04186793 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:28:48.530608 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be4089-5ca5-479f-ad70-e69b14621543 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:28:48.534553 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-43be4089-5ca5-479f-ad70-e69b14621543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:28:48.564829 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1178/2354] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:28:48 2022] POST /identity/v3/projects => generated 357 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:28:48.565837 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ca9f9-6a61-4b26-af4c-a04d04186793 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:28:48.570911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:28:48.604772 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be4089-5ca5-479f-ad70-e69b14621543 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:28:48.631088 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ca9f9-6a61-4b26-af4c-a04d04186793 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:28:48.636642 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acdb6cf-ca53-4d4b-b3a7-a29330152007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:28:48.637316 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acdb6cf-ca53-4d4b-b3a7-a29330152007 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:28:48.637591 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acdb6cf-ca53-4d4b-b3a7-a29330152007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:28:48.637863 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acdb6cf-ca53-4d4b-b3a7-a29330152007 admin admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:28:48.638735 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acdb6cf-ca53-4d4b-b3a7-a29330152007 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:28:48.641947 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acdb6cf-ca53-4d4b-b3a7-a29330152007 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:28:48.666738 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b3362-7776-49d9-9a73-a0439c8bb4df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07ad3dd7477497ea25c2a01bff35712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:28:48.667530 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b3362-7776-49d9-9a73-a0439c8bb4df service swift] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:28:48.667802 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b3362-7776-49d9-9a73-a0439c8bb4df service swift] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:28:48.668080 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b3362-7776-49d9-9a73-a0439c8bb4df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:28:48.707112 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:28:48.722869 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1179/2355] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:28:48 2022] POST /identity/v3/users => generated 285 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:28:48.723920 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acdb6cf-ca53-4d4b-b3a7-a29330152007 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:28:48.725036 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b3362-7776-49d9-9a73-a0439c8bb4df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:28:48.726625 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b3362-7776-49d9-9a73-a0439c8bb4df service swift] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:28:48.735337 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1177/2356] 10.222.0.61 () {60 vars in 1384 bytes} [Fri Jun 3 13:28:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 03 13:28:48.738281 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acdb6cf-ca53-4d4b-b3a7-a29330152007 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:28:48.743341 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62e46a-5619-41d6-bb6d-081fc6dfe3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:28:48.744004 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62e46a-5619-41d6-bb6d-081fc6dfe3ed admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:28:48.744849 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62e46a-5619-41d6-bb6d-081fc6dfe3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:28:48.745563 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62e46a-5619-41d6-bb6d-081fc6dfe3ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:28:48.746155 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f62e46a-5619-41d6-bb6d-081fc6dfe3ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:28:48.747735 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f62e46a-5619-41d6-bb6d-081fc6dfe3ed admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:28:48.764200 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1180/2357] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:28:48.768358 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b3362-7776-49d9-9a73-a0439c8bb4df service swift] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:28:48.780005 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b3362-7776-49d9-9a73-a0439c8bb4df service swift] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:28:48.786736 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e4ace-489a-4639-ba72-f9cc6efa196b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:28:48.786736 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e4ace-489a-4639-ba72-f9cc6efa196b admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:28:48.786736 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e4ace-489a-4639-ba72-f9cc6efa196b admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:28:48.786736 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e4ace-489a-4639-ba72-f9cc6efa196b admin admin] PATH_INFO: `/v3/projects/ffea75b85b35424ab52232d707f42257/users/0a0e7ebb6c0e4f8292026c8ca307b970/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:28:48.801378 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e4ace-489a-4639-ba72-f9cc6efa196b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffea75b85b35424ab52232d707f42257, user_id=0a0e7ebb6c0e4f8292026c8ca307b970, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:28:48.804002 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e4ace-489a-4639-ba72-f9cc6efa196b admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:28:48.891776 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1178/2358] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:28:48 2022] PUT /identity/v3/projects/ffea75b85b35424ab52232d707f42257/users/0a0e7ebb6c0e4f8292026c8ca307b970/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:28:48.895765 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62e46a-5619-41d6-bb6d-081fc6dfe3ed admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:28:48.906097 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62e46a-5619-41d6-bb6d-081fc6dfe3ed admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:28:48.966797 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a72671-1a32-484c-a24b-c8ad727250f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:28:48.967473 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a72671-1a32-484c-a24b-c8ad727250f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:28:48.967758 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a72671-1a32-484c-a24b-c8ad727250f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:28:48.968034 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a72671-1a32-484c-a24b-c8ad727250f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:28:48.968798 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a72671-1a32-484c-a24b-c8ad727250f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:28:48.970484 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a72671-1a32-484c-a24b-c8ad727250f7 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:28:48.981680 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1181/2359] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:28:48.985891 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e4ace-489a-4639-ba72-f9cc6efa196b admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:28:48.997529 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e4ace-489a-4639-ba72-f9cc6efa196b admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:28:49.008738 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1dd02-47c3-4f46-9d8c-c685183cd6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:28:49.009986 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1dd02-47c3-4f46-9d8c-c685183cd6b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:28:49.010465 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1dd02-47c3-4f46-9d8c-c685183cd6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:28:49.010917 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1dd02-47c3-4f46-9d8c-c685183cd6b3 admin admin] PATH_INFO: `/v3/projects/ffea75b85b35424ab52232d707f42257/users/0a0e7ebb6c0e4f8292026c8ca307b970/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:28:49.014187 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a1dd02-47c3-4f46-9d8c-c685183cd6b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffea75b85b35424ab52232d707f42257, user_id=0a0e7ebb6c0e4f8292026c8ca307b970, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:28:49.019583 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a1dd02-47c3-4f46-9d8c-c685183cd6b3 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:28:49.036910 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1179/2360] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:28:48 2022] PUT /identity/v3/projects/ffea75b85b35424ab52232d707f42257/users/0a0e7ebb6c0e4f8292026c8ca307b970/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:28:49.054620 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7bd145-ac0e-4f71-a39a-adace4dbf705 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:28:49.054911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7bd145-ac0e-4f71-a39a-adace4dbf705 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:28:49.055189 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7bd145-ac0e-4f71-a39a-adace4dbf705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:28:49.084425 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-ed7bd145-ac0e-4f71-a39a-adace4dbf705 None None] MFA Rules not processed for user `0a0e7ebb6c0e4f8292026c8ca307b970`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:28:49.086047 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-ed7bd145-ac0e-4f71-a39a-adace4dbf705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:28:49.160571 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1182/2361] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:28:49 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:28:49.173127 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1dd02-47c3-4f46-9d8c-c685183cd6b3 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:28:49.174998 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-d3a1dd02-47c3-4f46-9d8c-c685183cd6b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:28:49.237965 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1dd02-47c3-4f46-9d8c-c685183cd6b3 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:28:49.241766 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3dd37e-6bd7-4d0d-a866-00aff6ced11f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:28:49.242411 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3dd37e-6bd7-4d0d-a866-00aff6ced11f service cinder] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:28:49.242700 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3dd37e-6bd7-4d0d-a866-00aff6ced11f service cinder] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:28:49.242977 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3dd37e-6bd7-4d0d-a866-00aff6ced11f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:28:49.254546 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3dd37e-6bd7-4d0d-a866-00aff6ced11f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:28:49.256291 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3dd37e-6bd7-4d0d-a866-00aff6ced11f service cinder] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:28:49.267016 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1180/2362] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:28:49 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:28:49.509007 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7bd145-ac0e-4f71-a39a-adace4dbf705 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:28:49.513778 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:28:49.519204 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7bd145-ac0e-4f71-a39a-adace4dbf705 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:28:49.522992 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06323f24-8157-45a8-a16a-4f1e951936dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:28:49.523686 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06323f24-8157-45a8-a16a-4f1e951936dd service cinder] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:28:49.523914 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06323f24-8157-45a8-a16a-4f1e951936dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:28:49.524238 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06323f24-8157-45a8-a16a-4f1e951936dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:28:49.581534 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06323f24-8157-45a8-a16a-4f1e951936dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:28:49.582991 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06323f24-8157-45a8-a16a-4f1e951936dd service cinder] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:28:49.592715 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1183/2363] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:28:49 2022] GET /identity/v3/auth/tokens => generated 3220 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:28:54.132003 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3dd37e-6bd7-4d0d-a866-00aff6ced11f service cinder] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:28:54.133657 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-2a3dd37e-6bd7-4d0d-a866-00aff6ced11f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:28:54.204788 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3dd37e-6bd7-4d0d-a866-00aff6ced11f service cinder] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:28:54.209669 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2c879-5471-45fd-999a-33dc768d4b69 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5c4ad16c9454b74ae8445b115cf0af4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:28:54.210312 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2c879-5471-45fd-999a-33dc768d4b69 service placement] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:28:54.210593 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2c879-5471-45fd-999a-33dc768d4b69 service placement] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:28:54.210868 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2c879-5471-45fd-999a-33dc768d4b69 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:28:54.212638 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-ddd2c879-5471-45fd-999a-33dc768d4b69 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:28:54.226474 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd2c879-5471-45fd-999a-33dc768d4b69 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:28:54.228054 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd2c879-5471-45fd-999a-33dc768d4b69 service placement] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:28:54.239364 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1181/2364] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:28:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 13:28:58.274811 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06323f24-8157-45a8-a16a-4f1e951936dd service cinder] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:28:58.276268 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-06323f24-8157-45a8-a16a-4f1e951936dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:28:58.347306 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06323f24-8157-45a8-a16a-4f1e951936dd service cinder] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:28:58.352353 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38893022-33f0-4dbc-8ae9-0b224afa8923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:28:58.353231 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38893022-33f0-4dbc-8ae9-0b224afa8923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:28:58.353512 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38893022-33f0-4dbc-8ae9-0b224afa8923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:28:58.353785 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38893022-33f0-4dbc-8ae9-0b224afa8923 admin admin] PATH_INFO: `/v3/users/4d0490962ec743048ef924340c93de20` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:28:58.355653 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38893022-33f0-4dbc-8ae9-0b224afa8923 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d0490962ec743048ef924340c93de20)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:28:58.357649 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38893022-33f0-4dbc-8ae9-0b224afa8923 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:28:58.563535 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-38893022-33f0-4dbc-8ae9-0b224afa8923 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d0490962ec743048ef924340c93de20'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:28:58.580687 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-38893022-33f0-4dbc-8ae9-0b224afa8923 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d0490962ec743048ef924340c93de20'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:28:58.581535 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-38893022-33f0-4dbc-8ae9-0b224afa8923 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d0490962ec743048ef924340c93de20'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:28:58.590169 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-38893022-33f0-4dbc-8ae9-0b224afa8923 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d0490962ec743048ef924340c93de20'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:28:58.591007 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-38893022-33f0-4dbc-8ae9-0b224afa8923 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d0490962ec743048ef924340c93de20'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:28:58.698439 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1184/2365] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:28:58 2022] DELETE /identity/v3/users/4d0490962ec743048ef924340c93de20 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:28:58.776286 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2c784-a2c2-44fb-ba82-40f72f905618 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:28:58.777489 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2c784-a2c2-44fb-ba82-40f72f905618 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:28:58.777489 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2c784-a2c2-44fb-ba82-40f72f905618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:28:58.796182 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-aca2c784-a2c2-44fb-ba82-40f72f905618 None None] MFA Rules not processed for user `7254adba100f4453b2b9a953990dbb41`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:28:58.797465 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-aca2c784-a2c2-44fb-ba82-40f72f905618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:28:58.832441 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:28:58.861882 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1182/2366] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:28:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:28:58.976287 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38893022-33f0-4dbc-8ae9-0b224afa8923 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:28:58.977824 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-38893022-33f0-4dbc-8ae9-0b224afa8923 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:28:59.016037 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:28:59.060447 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38893022-33f0-4dbc-8ae9-0b224afa8923 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:28:59.065157 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51853f69-08bc-4a6c-8df4-c1405f6e6406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:28:59.066016 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51853f69-08bc-4a6c-8df4-c1405f6e6406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:28:59.066295 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51853f69-08bc-4a6c-8df4-c1405f6e6406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:28:59.066564 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51853f69-08bc-4a6c-8df4-c1405f6e6406 admin admin] PATH_INFO: `/v3/projects/03432cb8c28c46fba16dc9f88d648d11` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:28:59.067739 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51853f69-08bc-4a6c-8df4-c1405f6e6406 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03432cb8c28c46fba16dc9f88d648d11)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:28:59.069800 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51853f69-08bc-4a6c-8df4-c1405f6e6406 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:28:59.188752 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-51853f69-08bc-4a6c-8df4-c1405f6e6406 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03432cb8c28c46fba16dc9f88d648d11', 'request_id': 'req-51853f69-08bc-4a6c-8df4-c1405f6e6406'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:28:59.194869 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-51853f69-08bc-4a6c-8df4-c1405f6e6406 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03432cb8c28c46fba16dc9f88d648d11', 'request_id': 'req-51853f69-08bc-4a6c-8df4-c1405f6e6406'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:28:59.200858 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-51853f69-08bc-4a6c-8df4-c1405f6e6406 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03432cb8c28c46fba16dc9f88d648d11', 'request_id': 'req-51853f69-08bc-4a6c-8df4-c1405f6e6406'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:28:59.268771 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-51853f69-08bc-4a6c-8df4-c1405f6e6406 admin admin] The token cache is being invalidate because project 03432cb8c28c46fba16dc9f88d648d11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:28:59.269058 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-51853f69-08bc-4a6c-8df4-c1405f6e6406 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:28:59.269684 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-51853f69-08bc-4a6c-8df4-c1405f6e6406 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:28:59.271252 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1185/2367] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:28:58 2022] DELETE /identity/v3/projects/03432cb8c28c46fba16dc9f88d648d11 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:28:59.275257 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2c784-a2c2-44fb-ba82-40f72f905618 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:28:59.286314 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2c784-a2c2-44fb-ba82-40f72f905618 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:28:59.344743 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b70524-c610-43ae-8b40-777d83fb7ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:28:59.345539 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b70524-c610-43ae-8b40-777d83fb7ee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:28:59.345818 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b70524-c610-43ae-8b40-777d83fb7ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:28:59.346094 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b70524-c610-43ae-8b40-777d83fb7ee2 admin admin] PATH_INFO: `/v3/users/d43f464cc3ef44f6ba9fb34388ebb2cc` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:28:59.347279 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b70524-c610-43ae-8b40-777d83fb7ee2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d43f464cc3ef44f6ba9fb34388ebb2cc)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:28:59.349222 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b70524-c610-43ae-8b40-777d83fb7ee2 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:28:59.604166 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-c0b70524-c610-43ae-8b40-777d83fb7ee2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd43f464cc3ef44f6ba9fb34388ebb2cc'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:28:59.620450 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-c0b70524-c610-43ae-8b40-777d83fb7ee2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd43f464cc3ef44f6ba9fb34388ebb2cc'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:28:59.621829 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-c0b70524-c610-43ae-8b40-777d83fb7ee2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd43f464cc3ef44f6ba9fb34388ebb2cc'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:28:59.630470 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-c0b70524-c610-43ae-8b40-777d83fb7ee2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd43f464cc3ef44f6ba9fb34388ebb2cc'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:28:59.631528 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-c0b70524-c610-43ae-8b40-777d83fb7ee2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd43f464cc3ef44f6ba9fb34388ebb2cc'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:28:59.723367 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1183/2368] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:28:59 2022] DELETE /identity/v3/users/d43f464cc3ef44f6ba9fb34388ebb2cc => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:29:00.065075 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51853f69-08bc-4a6c-8df4-c1405f6e6406 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:00.066558 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-51853f69-08bc-4a6c-8df4-c1405f6e6406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:29:00.082127 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51853f69-08bc-4a6c-8df4-c1405f6e6406 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:00.141604 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637ef4b-70ca-4196-893e-9aa399cc8351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:00.142495 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637ef4b-70ca-4196-893e-9aa399cc8351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:00.142776 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637ef4b-70ca-4196-893e-9aa399cc8351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:00.143269 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637ef4b-70ca-4196-893e-9aa399cc8351 admin admin] PATH_INFO: `/v3/projects/496b687b3f7e461a950f846ecf322b90` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:00.144254 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7637ef4b-70ca-4196-893e-9aa399cc8351 admin admin] RBAC: Authorizing `identity:delete_project(project_id=496b687b3f7e461a950f846ecf322b90)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:00.146235 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7637ef4b-70ca-4196-893e-9aa399cc8351 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:00.309258 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-7637ef4b-70ca-4196-893e-9aa399cc8351 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '496b687b3f7e461a950f846ecf322b90', 'request_id': 'req-7637ef4b-70ca-4196-893e-9aa399cc8351'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:00.311285 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:29:00.315891 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-7637ef4b-70ca-4196-893e-9aa399cc8351 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '496b687b3f7e461a950f846ecf322b90', 'request_id': 'req-7637ef4b-70ca-4196-893e-9aa399cc8351'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:00.322260 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-7637ef4b-70ca-4196-893e-9aa399cc8351 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '496b687b3f7e461a950f846ecf322b90', 'request_id': 'req-7637ef4b-70ca-4196-893e-9aa399cc8351'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:00.416740 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-7637ef4b-70ca-4196-893e-9aa399cc8351 admin admin] The token cache is being invalidate because project 496b687b3f7e461a950f846ecf322b90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:29:00.417032 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-7637ef4b-70ca-4196-893e-9aa399cc8351 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:00.417796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-7637ef4b-70ca-4196-893e-9aa399cc8351 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:00.419629 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1186/2369] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:29:00 2022] DELETE /identity/v3/projects/496b687b3f7e461a950f846ecf322b90 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:29:09.718529 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=63,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:29:10.160849 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b70524-c610-43ae-8b40-777d83fb7ee2 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:10.162269 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-c0b70524-c610-43ae-8b40-777d83fb7ee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:29:10.175631 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b70524-c610-43ae-8b40-777d83fb7ee2 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:10.234555 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b31f5-638b-44b4-9c98-3cd7512eb3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:10.235420 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b31f5-638b-44b4-9c98-3cd7512eb3f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:10.235699 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b31f5-638b-44b4-9c98-3cd7512eb3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:10.235977 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b31f5-638b-44b4-9c98-3cd7512eb3f2 admin admin] PATH_INFO: `/v3/users/9a55a815eb3a4d9491693f7f1cf96533` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:10.237182 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b31f5-638b-44b4-9c98-3cd7512eb3f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a55a815eb3a4d9491693f7f1cf96533)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:10.239109 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b31f5-638b-44b4-9c98-3cd7512eb3f2 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:10.454052 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-f46b31f5-638b-44b4-9c98-3cd7512eb3f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a55a815eb3a4d9491693f7f1cf96533'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:10.465734 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-f46b31f5-638b-44b4-9c98-3cd7512eb3f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a55a815eb3a4d9491693f7f1cf96533'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:10.467158 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-f46b31f5-638b-44b4-9c98-3cd7512eb3f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a55a815eb3a4d9491693f7f1cf96533'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:10.473959 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-f46b31f5-638b-44b4-9c98-3cd7512eb3f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a55a815eb3a4d9491693f7f1cf96533'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:10.474588 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-f46b31f5-638b-44b4-9c98-3cd7512eb3f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a55a815eb3a4d9491693f7f1cf96533'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:10.553994 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1184/2370] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:29:10 2022] DELETE /identity/v3/users/9a55a815eb3a4d9491693f7f1cf96533 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:29:10.558579 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe4f11-4d85-4d59-8c1e-529c1ecc5e91 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:10.559083 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe4f11-4d85-4d59-8c1e-529c1ecc5e91 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:10.559253 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe4f11-4d85-4d59-8c1e-529c1ecc5e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:10.577948 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-cdfe4f11-4d85-4d59-8c1e-529c1ecc5e91 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:29:10.579131 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-cdfe4f11-4d85-4d59-8c1e-529c1ecc5e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:29:10.639359 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1187/2371] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:29:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:29:10.649099 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b31f5-638b-44b4-9c98-3cd7512eb3f2 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:10.650602 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-f46b31f5-638b-44b4-9c98-3cd7512eb3f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:29:10.708322 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b31f5-638b-44b4-9c98-3cd7512eb3f2 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:10.711740 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d9d08-b0a1-4d7d-8dfe-ebff71c2feff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:10.712431 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d9d08-b0a1-4d7d-8dfe-ebff71c2feff service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:10.712709 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d9d08-b0a1-4d7d-8dfe-ebff71c2feff service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:10.712984 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d9d08-b0a1-4d7d-8dfe-ebff71c2feff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:10.722934 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d9d08-b0a1-4d7d-8dfe-ebff71c2feff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:10.724427 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d9d08-b0a1-4d7d-8dfe-ebff71c2feff service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:10.734530 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1185/2372] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:29:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:29:11.170761 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe4f11-4d85-4d59-8c1e-529c1ecc5e91 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:11.172225 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-cdfe4f11-4d85-4d59-8c1e-529c1ecc5e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:29:11.184728 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe4f11-4d85-4d59-8c1e-529c1ecc5e91 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:11.200031 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a012a-58e3-408d-b4a6-4f460f0a0eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:11.201792 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a012a-58e3-408d-b4a6-4f460f0a0eaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:11.202132 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a012a-58e3-408d-b4a6-4f460f0a0eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:11.202416 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a012a-58e3-408d-b4a6-4f460f0a0eaf admin admin] PATH_INFO: `/v3/projects/8f19b9ca2f0a4ea583b91951aa6df374` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:11.203613 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a012a-58e3-408d-b4a6-4f460f0a0eaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f19b9ca2f0a4ea583b91951aa6df374)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:11.205637 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a012a-58e3-408d-b4a6-4f460f0a0eaf admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:11.327014 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-107a012a-58e3-408d-b4a6-4f460f0a0eaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f19b9ca2f0a4ea583b91951aa6df374', 'request_id': 'req-107a012a-58e3-408d-b4a6-4f460f0a0eaf'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:11.333172 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-107a012a-58e3-408d-b4a6-4f460f0a0eaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f19b9ca2f0a4ea583b91951aa6df374', 'request_id': 'req-107a012a-58e3-408d-b4a6-4f460f0a0eaf'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:11.338669 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-107a012a-58e3-408d-b4a6-4f460f0a0eaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f19b9ca2f0a4ea583b91951aa6df374', 'request_id': 'req-107a012a-58e3-408d-b4a6-4f460f0a0eaf'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:11.467847 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-107a012a-58e3-408d-b4a6-4f460f0a0eaf admin admin] The token cache is being invalidate because project 8f19b9ca2f0a4ea583b91951aa6df374 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:29:11.468133 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-107a012a-58e3-408d-b4a6-4f460f0a0eaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:11.468769 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-107a012a-58e3-408d-b4a6-4f460f0a0eaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:11.470303 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1188/2373] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:29:11 2022] DELETE /identity/v3/projects/8f19b9ca2f0a4ea583b91951aa6df374 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:29:11.474227 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d9d08-b0a1-4d7d-8dfe-ebff71c2feff service neutron] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:11.484155 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d9d08-b0a1-4d7d-8dfe-ebff71c2feff service neutron] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:11.502554 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:29:11.539905 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93bcf2-56d3-4807-919f-8eeb357e91eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:11.540886 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93bcf2-56d3-4807-919f-8eeb357e91eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:11.541165 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93bcf2-56d3-4807-919f-8eeb357e91eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:11.541433 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93bcf2-56d3-4807-919f-8eeb357e91eb admin admin] PATH_INFO: `/v3/users/0a0e7ebb6c0e4f8292026c8ca307b970` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:11.542592 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e93bcf2-56d3-4807-919f-8eeb357e91eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a0e7ebb6c0e4f8292026c8ca307b970)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:11.544615 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e93bcf2-56d3-4807-919f-8eeb357e91eb admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:11.751428 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-7e93bcf2-56d3-4807-919f-8eeb357e91eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a0e7ebb6c0e4f8292026c8ca307b970'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:11.763473 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-7e93bcf2-56d3-4807-919f-8eeb357e91eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a0e7ebb6c0e4f8292026c8ca307b970'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:11.764159 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-7e93bcf2-56d3-4807-919f-8eeb357e91eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a0e7ebb6c0e4f8292026c8ca307b970'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:11.770988 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-7e93bcf2-56d3-4807-919f-8eeb357e91eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a0e7ebb6c0e4f8292026c8ca307b970'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:11.771615 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-7e93bcf2-56d3-4807-919f-8eeb357e91eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a0e7ebb6c0e4f8292026c8ca307b970'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:11.851255 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1186/2374] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:29:11 2022] DELETE /identity/v3/users/0a0e7ebb6c0e4f8292026c8ca307b970 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:29:12.323237 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a012a-58e3-408d-b4a6-4f460f0a0eaf admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:12.324685 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-107a012a-58e3-408d-b4a6-4f460f0a0eaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:29:12.337625 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a012a-58e3-408d-b4a6-4f460f0a0eaf admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:12.414576 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ce566-6f2e-4864-9a3f-8554b4ce8571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:12.415441 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ce566-6f2e-4864-9a3f-8554b4ce8571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:12.415719 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ce566-6f2e-4864-9a3f-8554b4ce8571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:12.415985 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ce566-6f2e-4864-9a3f-8554b4ce8571 admin admin] PATH_INFO: `/v3/projects/ffea75b85b35424ab52232d707f42257` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:12.417206 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9ce566-6f2e-4864-9a3f-8554b4ce8571 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffea75b85b35424ab52232d707f42257)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:12.419761 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9ce566-6f2e-4864-9a3f-8554b4ce8571 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:12.426449 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:29:12.571318 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-1b9ce566-6f2e-4864-9a3f-8554b4ce8571 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffea75b85b35424ab52232d707f42257', 'request_id': 'req-1b9ce566-6f2e-4864-9a3f-8554b4ce8571'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:12.578258 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-1b9ce566-6f2e-4864-9a3f-8554b4ce8571 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffea75b85b35424ab52232d707f42257', 'request_id': 'req-1b9ce566-6f2e-4864-9a3f-8554b4ce8571'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:12.583934 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-1b9ce566-6f2e-4864-9a3f-8554b4ce8571 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffea75b85b35424ab52232d707f42257', 'request_id': 'req-1b9ce566-6f2e-4864-9a3f-8554b4ce8571'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:12.673762 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-1b9ce566-6f2e-4864-9a3f-8554b4ce8571 admin admin] The token cache is being invalidate because project ffea75b85b35424ab52232d707f42257 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:29:12.673974 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-1b9ce566-6f2e-4864-9a3f-8554b4ce8571 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:12.674643 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-1b9ce566-6f2e-4864-9a3f-8554b4ce8571 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:12.676237 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1189/2375] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:29:12 2022] DELETE /identity/v3/projects/ffea75b85b35424ab52232d707f42257 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:29:12.681178 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7cd418-c3e1-4771-992d-7d22a54f602e None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:12.681467 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7cd418-c3e1-4771-992d-7d22a54f602e None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:12.681742 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7cd418-c3e1-4771-992d-7d22a54f602e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:12.699106 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-5a7cd418-c3e1-4771-992d-7d22a54f602e None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:29:12.700910 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-5a7cd418-c3e1-4771-992d-7d22a54f602e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:29:12.760324 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1187/2376] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:29:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:29:12.769872 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa575bf-7821-4229-b4a4-d378987afd7e None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:12.770163 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa575bf-7821-4229-b4a4-d378987afd7e None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:12.770438 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa575bf-7821-4229-b4a4-d378987afd7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:12.789320 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-baa575bf-7821-4229-b4a4-d378987afd7e None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:29:12.790514 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-baa575bf-7821-4229-b4a4-d378987afd7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:29:12.798367 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1190/2377] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:29:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:29:12.802587 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7cd418-c3e1-4771-992d-7d22a54f602e None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:12.814369 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7cd418-c3e1-4771-992d-7d22a54f602e None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:12.818885 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67228524-45f1-41e1-bbe2-1af7fed63d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:12.819533 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67228524-45f1-41e1-bbe2-1af7fed63d9d admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:12.819809 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67228524-45f1-41e1-bbe2-1af7fed63d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:12.820078 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67228524-45f1-41e1-bbe2-1af7fed63d9d admin admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:12.820823 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67228524-45f1-41e1-bbe2-1af7fed63d9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:29:12.821125 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67228524-45f1-41e1-bbe2-1af7fed63d9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:12.822700 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67228524-45f1-41e1-bbe2-1af7fed63d9d admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:12.835145 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1188/2378] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:29:12.839425 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa575bf-7821-4229-b4a4-d378987afd7e None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:12.848869 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa575bf-7821-4229-b4a4-d378987afd7e None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:12.853660 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd8dd8-a544-483a-9f96-92dea196b039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:12.854305 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd8dd8-a544-483a-9f96-92dea196b039 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:12.854585 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd8dd8-a544-483a-9f96-92dea196b039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:12.854857 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd8dd8-a544-483a-9f96-92dea196b039 admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:12.855581 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd8dd8-a544-483a-9f96-92dea196b039 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:12.857768 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd8dd8-a544-483a-9f96-92dea196b039 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:12.962141 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1191/2379] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:29:12 2022] POST /identity/v3/projects => generated 365 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:29:12.965676 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67228524-45f1-41e1-bbe2-1af7fed63d9d admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:12.976643 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67228524-45f1-41e1-bbe2-1af7fed63d9d admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:13.003867 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:29:13.034301 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512bcacf-b2a9-4e5d-90de-5ece2ee6d354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:13.035032 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512bcacf-b2a9-4e5d-90de-5ece2ee6d354 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:13.035316 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512bcacf-b2a9-4e5d-90de-5ece2ee6d354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:13.035589 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512bcacf-b2a9-4e5d-90de-5ece2ee6d354 admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:13.036309 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512bcacf-b2a9-4e5d-90de-5ece2ee6d354 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:13.038252 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512bcacf-b2a9-4e5d-90de-5ece2ee6d354 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:13.143182 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1189/2380] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:29:12 2022] POST /identity/v3/users => generated 283 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:29:13.147248 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd8dd8-a544-483a-9f96-92dea196b039 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:13.158135 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd8dd8-a544-483a-9f96-92dea196b039 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:13.162660 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc7afe-5bca-47d1-ae46-a32e72bc9a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:13.163303 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc7afe-5bca-47d1-ae46-a32e72bc9a13 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:13.163582 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc7afe-5bca-47d1-ae46-a32e72bc9a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:13.163854 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc7afe-5bca-47d1-ae46-a32e72bc9a13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:13.164606 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc7afe-5bca-47d1-ae46-a32e72bc9a13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:13.166190 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc7afe-5bca-47d1-ae46-a32e72bc9a13 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:13.177260 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1192/2381] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:29:13.182872 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512bcacf-b2a9-4e5d-90de-5ece2ee6d354 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:13.193079 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512bcacf-b2a9-4e5d-90de-5ece2ee6d354 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:13.197720 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452febe2-c484-4d3c-81c1-55d570995ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:13.198411 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452febe2-c484-4d3c-81c1-55d570995ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:13.198927 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452febe2-c484-4d3c-81c1-55d570995ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:13.199375 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452febe2-c484-4d3c-81c1-55d570995ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:13.201295 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452febe2-c484-4d3c-81c1-55d570995ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:13.202836 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452febe2-c484-4d3c-81c1-55d570995ac6 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:13.213390 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1190/2382] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:29:13.218022 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc7afe-5bca-47d1-ae46-a32e72bc9a13 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:13.227744 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc7afe-5bca-47d1-ae46-a32e72bc9a13 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:13.232812 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db541ebb-aeb8-4143-8f64-fd9e4519304c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:13.233676 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db541ebb-aeb8-4143-8f64-fd9e4519304c admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:13.233956 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db541ebb-aeb8-4143-8f64-fd9e4519304c admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:13.234228 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db541ebb-aeb8-4143-8f64-fd9e4519304c admin admin] PATH_INFO: `/v3/projects/7cdf08082066415fad6ff9c3aecffd45/users/3e654a361d91467693be9a62df982fe0/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:13.248909 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db541ebb-aeb8-4143-8f64-fd9e4519304c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cdf08082066415fad6ff9c3aecffd45, user_id=3e654a361d91467693be9a62df982fe0, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:13.251819 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db541ebb-aeb8-4143-8f64-fd9e4519304c admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:13.360557 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1193/2383] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:29:13 2022] PUT /identity/v3/projects/7cdf08082066415fad6ff9c3aecffd45/users/3e654a361d91467693be9a62df982fe0/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:29:13.370794 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fe99d-4e79-4cfc-b945-8d9d90e19dcf None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:13.371077 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fe99d-4e79-4cfc-b945-8d9d90e19dcf None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:13.371348 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fe99d-4e79-4cfc-b945-8d9d90e19dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:13.398869 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-1e1fe99d-4e79-4cfc-b945-8d9d90e19dcf None None] MFA Rules not processed for user `3e654a361d91467693be9a62df982fe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:29:13.400170 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-1e1fe99d-4e79-4cfc-b945-8d9d90e19dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:29:13.466761 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1191/2384] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:29:13 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:29:13.471207 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db541ebb-aeb8-4143-8f64-fd9e4519304c admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:13.534515 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db541ebb-aeb8-4143-8f64-fd9e4519304c admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:13.539929 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385436e0-65cd-40cc-bb34-929d722ca53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:13.540618 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385436e0-65cd-40cc-bb34-929d722ca53f admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:13.540900 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385436e0-65cd-40cc-bb34-929d722ca53f admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:13.541172 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385436e0-65cd-40cc-bb34-929d722ca53f admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:13.541868 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385436e0-65cd-40cc-bb34-929d722ca53f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:13.543835 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385436e0-65cd-40cc-bb34-929d722ca53f admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:13.662026 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1194/2385] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:29:13 2022] POST /identity/v3/projects => generated 365 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:29:13.663162 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1fe99d-4e79-4cfc-b945-8d9d90e19dcf None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:13.675960 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1fe99d-4e79-4cfc-b945-8d9d90e19dcf None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:13.734240 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131e7a2-fd5c-449c-93a9-a8996386162b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:13.734867 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131e7a2-fd5c-449c-93a9-a8996386162b admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:13.735158 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131e7a2-fd5c-449c-93a9-a8996386162b admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:13.735435 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131e7a2-fd5c-449c-93a9-a8996386162b admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:13.736124 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8131e7a2-fd5c-449c-93a9-a8996386162b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:13.738077 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8131e7a2-fd5c-449c-93a9-a8996386162b admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:13.832135 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1192/2386] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:29:13 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:29:13.833396 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385436e0-65cd-40cc-bb34-929d722ca53f admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:13.844351 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385436e0-65cd-40cc-bb34-929d722ca53f admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:13.850138 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724560a6-b0e2-425e-8b4c-debd454f4e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:13.850805 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724560a6-b0e2-425e-8b4c-debd454f4e90 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:13.851091 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724560a6-b0e2-425e-8b4c-debd454f4e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:13.851366 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724560a6-b0e2-425e-8b4c-debd454f4e90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:13.852094 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724560a6-b0e2-425e-8b4c-debd454f4e90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:13.853752 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724560a6-b0e2-425e-8b4c-debd454f4e90 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:13.865905 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1195/2387] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:29:13.876793 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131e7a2-fd5c-449c-93a9-a8996386162b admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:13.887482 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131e7a2-fd5c-449c-93a9-a8996386162b admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:13.892762 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b4374-3e52-400f-a836-c5975b30dfa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:13.893649 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b4374-3e52-400f-a836-c5975b30dfa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:13.893932 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b4374-3e52-400f-a836-c5975b30dfa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:13.894232 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b4374-3e52-400f-a836-c5975b30dfa4 admin admin] PATH_INFO: `/v3/projects/fbdbdd2209464e538dda1d1fbaac9ef5/users/79e5205f45154cb0a87276fe0eaab610/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:13.910728 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b4374-3e52-400f-a836-c5975b30dfa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbdbdd2209464e538dda1d1fbaac9ef5, user_id=79e5205f45154cb0a87276fe0eaab610, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:13.913465 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b4374-3e52-400f-a836-c5975b30dfa4 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:13.983589 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1193/2388] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:29:13 2022] PUT /identity/v3/projects/fbdbdd2209464e538dda1d1fbaac9ef5/users/79e5205f45154cb0a87276fe0eaab610/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:29:13.988519 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724560a6-b0e2-425e-8b4c-debd454f4e90 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:13.995200 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:29:13.999750 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724560a6-b0e2-425e-8b4c-debd454f4e90 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:14.058356 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aba88f-0024-4a17-96f9-10a7a6666437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:14.059379 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aba88f-0024-4a17-96f9-10a7a6666437 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:14.059828 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aba88f-0024-4a17-96f9-10a7a6666437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:14.060176 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aba88f-0024-4a17-96f9-10a7a6666437 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:14.060917 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aba88f-0024-4a17-96f9-10a7a6666437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:14.062578 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aba88f-0024-4a17-96f9-10a7a6666437 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:14.076128 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1196/2389] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:29:14.077353 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b4374-3e52-400f-a836-c5975b30dfa4 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:14.083005 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:29:14.088416 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b4374-3e52-400f-a836-c5975b30dfa4 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:14.093702 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db50601-1e7b-45a8-8433-06677dec844a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:14.094587 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db50601-1e7b-45a8-8433-06677dec844a admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:14.094865 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db50601-1e7b-45a8-8433-06677dec844a admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:14.095277 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db50601-1e7b-45a8-8433-06677dec844a admin admin] PATH_INFO: `/v3/projects/fbdbdd2209464e538dda1d1fbaac9ef5/users/79e5205f45154cb0a87276fe0eaab610/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:14.097266 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db50601-1e7b-45a8-8433-06677dec844a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbdbdd2209464e538dda1d1fbaac9ef5, user_id=79e5205f45154cb0a87276fe0eaab610, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:14.099903 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db50601-1e7b-45a8-8433-06677dec844a admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:14.110171 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1194/2390] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:29:14 2022] PUT /identity/v3/projects/fbdbdd2209464e538dda1d1fbaac9ef5/users/79e5205f45154cb0a87276fe0eaab610/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:29:14.120314 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094bcb5-b338-46c8-87a2-c37ac277b36e None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:14.120622 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094bcb5-b338-46c8-87a2-c37ac277b36e None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:14.120895 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094bcb5-b338-46c8-87a2-c37ac277b36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:14.147625 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-e094bcb5-b338-46c8-87a2-c37ac277b36e None None] MFA Rules not processed for user `79e5205f45154cb0a87276fe0eaab610`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:29:14.148863 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-e094bcb5-b338-46c8-87a2-c37ac277b36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:29:14.217655 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1197/2391] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:29:14 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:29:14.229722 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db50601-1e7b-45a8-8433-06677dec844a admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:14.231403 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-8db50601-1e7b-45a8-8433-06677dec844a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:29:14.296528 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db50601-1e7b-45a8-8433-06677dec844a admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:14.300734 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3757ae5-953a-4b8b-881a-4466c86ae7bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:14.301402 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3757ae5-953a-4b8b-881a-4466c86ae7bd service cinder] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:14.301687 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3757ae5-953a-4b8b-881a-4466c86ae7bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:14.301965 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3757ae5-953a-4b8b-881a-4466c86ae7bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:14.312359 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3757ae5-953a-4b8b-881a-4466c86ae7bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:14.313789 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3757ae5-953a-4b8b-881a-4466c86ae7bd service cinder] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:14.324291 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1195/2392] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:29:14 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:29:14.568995 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094bcb5-b338-46c8-87a2-c37ac277b36e None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:14.579284 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094bcb5-b338-46c8-87a2-c37ac277b36e None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:14.583131 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a95371-1122-4a66-9434-e234a3539abb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:14.583652 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a95371-1122-4a66-9434-e234a3539abb service cinder] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:14.583937 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a95371-1122-4a66-9434-e234a3539abb service cinder] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:14.584398 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a95371-1122-4a66-9434-e234a3539abb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:14.662683 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a95371-1122-4a66-9434-e234a3539abb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:14.664649 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a95371-1122-4a66-9434-e234a3539abb service cinder] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:14.674939 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1198/2393] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:29:14 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:29:24.319223 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:29:24.671353 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=89 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:29:27.614810 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3757ae5-953a-4b8b-881a-4466c86ae7bd service cinder] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:27.676673 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3757ae5-953a-4b8b-881a-4466c86ae7bd service cinder] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:27.681179 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868c728-5bcf-454b-a64f-74e4916ef8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:27.682036 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868c728-5bcf-454b-a64f-74e4916ef8d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:27.682314 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868c728-5bcf-454b-a64f-74e4916ef8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:27.682585 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868c728-5bcf-454b-a64f-74e4916ef8d3 admin admin] PATH_INFO: `/v3/users/3e654a361d91467693be9a62df982fe0` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:27.683767 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3868c728-5bcf-454b-a64f-74e4916ef8d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e654a361d91467693be9a62df982fe0)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:27.685705 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3868c728-5bcf-454b-a64f-74e4916ef8d3 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:27.898898 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-3868c728-5bcf-454b-a64f-74e4916ef8d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e654a361d91467693be9a62df982fe0'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:27.910394 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-3868c728-5bcf-454b-a64f-74e4916ef8d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e654a361d91467693be9a62df982fe0'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:27.911048 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-3868c728-5bcf-454b-a64f-74e4916ef8d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e654a361d91467693be9a62df982fe0'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:27.917837 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-3868c728-5bcf-454b-a64f-74e4916ef8d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e654a361d91467693be9a62df982fe0'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:27.918459 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-3868c728-5bcf-454b-a64f-74e4916ef8d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e654a361d91467693be9a62df982fe0'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:27.987985 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1196/2394] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:29:27 2022] DELETE /identity/v3/users/3e654a361d91467693be9a62df982fe0 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:29:27.992340 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425af984-668d-4fed-ace4-15fa96749298 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:27.992815 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425af984-668d-4fed-ace4-15fa96749298 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:27.992928 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425af984-668d-4fed-ace4-15fa96749298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:28.011333 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-425af984-668d-4fed-ace4-15fa96749298 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:29:28.012550 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-425af984-668d-4fed-ace4-15fa96749298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:29:28.069869 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1199/2395] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:29:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:29:28.080111 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868c728-5bcf-454b-a64f-74e4916ef8d3 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:28.081507 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-3868c728-5bcf-454b-a64f-74e4916ef8d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:29:28.137635 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868c728-5bcf-454b-a64f-74e4916ef8d3 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:28.141865 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddbc94-b7da-4453-a213-ddf62e2ac942 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:28.142497 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddbc94-b7da-4453-a213-ddf62e2ac942 service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:28.142774 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddbc94-b7da-4453-a213-ddf62e2ac942 service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:28.143049 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddbc94-b7da-4453-a213-ddf62e2ac942 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:28.151911 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ddbc94-b7da-4453-a213-ddf62e2ac942 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:28.153309 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ddbc94-b7da-4453-a213-ddf62e2ac942 service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:28.162506 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1197/2396] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:29:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:29:28.589512 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425af984-668d-4fed-ace4-15fa96749298 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:28.591091 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-425af984-668d-4fed-ace4-15fa96749298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:29:28.604418 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425af984-668d-4fed-ace4-15fa96749298 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:28.609575 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075bded0-ebeb-4f56-bbf5-1ccf2e6e0c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:28.610638 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bded0-ebeb-4f56-bbf5-1ccf2e6e0c5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:28.610919 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bded0-ebeb-4f56-bbf5-1ccf2e6e0c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:28.611197 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bded0-ebeb-4f56-bbf5-1ccf2e6e0c5b admin admin] PATH_INFO: `/v3/projects/7cdf08082066415fad6ff9c3aecffd45` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:28.612432 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075bded0-ebeb-4f56-bbf5-1ccf2e6e0c5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cdf08082066415fad6ff9c3aecffd45)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:28.614417 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075bded0-ebeb-4f56-bbf5-1ccf2e6e0c5b admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:28.728994 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-075bded0-ebeb-4f56-bbf5-1ccf2e6e0c5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cdf08082066415fad6ff9c3aecffd45', 'request_id': 'req-075bded0-ebeb-4f56-bbf5-1ccf2e6e0c5b'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:28.735581 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-075bded0-ebeb-4f56-bbf5-1ccf2e6e0c5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cdf08082066415fad6ff9c3aecffd45', 'request_id': 'req-075bded0-ebeb-4f56-bbf5-1ccf2e6e0c5b'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:28.741301 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-075bded0-ebeb-4f56-bbf5-1ccf2e6e0c5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cdf08082066415fad6ff9c3aecffd45', 'request_id': 'req-075bded0-ebeb-4f56-bbf5-1ccf2e6e0c5b'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:28.805429 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-075bded0-ebeb-4f56-bbf5-1ccf2e6e0c5b admin admin] The token cache is being invalidate because project 7cdf08082066415fad6ff9c3aecffd45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:29:28.805744 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-075bded0-ebeb-4f56-bbf5-1ccf2e6e0c5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:28.806375 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-075bded0-ebeb-4f56-bbf5-1ccf2e6e0c5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:28.807956 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1200/2397] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:29:28 2022] DELETE /identity/v3/projects/7cdf08082066415fad6ff9c3aecffd45 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:29:28.812182 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddbc94-b7da-4453-a213-ddf62e2ac942 service neutron] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:28.823265 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddbc94-b7da-4453-a213-ddf62e2ac942 service neutron] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:28.841235 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:29:28.880816 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5438d-0bfa-46e5-9cb1-eddbbd97fca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:28.881691 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5438d-0bfa-46e5-9cb1-eddbbd97fca3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:28.882008 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5438d-0bfa-46e5-9cb1-eddbbd97fca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:28.882285 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5438d-0bfa-46e5-9cb1-eddbbd97fca3 admin admin] PATH_INFO: `/v3/users/79e5205f45154cb0a87276fe0eaab610` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:28.883626 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d5438d-0bfa-46e5-9cb1-eddbbd97fca3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79e5205f45154cb0a87276fe0eaab610)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:28.885611 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d5438d-0bfa-46e5-9cb1-eddbbd97fca3 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:29.064620 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-86d5438d-0bfa-46e5-9cb1-eddbbd97fca3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79e5205f45154cb0a87276fe0eaab610'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:29.076268 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-86d5438d-0bfa-46e5-9cb1-eddbbd97fca3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79e5205f45154cb0a87276fe0eaab610'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:29.076926 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-86d5438d-0bfa-46e5-9cb1-eddbbd97fca3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79e5205f45154cb0a87276fe0eaab610'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:29.083773 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-86d5438d-0bfa-46e5-9cb1-eddbbd97fca3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79e5205f45154cb0a87276fe0eaab610'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:29.084473 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-86d5438d-0bfa-46e5-9cb1-eddbbd97fca3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79e5205f45154cb0a87276fe0eaab610'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:29.164888 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1198/2398] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:29:28 2022] DELETE /identity/v3/users/79e5205f45154cb0a87276fe0eaab610 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:29:29.588866 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075bded0-ebeb-4f56-bbf5-1ccf2e6e0c5b admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:29.590281 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-075bded0-ebeb-4f56-bbf5-1ccf2e6e0c5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:29:29.604623 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075bded0-ebeb-4f56-bbf5-1ccf2e6e0c5b admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:29.661447 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6865ef9-08a5-44c1-b7c8-20108e6c2f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:29.662307 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6865ef9-08a5-44c1-b7c8-20108e6c2f07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:29.662586 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6865ef9-08a5-44c1-b7c8-20108e6c2f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:29.662861 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6865ef9-08a5-44c1-b7c8-20108e6c2f07 admin admin] PATH_INFO: `/v3/projects/fbdbdd2209464e538dda1d1fbaac9ef5` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:29.664224 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6865ef9-08a5-44c1-b7c8-20108e6c2f07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbdbdd2209464e538dda1d1fbaac9ef5)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:29.666451 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6865ef9-08a5-44c1-b7c8-20108e6c2f07 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:29.795473 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:29:29.820278 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-e6865ef9-08a5-44c1-b7c8-20108e6c2f07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbdbdd2209464e538dda1d1fbaac9ef5', 'request_id': 'req-e6865ef9-08a5-44c1-b7c8-20108e6c2f07'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:29.826477 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-e6865ef9-08a5-44c1-b7c8-20108e6c2f07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbdbdd2209464e538dda1d1fbaac9ef5', 'request_id': 'req-e6865ef9-08a5-44c1-b7c8-20108e6c2f07'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:29.832789 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-e6865ef9-08a5-44c1-b7c8-20108e6c2f07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbdbdd2209464e538dda1d1fbaac9ef5', 'request_id': 'req-e6865ef9-08a5-44c1-b7c8-20108e6c2f07'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:29.913311 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-e6865ef9-08a5-44c1-b7c8-20108e6c2f07 admin admin] The token cache is being invalidate because project fbdbdd2209464e538dda1d1fbaac9ef5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:29:29.913594 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-e6865ef9-08a5-44c1-b7c8-20108e6c2f07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:29.914237 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-e6865ef9-08a5-44c1-b7c8-20108e6c2f07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:29.915830 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1201/2399] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:29:29 2022] DELETE /identity/v3/projects/fbdbdd2209464e538dda1d1fbaac9ef5 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:29:29.920723 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ad96b-fb6d-4120-826f-f1a0fa125eff None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:29.921207 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ad96b-fb6d-4120-826f-f1a0fa125eff None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:29.921314 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ad96b-fb6d-4120-826f-f1a0fa125eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:29.940068 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-240ad96b-fb6d-4120-826f-f1a0fa125eff None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:29:29.941296 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-240ad96b-fb6d-4120-826f-f1a0fa125eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:29:30.003162 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1199/2400] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:29:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:29:30.011036 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affab503-d450-4da7-bde6-b76edcc98ab0 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:30.011326 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affab503-d450-4da7-bde6-b76edcc98ab0 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:30.011604 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affab503-d450-4da7-bde6-b76edcc98ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:30.030686 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-affab503-d450-4da7-bde6-b76edcc98ab0 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:29:30.031879 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-affab503-d450-4da7-bde6-b76edcc98ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:29:30.039665 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1202/2401] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:29:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:29:30.043795 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ad96b-fb6d-4120-826f-f1a0fa125eff None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:30.054093 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ad96b-fb6d-4120-826f-f1a0fa125eff None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:30.058578 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b7b5c5-2160-4e47-8c3b-0d5f2f8f52dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:30.059221 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7b5c5-2160-4e47-8c3b-0d5f2f8f52dc admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:30.059502 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7b5c5-2160-4e47-8c3b-0d5f2f8f52dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:30.059776 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7b5c5-2160-4e47-8c3b-0d5f2f8f52dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:30.060530 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b7b5c5-2160-4e47-8c3b-0d5f2f8f52dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:29:30.060833 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b7b5c5-2160-4e47-8c3b-0d5f2f8f52dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:30.062510 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b7b5c5-2160-4e47-8c3b-0d5f2f8f52dc admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:30.074478 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1200/2402] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:29:30.079215 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affab503-d450-4da7-bde6-b76edcc98ab0 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:30.088436 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affab503-d450-4da7-bde6-b76edcc98ab0 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:30.093035 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f49d46-85db-4656-8b3e-3fe767b65aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:30.093732 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f49d46-85db-4656-8b3e-3fe767b65aae admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:30.094224 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f49d46-85db-4656-8b3e-3fe767b65aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:30.094638 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f49d46-85db-4656-8b3e-3fe767b65aae admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:30.095333 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f49d46-85db-4656-8b3e-3fe767b65aae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:30.097338 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f49d46-85db-4656-8b3e-3fe767b65aae admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:30.183886 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1203/2403] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:29:30 2022] POST /identity/v3/projects => generated 393 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:29:30.188646 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b7b5c5-2160-4e47-8c3b-0d5f2f8f52dc admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:30.198853 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b7b5c5-2160-4e47-8c3b-0d5f2f8f52dc admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:30.224740 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:29:30.254619 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046613db-b065-45a9-a6c0-5e20a1392a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:30.255278 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046613db-b065-45a9-a6c0-5e20a1392a15 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:30.255622 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046613db-b065-45a9-a6c0-5e20a1392a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:30.256100 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046613db-b065-45a9-a6c0-5e20a1392a15 admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:30.257333 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046613db-b065-45a9-a6c0-5e20a1392a15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:30.259302 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046613db-b065-45a9-a6c0-5e20a1392a15 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:30.315126 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1201/2404] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:29:30 2022] POST /identity/v3/users => generated 297 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:29:30.320333 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f49d46-85db-4656-8b3e-3fe767b65aae admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:30.332676 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f49d46-85db-4656-8b3e-3fe767b65aae admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:30.337682 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b748bd-22be-431a-9115-919d51e1c840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:30.338374 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b748bd-22be-431a-9115-919d51e1c840 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:30.338715 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b748bd-22be-431a-9115-919d51e1c840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:30.338941 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b748bd-22be-431a-9115-919d51e1c840 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:30.339668 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b748bd-22be-431a-9115-919d51e1c840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:30.341332 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b748bd-22be-431a-9115-919d51e1c840 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:30.352219 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1204/2405] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:29:30.356684 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046613db-b065-45a9-a6c0-5e20a1392a15 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:30.367084 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046613db-b065-45a9-a6c0-5e20a1392a15 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:30.371587 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9400f22-090b-4fbc-8fe6-cbc8dd80cf38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:30.372271 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9400f22-090b-4fbc-8fe6-cbc8dd80cf38 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:30.372553 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9400f22-090b-4fbc-8fe6-cbc8dd80cf38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:30.372827 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9400f22-090b-4fbc-8fe6-cbc8dd80cf38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:30.373538 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9400f22-090b-4fbc-8fe6-cbc8dd80cf38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:30.376070 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9400f22-090b-4fbc-8fe6-cbc8dd80cf38 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:30.385820 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1202/2406] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:29:30.389924 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b748bd-22be-431a-9115-919d51e1c840 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:30.400010 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b748bd-22be-431a-9115-919d51e1c840 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:30.404670 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc3615-de77-48dc-aaea-40b9d827174d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:30.405566 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc3615-de77-48dc-aaea-40b9d827174d admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:30.405821 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc3615-de77-48dc-aaea-40b9d827174d admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:30.406143 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc3615-de77-48dc-aaea-40b9d827174d admin admin] PATH_INFO: `/v3/projects/a86ec36c30c44326ab57cd186c55d0f4/users/53fd2ee84e134ec5876617c3de1c9935/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:30.420687 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc3615-de77-48dc-aaea-40b9d827174d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a86ec36c30c44326ab57cd186c55d0f4, user_id=53fd2ee84e134ec5876617c3de1c9935, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:30.423955 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc3615-de77-48dc-aaea-40b9d827174d admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:30.519437 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1205/2407] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:29:30 2022] PUT /identity/v3/projects/a86ec36c30c44326ab57cd186c55d0f4/users/53fd2ee84e134ec5876617c3de1c9935/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:29:30.529854 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdcaf9-782b-4f7a-9704-bd9351f0e35c None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:30.530153 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdcaf9-782b-4f7a-9704-bd9351f0e35c None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:30.530454 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdcaf9-782b-4f7a-9704-bd9351f0e35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:30.558510 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-31bdcaf9-782b-4f7a-9704-bd9351f0e35c None None] MFA Rules not processed for user `53fd2ee84e134ec5876617c3de1c9935`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:29:30.559684 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-31bdcaf9-782b-4f7a-9704-bd9351f0e35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:29:30.623375 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1203/2408] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:29:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:29:30.628286 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc3615-de77-48dc-aaea-40b9d827174d admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:30.689129 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc3615-de77-48dc-aaea-40b9d827174d admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:30.694168 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8c0eb-bd33-4e5d-a143-8fe879a73546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:30.694850 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8c0eb-bd33-4e5d-a143-8fe879a73546 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:30.695130 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8c0eb-bd33-4e5d-a143-8fe879a73546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:30.695403 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8c0eb-bd33-4e5d-a143-8fe879a73546 admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:30.696082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df8c0eb-bd33-4e5d-a143-8fe879a73546 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:30.698300 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df8c0eb-bd33-4e5d-a143-8fe879a73546 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:30.795544 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1206/2409] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:29:30 2022] POST /identity/v3/projects => generated 393 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:29:30.800525 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bdcaf9-782b-4f7a-9704-bd9351f0e35c None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:30.811896 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bdcaf9-782b-4f7a-9704-bd9351f0e35c None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:30.868616 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6eb78-2228-4a1d-9ce1-ac2d8e51e13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:30.869288 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6eb78-2228-4a1d-9ce1-ac2d8e51e13f admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:30.869590 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6eb78-2228-4a1d-9ce1-ac2d8e51e13f admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:30.869862 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6eb78-2228-4a1d-9ce1-ac2d8e51e13f admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:30.870558 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f6eb78-2228-4a1d-9ce1-ac2d8e51e13f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:30.872491 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f6eb78-2228-4a1d-9ce1-ac2d8e51e13f admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:30.993347 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1204/2410] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:29:30 2022] POST /identity/v3/users => generated 303 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:29:30.997438 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8c0eb-bd33-4e5d-a143-8fe879a73546 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:31.008403 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8c0eb-bd33-4e5d-a143-8fe879a73546 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:31.013059 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f418b-c93f-4cfc-ba0b-3b8bd2d914e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:31.013723 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f418b-c93f-4cfc-ba0b-3b8bd2d914e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:31.013998 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f418b-c93f-4cfc-ba0b-3b8bd2d914e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:31.014274 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f418b-c93f-4cfc-ba0b-3b8bd2d914e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:31.014996 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f418b-c93f-4cfc-ba0b-3b8bd2d914e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:31.017185 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f418b-c93f-4cfc-ba0b-3b8bd2d914e5 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:31.027922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1207/2411] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:29:31.033203 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6eb78-2228-4a1d-9ce1-ac2d8e51e13f admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:31.043292 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6eb78-2228-4a1d-9ce1-ac2d8e51e13f admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:31.048900 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed50df6-9bdb-4000-8c8e-8ae09646f13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:31.049719 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed50df6-9bdb-4000-8c8e-8ae09646f13c admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:31.050200 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed50df6-9bdb-4000-8c8e-8ae09646f13c admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:31.050434 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed50df6-9bdb-4000-8c8e-8ae09646f13c admin admin] PATH_INFO: `/v3/projects/6d5d04ef285e4fcbbf16782066183319/users/b4ad23a222914055904bae5bb544bb09/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:31.069245 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed50df6-9bdb-4000-8c8e-8ae09646f13c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d5d04ef285e4fcbbf16782066183319, user_id=b4ad23a222914055904bae5bb544bb09, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:31.071951 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed50df6-9bdb-4000-8c8e-8ae09646f13c admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:31.188725 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1205/2412] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:29:31 2022] PUT /identity/v3/projects/6d5d04ef285e4fcbbf16782066183319/users/b4ad23a222914055904bae5bb544bb09/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:29:31.192741 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f418b-c93f-4cfc-ba0b-3b8bd2d914e5 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:31.202579 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f418b-c93f-4cfc-ba0b-3b8bd2d914e5 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:31.222759 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:29:31.260280 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43306d69-9e20-4677-a149-d1515c5dcdf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:31.260280 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43306d69-9e20-4677-a149-d1515c5dcdf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:31.260280 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43306d69-9e20-4677-a149-d1515c5dcdf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:31.260280 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43306d69-9e20-4677-a149-d1515c5dcdf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:31.260886 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43306d69-9e20-4677-a149-d1515c5dcdf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:31.262480 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43306d69-9e20-4677-a149-d1515c5dcdf9 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:31.272563 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1208/2413] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:29:31.276641 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed50df6-9bdb-4000-8c8e-8ae09646f13c admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:31.282889 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:29:31.288196 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed50df6-9bdb-4000-8c8e-8ae09646f13c admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:31.292881 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9df4e-0f17-489d-95ae-fd3bc3fb7690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:31.293761 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9df4e-0f17-489d-95ae-fd3bc3fb7690 admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:31.294044 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9df4e-0f17-489d-95ae-fd3bc3fb7690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:31.294315 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9df4e-0f17-489d-95ae-fd3bc3fb7690 admin admin] PATH_INFO: `/v3/projects/6d5d04ef285e4fcbbf16782066183319/users/b4ad23a222914055904bae5bb544bb09/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:31.296356 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf9df4e-0f17-489d-95ae-fd3bc3fb7690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d5d04ef285e4fcbbf16782066183319, user_id=b4ad23a222914055904bae5bb544bb09, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:31.299835 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf9df4e-0f17-489d-95ae-fd3bc3fb7690 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:31.310151 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1206/2414] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:29:31 2022] PUT /identity/v3/projects/6d5d04ef285e4fcbbf16782066183319/users/b4ad23a222914055904bae5bb544bb09/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:29:31.321634 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512aa6f0-3a36-4a7b-a100-026532e84ed1 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:31.321948 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512aa6f0-3a36-4a7b-a100-026532e84ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:31.322228 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512aa6f0-3a36-4a7b-a100-026532e84ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:31.350385 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-512aa6f0-3a36-4a7b-a100-026532e84ed1 None None] MFA Rules not processed for user `b4ad23a222914055904bae5bb544bb09`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:29:31.351577 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-512aa6f0-3a36-4a7b-a100-026532e84ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:29:31.552806 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1209/2415] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:29:31 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:29:31.565095 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9df4e-0f17-489d-95ae-fd3bc3fb7690 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:31.566816 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-5bf9df4e-0f17-489d-95ae-fd3bc3fb7690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:29:31.622546 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9df4e-0f17-489d-95ae-fd3bc3fb7690 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:31.626464 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91a33c-5b72-4f79-9ae3-05a76f2d366c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:31.627092 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91a33c-5b72-4f79-9ae3-05a76f2d366c service cinder] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:31.627373 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91a33c-5b72-4f79-9ae3-05a76f2d366c service cinder] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:31.627646 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91a33c-5b72-4f79-9ae3-05a76f2d366c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:31.636746 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91a33c-5b72-4f79-9ae3-05a76f2d366c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:31.638155 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91a33c-5b72-4f79-9ae3-05a76f2d366c service cinder] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:31.648275 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1207/2416] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:29:31 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:29:31.693089 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512aa6f0-3a36-4a7b-a100-026532e84ed1 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:31.694450 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-512aa6f0-3a36-4a7b-a100-026532e84ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:29:31.706777 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512aa6f0-3a36-4a7b-a100-026532e84ed1 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:31.710301 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c0b0f-c383-4beb-9c9a-a96b6fe21e23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:31.710931 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c0b0f-c383-4beb-9c9a-a96b6fe21e23 service cinder] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:31.711207 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c0b0f-c383-4beb-9c9a-a96b6fe21e23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:31.711480 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c0b0f-c383-4beb-9c9a-a96b6fe21e23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:31.767630 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1c0b0f-c383-4beb-9c9a-a96b6fe21e23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:31.769108 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1c0b0f-c383-4beb-9c9a-a96b6fe21e23 service cinder] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:31.777902 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1210/2417] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:29:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:29:37.538426 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91a33c-5b72-4f79-9ae3-05a76f2d366c service cinder] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:37.600128 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91a33c-5b72-4f79-9ae3-05a76f2d366c service cinder] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:37.604618 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db92112b-fa7e-4bdb-80da-129052fadd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:37.605475 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92112b-fa7e-4bdb-80da-129052fadd56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:37.605754 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92112b-fa7e-4bdb-80da-129052fadd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:37.606030 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92112b-fa7e-4bdb-80da-129052fadd56 admin admin] PATH_INFO: `/v3/users/53fd2ee84e134ec5876617c3de1c9935` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:37.607199 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db92112b-fa7e-4bdb-80da-129052fadd56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53fd2ee84e134ec5876617c3de1c9935)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:37.609138 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db92112b-fa7e-4bdb-80da-129052fadd56 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:37.824604 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-db92112b-fa7e-4bdb-80da-129052fadd56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53fd2ee84e134ec5876617c3de1c9935'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:37.836328 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-db92112b-fa7e-4bdb-80da-129052fadd56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53fd2ee84e134ec5876617c3de1c9935'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:37.837270 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-db92112b-fa7e-4bdb-80da-129052fadd56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53fd2ee84e134ec5876617c3de1c9935'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:37.844006 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-db92112b-fa7e-4bdb-80da-129052fadd56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53fd2ee84e134ec5876617c3de1c9935'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:37.845259 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-db92112b-fa7e-4bdb-80da-129052fadd56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53fd2ee84e134ec5876617c3de1c9935'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:37.947846 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1208/2418] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:29:37 2022] DELETE /identity/v3/users/53fd2ee84e134ec5876617c3de1c9935 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:29:37.952376 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78029525-e0a8-47e3-aaf6-10a2c0880d84 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:37.952917 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78029525-e0a8-47e3-aaf6-10a2c0880d84 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:37.953028 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78029525-e0a8-47e3-aaf6-10a2c0880d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:37.971337 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-78029525-e0a8-47e3-aaf6-10a2c0880d84 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:29:37.972561 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-78029525-e0a8-47e3-aaf6-10a2c0880d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:29:38.011932 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:29:38.030349 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1211/2419] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:29:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:29:38.040635 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db92112b-fa7e-4bdb-80da-129052fadd56 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:38.042018 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-db92112b-fa7e-4bdb-80da-129052fadd56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:29:38.055458 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:29:38.100352 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db92112b-fa7e-4bdb-80da-129052fadd56 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:38.103933 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be86ae4-47bd-4e3b-8910-5a3f1aac6caf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:38.104609 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be86ae4-47bd-4e3b-8910-5a3f1aac6caf service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:38.104939 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be86ae4-47bd-4e3b-8910-5a3f1aac6caf service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:38.105205 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be86ae4-47bd-4e3b-8910-5a3f1aac6caf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:38.114723 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be86ae4-47bd-4e3b-8910-5a3f1aac6caf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:38.116252 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be86ae4-47bd-4e3b-8910-5a3f1aac6caf service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:38.125836 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1209/2420] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:29:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:29:38.531593 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78029525-e0a8-47e3-aaf6-10a2c0880d84 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:38.533812 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-78029525-e0a8-47e3-aaf6-10a2c0880d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:29:38.545677 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78029525-e0a8-47e3-aaf6-10a2c0880d84 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:38.551272 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eaf586-33dd-4f42-b2bd-3106ea23e0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:38.552134 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eaf586-33dd-4f42-b2bd-3106ea23e0ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:38.552467 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eaf586-33dd-4f42-b2bd-3106ea23e0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:38.552743 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eaf586-33dd-4f42-b2bd-3106ea23e0ce admin admin] PATH_INFO: `/v3/projects/a86ec36c30c44326ab57cd186c55d0f4` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:38.553994 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eaf586-33dd-4f42-b2bd-3106ea23e0ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=a86ec36c30c44326ab57cd186c55d0f4)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:38.555839 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eaf586-33dd-4f42-b2bd-3106ea23e0ce admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:38.680185 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-f6eaf586-33dd-4f42-b2bd-3106ea23e0ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a86ec36c30c44326ab57cd186c55d0f4', 'request_id': 'req-f6eaf586-33dd-4f42-b2bd-3106ea23e0ce'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:38.686201 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-f6eaf586-33dd-4f42-b2bd-3106ea23e0ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a86ec36c30c44326ab57cd186c55d0f4', 'request_id': 'req-f6eaf586-33dd-4f42-b2bd-3106ea23e0ce'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:38.691826 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-f6eaf586-33dd-4f42-b2bd-3106ea23e0ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a86ec36c30c44326ab57cd186c55d0f4', 'request_id': 'req-f6eaf586-33dd-4f42-b2bd-3106ea23e0ce'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:38.787782 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-f6eaf586-33dd-4f42-b2bd-3106ea23e0ce admin admin] The token cache is being invalidate because project a86ec36c30c44326ab57cd186c55d0f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:29:38.788068 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-f6eaf586-33dd-4f42-b2bd-3106ea23e0ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:38.788729 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-f6eaf586-33dd-4f42-b2bd-3106ea23e0ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:38.790292 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1212/2421] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:29:38 2022] DELETE /identity/v3/projects/a86ec36c30c44326ab57cd186c55d0f4 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:29:38.794357 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be86ae4-47bd-4e3b-8910-5a3f1aac6caf service neutron] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:38.804120 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be86ae4-47bd-4e3b-8910-5a3f1aac6caf service neutron] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:38.859590 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a7c81-c8fb-4639-a063-bb51370d14a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:38.860663 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a7c81-c8fb-4639-a063-bb51370d14a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:38.860945 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a7c81-c8fb-4639-a063-bb51370d14a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:38.861243 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a7c81-c8fb-4639-a063-bb51370d14a5 admin admin] PATH_INFO: `/v3/users/b4ad23a222914055904bae5bb544bb09` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:38.862417 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a7c81-c8fb-4639-a063-bb51370d14a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4ad23a222914055904bae5bb544bb09)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:38.864343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a7c81-c8fb-4639-a063-bb51370d14a5 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:39.097323 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-328a7c81-c8fb-4639-a063-bb51370d14a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4ad23a222914055904bae5bb544bb09'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:39.108941 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-328a7c81-c8fb-4639-a063-bb51370d14a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4ad23a222914055904bae5bb544bb09'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:39.109606 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-328a7c81-c8fb-4639-a063-bb51370d14a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4ad23a222914055904bae5bb544bb09'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:39.116346 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-328a7c81-c8fb-4639-a063-bb51370d14a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4ad23a222914055904bae5bb544bb09'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:39.116978 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-328a7c81-c8fb-4639-a063-bb51370d14a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4ad23a222914055904bae5bb544bb09'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:39.176155 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1210/2422] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:29:38 2022] DELETE /identity/v3/users/b4ad23a222914055904bae5bb544bb09 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:29:39.579328 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eaf586-33dd-4f42-b2bd-3106ea23e0ce admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:39.581093 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-f6eaf586-33dd-4f42-b2bd-3106ea23e0ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:29:39.600366 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eaf586-33dd-4f42-b2bd-3106ea23e0ce admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:39.652206 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7297fb7-e805-4479-a332-1c65db789914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:39.653080 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7297fb7-e805-4479-a332-1c65db789914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:39.653355 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7297fb7-e805-4479-a332-1c65db789914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:39.653624 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7297fb7-e805-4479-a332-1c65db789914 admin admin] PATH_INFO: `/v3/projects/6d5d04ef285e4fcbbf16782066183319` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:39.654809 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7297fb7-e805-4479-a332-1c65db789914 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d5d04ef285e4fcbbf16782066183319)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:39.657404 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7297fb7-e805-4479-a332-1c65db789914 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:39.806231 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-d7297fb7-e805-4479-a332-1c65db789914 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d5d04ef285e4fcbbf16782066183319', 'request_id': 'req-d7297fb7-e805-4479-a332-1c65db789914'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:39.813720 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-d7297fb7-e805-4479-a332-1c65db789914 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d5d04ef285e4fcbbf16782066183319', 'request_id': 'req-d7297fb7-e805-4479-a332-1c65db789914'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:39.820575 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-d7297fb7-e805-4479-a332-1c65db789914 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d5d04ef285e4fcbbf16782066183319', 'request_id': 'req-d7297fb7-e805-4479-a332-1c65db789914'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:39.936895 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:29:39.942277 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-d7297fb7-e805-4479-a332-1c65db789914 admin admin] The token cache is being invalidate because project 6d5d04ef285e4fcbbf16782066183319 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:29:39.942563 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-d7297fb7-e805-4479-a332-1c65db789914 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:39.943178 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-d7297fb7-e805-4479-a332-1c65db789914 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:39.944753 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1213/2423] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:29:39 2022] DELETE /identity/v3/projects/6d5d04ef285e4fcbbf16782066183319 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:29:39.950649 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5658804-5f70-418b-bee2-fc351e0041d1 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:39.951148 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5658804-5f70-418b-bee2-fc351e0041d1 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:39.951273 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5658804-5f70-418b-bee2-fc351e0041d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:39.969348 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-a5658804-5f70-418b-bee2-fc351e0041d1 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:29:39.970564 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-a5658804-5f70-418b-bee2-fc351e0041d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:29:39.999317 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:29:40.029476 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1211/2424] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:29:40.037579 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce3067-52e6-4f41-b6b1-cde22a0f65b5 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:40.037875 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce3067-52e6-4f41-b6b1-cde22a0f65b5 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:40.038140 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce3067-52e6-4f41-b6b1-cde22a0f65b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:40.056070 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-70ce3067-52e6-4f41-b6b1-cde22a0f65b5 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:29:40.057272 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-70ce3067-52e6-4f41-b6b1-cde22a0f65b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:29:40.065562 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1214/2425] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:29:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:29:40.070045 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5658804-5f70-418b-bee2-fc351e0041d1 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:40.080118 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5658804-5f70-418b-bee2-fc351e0041d1 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:40.084684 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f165d-5460-423d-a542-8db56797c9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:40.085328 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f165d-5460-423d-a542-8db56797c9ce admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:40.085611 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f165d-5460-423d-a542-8db56797c9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:40.085889 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f165d-5460-423d-a542-8db56797c9ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:40.086691 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5f165d-5460-423d-a542-8db56797c9ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:29:40.086998 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5f165d-5460-423d-a542-8db56797c9ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:40.088639 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5f165d-5460-423d-a542-8db56797c9ce admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:40.101099 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1212/2426] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:29:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:29:40.105195 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce3067-52e6-4f41-b6b1-cde22a0f65b5 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:40.114116 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce3067-52e6-4f41-b6b1-cde22a0f65b5 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:40.118777 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaebe30-ac9c-484c-945a-b2f14710e143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:40.119414 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaebe30-ac9c-484c-945a-b2f14710e143 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:40.119691 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaebe30-ac9c-484c-945a-b2f14710e143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:40.119959 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaebe30-ac9c-484c-945a-b2f14710e143 admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:40.120659 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaebe30-ac9c-484c-945a-b2f14710e143 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:40.122531 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaebe30-ac9c-484c-945a-b2f14710e143 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:40.242642 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1215/2427] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:29:40 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:29:40.246834 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f165d-5460-423d-a542-8db56797c9ce admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:40.257810 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f165d-5460-423d-a542-8db56797c9ce admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:40.311741 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d98e77-108a-47ff-9544-70517630864e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:40.312624 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d98e77-108a-47ff-9544-70517630864e admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:40.313681 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d98e77-108a-47ff-9544-70517630864e admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:40.314215 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d98e77-108a-47ff-9544-70517630864e admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:40.315522 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d98e77-108a-47ff-9544-70517630864e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:40.317469 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d98e77-108a-47ff-9544-70517630864e admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:40.393918 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1213/2428] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:29:40 2022] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:29:40.397972 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaebe30-ac9c-484c-945a-b2f14710e143 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:40.408219 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaebe30-ac9c-484c-945a-b2f14710e143 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:40.412948 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c88310-3110-4b0c-8c42-d8912382d00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:40.413604 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c88310-3110-4b0c-8c42-d8912382d00e admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:40.413885 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c88310-3110-4b0c-8c42-d8912382d00e admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:40.414159 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c88310-3110-4b0c-8c42-d8912382d00e admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:40.414873 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c88310-3110-4b0c-8c42-d8912382d00e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:40.416553 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c88310-3110-4b0c-8c42-d8912382d00e admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:40.427034 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1216/2429] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:29:40.431717 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d98e77-108a-47ff-9544-70517630864e admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:40.442573 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d98e77-108a-47ff-9544-70517630864e admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:40.447226 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b59dc-0c3a-44bc-8b3e-5afaf890bd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:40.447875 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b59dc-0c3a-44bc-8b3e-5afaf890bd2c admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:40.448166 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b59dc-0c3a-44bc-8b3e-5afaf890bd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:40.448457 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b59dc-0c3a-44bc-8b3e-5afaf890bd2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:40.449168 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134b59dc-0c3a-44bc-8b3e-5afaf890bd2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:40.450745 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134b59dc-0c3a-44bc-8b3e-5afaf890bd2c admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:40.460786 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1214/2430] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:29:40.464767 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c88310-3110-4b0c-8c42-d8912382d00e admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:40.474652 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c88310-3110-4b0c-8c42-d8912382d00e admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:40.479211 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf213e-c087-46ad-b8ce-28d088e1b767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:40.480133 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf213e-c087-46ad-b8ce-28d088e1b767 admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:40.480443 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf213e-c087-46ad-b8ce-28d088e1b767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:40.480714 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf213e-c087-46ad-b8ce-28d088e1b767 admin admin] PATH_INFO: `/v3/projects/51f0f46857e947118f15c95ca2253747/users/35ccd8d392bf45db8b087b67bf54a460/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:40.496943 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bf213e-c087-46ad-b8ce-28d088e1b767 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51f0f46857e947118f15c95ca2253747, user_id=35ccd8d392bf45db8b087b67bf54a460, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:40.499540 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bf213e-c087-46ad-b8ce-28d088e1b767 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:40.570731 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1217/2431] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:29:40 2022] PUT /identity/v3/projects/51f0f46857e947118f15c95ca2253747/users/35ccd8d392bf45db8b087b67bf54a460/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:29:40.581073 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3dc9f-218d-4600-9bcc-559600273b35 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:40.581392 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3dc9f-218d-4600-9bcc-559600273b35 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:40.581674 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3dc9f-218d-4600-9bcc-559600273b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:40.608360 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-c5f3dc9f-218d-4600-9bcc-559600273b35 None None] MFA Rules not processed for user `35ccd8d392bf45db8b087b67bf54a460`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:29:40.609562 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-c5f3dc9f-218d-4600-9bcc-559600273b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:29:40.673450 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1215/2432] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:29:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:29:40.684113 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf213e-c087-46ad-b8ce-28d088e1b767 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:40.685827 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-b0bf213e-c087-46ad-b8ce-28d088e1b767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:29:40.742237 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf213e-c087-46ad-b8ce-28d088e1b767 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:40.745809 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468aadd-be1e-4a2e-b1d4-651809ea4926 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:40.746441 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468aadd-be1e-4a2e-b1d4-651809ea4926 service cinder] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:40.746718 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468aadd-be1e-4a2e-b1d4-651809ea4926 service cinder] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:40.747040 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468aadd-be1e-4a2e-b1d4-651809ea4926 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:40.755523 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f468aadd-be1e-4a2e-b1d4-651809ea4926 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:40.757124 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f468aadd-be1e-4a2e-b1d4-651809ea4926 service cinder] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:40.765651 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1218/2433] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:29:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:29:50.670009 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=84,keystone:INSERT=3 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:29:50.761769 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=54,keystone:INSERT=2 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:29:51.020898 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d301c-bea4-4a76-b05c-d3d30aaea0f9 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:51.021196 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d301c-bea4-4a76-b05c-d3d30aaea0f9 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:51.021480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d301c-bea4-4a76-b05c-d3d30aaea0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:51.039186 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-e67d301c-bea4-4a76-b05c-d3d30aaea0f9 None None] MFA Rules not processed for user `77c56945d1d74a1eaa5e0c8f9e43f086`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:29:51.040419 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-e67d301c-bea4-4a76-b05c-d3d30aaea0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:29:51.097119 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1216/2434] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:29:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:29:52.757490 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468aadd-be1e-4a2e-b1d4-651809ea4926 service cinder] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:52.823697 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468aadd-be1e-4a2e-b1d4-651809ea4926 service cinder] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:52.828486 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d1967-3b45-4df3-ac0a-19db743cd963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:52.829416 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d1967-3b45-4df3-ac0a-19db743cd963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:52.829695 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d1967-3b45-4df3-ac0a-19db743cd963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:52.829994 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d1967-3b45-4df3-ac0a-19db743cd963 admin admin] PATH_INFO: `/v3/users/35ccd8d392bf45db8b087b67bf54a460` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:52.831831 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d1967-3b45-4df3-ac0a-19db743cd963 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35ccd8d392bf45db8b087b67bf54a460)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:52.833841 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d1967-3b45-4df3-ac0a-19db743cd963 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:53.033105 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-e62d1967-3b45-4df3-ac0a-19db743cd963 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35ccd8d392bf45db8b087b67bf54a460'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:53.044725 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-e62d1967-3b45-4df3-ac0a-19db743cd963 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35ccd8d392bf45db8b087b67bf54a460'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:53.047352 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-e62d1967-3b45-4df3-ac0a-19db743cd963 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35ccd8d392bf45db8b087b67bf54a460'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:53.053232 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-e62d1967-3b45-4df3-ac0a-19db743cd963 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35ccd8d392bf45db8b087b67bf54a460'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:53.053862 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-e62d1967-3b45-4df3-ac0a-19db743cd963 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35ccd8d392bf45db8b087b67bf54a460'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:53.118801 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1219/2435] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:29:52 2022] DELETE /identity/v3/users/35ccd8d392bf45db8b087b67bf54a460 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:29:53.123183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6d267-205a-4b6b-9cbf-3c6f8fe0f0a6 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:53.123680 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6d267-205a-4b6b-9cbf-3c6f8fe0f0a6 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:53.123778 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6d267-205a-4b6b-9cbf-3c6f8fe0f0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:53.142002 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-d7f6d267-205a-4b6b-9cbf-3c6f8fe0f0a6 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:29:53.147733 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-d7f6d267-205a-4b6b-9cbf-3c6f8fe0f0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:29:53.202826 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1217/2436] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:29:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:29:53.213216 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d1967-3b45-4df3-ac0a-19db743cd963 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:53.214561 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-e62d1967-3b45-4df3-ac0a-19db743cd963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:29:53.278717 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d1967-3b45-4df3-ac0a-19db743cd963 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:53.290495 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9287b-3384-47f0-930a-84849e22f31c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:53.291167 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9287b-3384-47f0-930a-84849e22f31c service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:53.291450 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9287b-3384-47f0-930a-84849e22f31c service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:53.291781 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9287b-3384-47f0-930a-84849e22f31c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:53.302158 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c9287b-3384-47f0-930a-84849e22f31c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:53.305677 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c9287b-3384-47f0-930a-84849e22f31c service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:53.314385 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1220/2437] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:29:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 13:29:53.721167 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f6d267-205a-4b6b-9cbf-3c6f8fe0f0a6 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:53.722826 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-d7f6d267-205a-4b6b-9cbf-3c6f8fe0f0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:29:53.745289 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f6d267-205a-4b6b-9cbf-3c6f8fe0f0a6 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:53.750046 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca0b593-088b-41e1-b632-acacd2823a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:53.751158 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0b593-088b-41e1-b632-acacd2823a57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:53.751439 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0b593-088b-41e1-b632-acacd2823a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:53.751708 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0b593-088b-41e1-b632-acacd2823a57 admin admin] PATH_INFO: `/v3/projects/51f0f46857e947118f15c95ca2253747` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:53.753668 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca0b593-088b-41e1-b632-acacd2823a57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51f0f46857e947118f15c95ca2253747)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:53.755594 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca0b593-088b-41e1-b632-acacd2823a57 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:53.858883 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-dca0b593-088b-41e1-b632-acacd2823a57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51f0f46857e947118f15c95ca2253747', 'request_id': 'req-dca0b593-088b-41e1-b632-acacd2823a57'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:53.954082 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-dca0b593-088b-41e1-b632-acacd2823a57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51f0f46857e947118f15c95ca2253747', 'request_id': 'req-dca0b593-088b-41e1-b632-acacd2823a57'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:53.959986 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-dca0b593-088b-41e1-b632-acacd2823a57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51f0f46857e947118f15c95ca2253747', 'request_id': 'req-dca0b593-088b-41e1-b632-acacd2823a57'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:53.971232 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-dca0b593-088b-41e1-b632-acacd2823a57 admin admin] The token cache is being invalidate because project 51f0f46857e947118f15c95ca2253747 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:29:53.971519 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-dca0b593-088b-41e1-b632-acacd2823a57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:53.972164 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-dca0b593-088b-41e1-b632-acacd2823a57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:53.973705 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1218/2438] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:29:53 2022] DELETE /identity/v3/projects/51f0f46857e947118f15c95ca2253747 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:29:53.978716 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f9791-eccb-48f6-ae2c-7820b4a34161 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:53.979181 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f9791-eccb-48f6-ae2c-7820b4a34161 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:53.979317 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f9791-eccb-48f6-ae2c-7820b4a34161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:53.997950 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-230f9791-eccb-48f6-ae2c-7820b4a34161 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:29:53.999337 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-230f9791-eccb-48f6-ae2c-7820b4a34161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:29:54.017558 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:29:54.059310 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1221/2439] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:29:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:29:54.068632 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebe0b2-af9b-4251-b4fe-9d52d75f71c4 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:54.068916 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebe0b2-af9b-4251-b4fe-9d52d75f71c4 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:54.075063 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebe0b2-af9b-4251-b4fe-9d52d75f71c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:54.087387 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-f4ebe0b2-af9b-4251-b4fe-9d52d75f71c4 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:29:54.088605 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-f4ebe0b2-af9b-4251-b4fe-9d52d75f71c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:29:54.097093 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1219/2440] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:29:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:29:54.101455 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f9791-eccb-48f6-ae2c-7820b4a34161 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:54.111323 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f9791-eccb-48f6-ae2c-7820b4a34161 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:54.116566 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb00344b-3357-4302-b555-ab74e7d8f039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:54.117217 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb00344b-3357-4302-b555-ab74e7d8f039 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:54.117508 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb00344b-3357-4302-b555-ab74e7d8f039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:54.117774 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb00344b-3357-4302-b555-ab74e7d8f039 admin admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:54.118499 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb00344b-3357-4302-b555-ab74e7d8f039 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:29:54.119037 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb00344b-3357-4302-b555-ab74e7d8f039 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:54.121214 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb00344b-3357-4302-b555-ab74e7d8f039 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:54.133542 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1222/2441] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:29:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:29:54.137955 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ebe0b2-af9b-4251-b4fe-9d52d75f71c4 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:54.147176 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ebe0b2-af9b-4251-b4fe-9d52d75f71c4 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:54.151900 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77ee6f-107b-4f07-a9a3-3ee306786027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:54.152647 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77ee6f-107b-4f07-a9a3-3ee306786027 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:54.152934 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77ee6f-107b-4f07-a9a3-3ee306786027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:54.153200 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77ee6f-107b-4f07-a9a3-3ee306786027 admin admin] PATH_INFO: `/v3/projects` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:54.153888 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d77ee6f-107b-4f07-a9a3-3ee306786027 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:54.155739 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d77ee6f-107b-4f07-a9a3-3ee306786027 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:54.246540 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:29:54.253418 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1220/2442] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:29:54 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:29:54.257323 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb00344b-3357-4302-b555-ab74e7d8f039 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:54.267759 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb00344b-3357-4302-b555-ab74e7d8f039 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:54.328111 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631a9f6-a19d-44c3-ad25-26328d986211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:54.328955 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631a9f6-a19d-44c3-ad25-26328d986211 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:54.329311 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631a9f6-a19d-44c3-ad25-26328d986211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:54.329797 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631a9f6-a19d-44c3-ad25-26328d986211 admin admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:54.330576 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6631a9f6-a19d-44c3-ad25-26328d986211 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:54.332636 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6631a9f6-a19d-44c3-ad25-26328d986211 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:54.452736 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1223/2443] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:29:54 2022] POST /identity/v3/users => generated 287 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:29:54.457416 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77ee6f-107b-4f07-a9a3-3ee306786027 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:54.468712 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77ee6f-107b-4f07-a9a3-3ee306786027 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:54.484441 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca40a35-44fd-484c-901e-bc956b5505ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:54.484441 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca40a35-44fd-484c-901e-bc956b5505ac admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:54.484441 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca40a35-44fd-484c-901e-bc956b5505ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:54.484441 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca40a35-44fd-484c-901e-bc956b5505ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:54.485613 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca40a35-44fd-484c-901e-bc956b5505ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:54.485613 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca40a35-44fd-484c-901e-bc956b5505ac admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:54.495942 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1221/2444] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:29:54.500126 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631a9f6-a19d-44c3-ad25-26328d986211 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:54.511155 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631a9f6-a19d-44c3-ad25-26328d986211 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:54.516309 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871271b-5d08-47fa-8db6-45e603dda8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:54.517077 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871271b-5d08-47fa-8db6-45e603dda8ff admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:54.517587 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871271b-5d08-47fa-8db6-45e603dda8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:54.517945 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871271b-5d08-47fa-8db6-45e603dda8ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:54.519306 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0871271b-5d08-47fa-8db6-45e603dda8ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:54.521037 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0871271b-5d08-47fa-8db6-45e603dda8ff admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:54.532696 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1224/2445] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:29:54.537727 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca40a35-44fd-484c-901e-bc956b5505ac admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:54.548036 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca40a35-44fd-484c-901e-bc956b5505ac admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:54.553363 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29951eb6-86a1-44b4-89c9-e2678e475bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:54.555293 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29951eb6-86a1-44b4-89c9-e2678e475bce admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:54.555594 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29951eb6-86a1-44b4-89c9-e2678e475bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:54.555879 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29951eb6-86a1-44b4-89c9-e2678e475bce admin admin] PATH_INFO: `/v3/projects/121f94ba2b6f4690a7e024c0b7960aa1/users/6c6c0c6838dd4b59a51973f888439bcb/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:54.573416 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29951eb6-86a1-44b4-89c9-e2678e475bce admin admin] RBAC: Authorizing `identity:create_grant(project_id=121f94ba2b6f4690a7e024c0b7960aa1, user_id=6c6c0c6838dd4b59a51973f888439bcb, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:54.575361 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29951eb6-86a1-44b4-89c9-e2678e475bce admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:54.662329 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1222/2446] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:29:54 2022] PUT /identity/v3/projects/121f94ba2b6f4690a7e024c0b7960aa1/users/6c6c0c6838dd4b59a51973f888439bcb/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:29:54.664108 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46663869-9396-44d9-81ca-9157f6c03b6b None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:54.664416 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46663869-9396-44d9-81ca-9157f6c03b6b None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:54.664690 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46663869-9396-44d9-81ca-9157f6c03b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:54.692240 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-46663869-9396-44d9-81ca-9157f6c03b6b None None] MFA Rules not processed for user `6c6c0c6838dd4b59a51973f888439bcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:29:54.693360 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-46663869-9396-44d9-81ca-9157f6c03b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:29:54.767049 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1225/2447] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:29:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:29:54.778185 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29951eb6-86a1-44b4-89c9-e2678e475bce admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:54.779923 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-29951eb6-86a1-44b4-89c9-e2678e475bce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:29:54.860539 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29951eb6-86a1-44b4-89c9-e2678e475bce admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:54.865039 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e9d69-18bf-4771-8746-4ae93d0aca50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:54.865686 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e9d69-18bf-4771-8746-4ae93d0aca50 service cinder] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:54.865967 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e9d69-18bf-4771-8746-4ae93d0aca50 service cinder] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:54.866240 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e9d69-18bf-4771-8746-4ae93d0aca50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:54.874950 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3e9d69-18bf-4771-8746-4ae93d0aca50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:54.876761 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3e9d69-18bf-4771-8746-4ae93d0aca50 service cinder] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:54.886697 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1223/2448] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:29:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:29:59.005780 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46663869-9396-44d9-81ca-9157f6c03b6b None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:59.024588 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:29:59.071236 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46663869-9396-44d9-81ca-9157f6c03b6b None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:59.075890 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086acc1-ae6b-4df9-9f71-43266204bb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:59.076789 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086acc1-ae6b-4df9-9f71-43266204bb5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:59.077075 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086acc1-ae6b-4df9-9f71-43266204bb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:59.077346 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086acc1-ae6b-4df9-9f71-43266204bb5d admin admin] PATH_INFO: `/v3/users/6c6c0c6838dd4b59a51973f888439bcb` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:59.078514 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c086acc1-ae6b-4df9-9f71-43266204bb5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c6c0c6838dd4b59a51973f888439bcb)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:59.080462 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c086acc1-ae6b-4df9-9f71-43266204bb5d admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:59.322308 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-c086acc1-ae6b-4df9-9f71-43266204bb5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c6c0c6838dd4b59a51973f888439bcb'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:59.334606 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-c086acc1-ae6b-4df9-9f71-43266204bb5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c6c0c6838dd4b59a51973f888439bcb'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:59.335345 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-c086acc1-ae6b-4df9-9f71-43266204bb5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c6c0c6838dd4b59a51973f888439bcb'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:59.342506 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-c086acc1-ae6b-4df9-9f71-43266204bb5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c6c0c6838dd4b59a51973f888439bcb'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:59.343965 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-c086acc1-ae6b-4df9-9f71-43266204bb5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c6c0c6838dd4b59a51973f888439bcb'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:29:59.411362 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1226/2449] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:29:59 2022] DELETE /identity/v3/users/6c6c0c6838dd4b59a51973f888439bcb => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:29:59.415880 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4f94a-f8e6-4de9-8f67-224dc39adbc1 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:59.417422 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4f94a-f8e6-4de9-8f67-224dc39adbc1 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:59.417422 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4f94a-f8e6-4de9-8f67-224dc39adbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:59.434879 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-cff4f94a-f8e6-4de9-8f67-224dc39adbc1 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:29:59.436096 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-cff4f94a-f8e6-4de9-8f67-224dc39adbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:29:59.498951 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1224/2450] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:29:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:29:59.510065 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086acc1-ae6b-4df9-9f71-43266204bb5d admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:59.511473 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-c086acc1-ae6b-4df9-9f71-43266204bb5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:29:59.570703 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086acc1-ae6b-4df9-9f71-43266204bb5d admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:59.574256 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d539e9-31fc-4d54-afa0-ca2cb1b012ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:59.574896 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d539e9-31fc-4d54-afa0-ca2cb1b012ea service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:59.575220 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d539e9-31fc-4d54-afa0-ca2cb1b012ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:59.575448 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d539e9-31fc-4d54-afa0-ca2cb1b012ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:59.585342 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d539e9-31fc-4d54-afa0-ca2cb1b012ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:59.586770 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d539e9-31fc-4d54-afa0-ca2cb1b012ea service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:29:59.596220 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1227/2451] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:29:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:29:59.961950 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff4f94a-f8e6-4de9-8f67-224dc39adbc1 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:29:59.963359 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-cff4f94a-f8e6-4de9-8f67-224dc39adbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:29:59.980364 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff4f94a-f8e6-4de9-8f67-224dc39adbc1 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:29:59.985162 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d5ed4-4b84-43c0-945a-4c32cc02fd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:29:59.986451 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d5ed4-4b84-43c0-945a-4c32cc02fd70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:29:59.986737 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d5ed4-4b84-43c0-945a-4c32cc02fd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:29:59.987007 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d5ed4-4b84-43c0-945a-4c32cc02fd70 admin admin] PATH_INFO: `/v3/projects/121f94ba2b6f4690a7e024c0b7960aa1` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:29:59.988300 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d5ed4-4b84-43c0-945a-4c32cc02fd70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=121f94ba2b6f4690a7e024c0b7960aa1)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:29:59.990207 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d5ed4-4b84-43c0-945a-4c32cc02fd70 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:30:00.091801 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-6b5d5ed4-4b84-43c0-945a-4c32cc02fd70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '121f94ba2b6f4690a7e024c0b7960aa1', 'request_id': 'req-6b5d5ed4-4b84-43c0-945a-4c32cc02fd70'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:30:00.141836 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-6b5d5ed4-4b84-43c0-945a-4c32cc02fd70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '121f94ba2b6f4690a7e024c0b7960aa1', 'request_id': 'req-6b5d5ed4-4b84-43c0-945a-4c32cc02fd70'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:30:00.147358 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:30:00.149429 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-6b5d5ed4-4b84-43c0-945a-4c32cc02fd70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '121f94ba2b6f4690a7e024c0b7960aa1', 'request_id': 'req-6b5d5ed4-4b84-43c0-945a-4c32cc02fd70'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:30:00.159681 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-6b5d5ed4-4b84-43c0-945a-4c32cc02fd70 admin admin] The token cache is being invalidate because project 121f94ba2b6f4690a7e024c0b7960aa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:30:00.159966 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-6b5d5ed4-4b84-43c0-945a-4c32cc02fd70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:30:00.160633 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-6b5d5ed4-4b84-43c0-945a-4c32cc02fd70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:30:00.162199 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1225/2452] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:29:59 2022] DELETE /identity/v3/projects/121f94ba2b6f4690a7e024c0b7960aa1 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:30:00.167337 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6ff1a-b326-427d-9d4e-e54d6db00e8d None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:30:00.167822 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6ff1a-b326-427d-9d4e-e54d6db00e8d None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:30:00.167929 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6ff1a-b326-427d-9d4e-e54d6db00e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:30:00.186125 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-d3c6ff1a-b326-427d-9d4e-e54d6db00e8d None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:30:00.187305 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-d3c6ff1a-b326-427d-9d4e-e54d6db00e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:30:00.221746 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:30:00.250256 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1228/2453] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:30:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:30:00.258731 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc66536-fd48-4e85-b506-1910b712ad76 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:30:00.266814 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc66536-fd48-4e85-b506-1910b712ad76 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:30:00.266814 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc66536-fd48-4e85-b506-1910b712ad76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:30:00.277512 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-bbc66536-fd48-4e85-b506-1910b712ad76 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:30:00.278697 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-bbc66536-fd48-4e85-b506-1910b712ad76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:30:00.287762 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1226/2454] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:30:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:30:00.292187 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6ff1a-b326-427d-9d4e-e54d6db00e8d None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:30:00.302613 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6ff1a-b326-427d-9d4e-e54d6db00e8d None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:30:00.307237 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf77b5b-57d0-4a60-a16e-438d81378c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:30:00.307885 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf77b5b-57d0-4a60-a16e-438d81378c05 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:30:00.308170 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf77b5b-57d0-4a60-a16e-438d81378c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:30:00.308464 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf77b5b-57d0-4a60-a16e-438d81378c05 admin admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:30:00.309180 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf77b5b-57d0-4a60-a16e-438d81378c05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:30:00.309481 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf77b5b-57d0-4a60-a16e-438d81378c05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:30:00.311093 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf77b5b-57d0-4a60-a16e-438d81378c05 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:30:00.323575 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1229/2455] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:30:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:30:00.327850 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc66536-fd48-4e85-b506-1910b712ad76 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:30:00.337589 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc66536-fd48-4e85-b506-1910b712ad76 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:30:00.342489 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c8571-44a2-4ce3-96f0-038add3e97d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:30:00.343101 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c8571-44a2-4ce3-96f0-038add3e97d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:30:00.343384 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c8571-44a2-4ce3-96f0-038add3e97d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:30:00.343666 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c8571-44a2-4ce3-96f0-038add3e97d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:30:00.344391 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9c8571-44a2-4ce3-96f0-038add3e97d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:30:00.346294 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9c8571-44a2-4ce3-96f0-038add3e97d5 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:30:00.413900 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1227/2456] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:30:00 2022] POST /identity/v3/projects => generated 371 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:30:00.418161 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf77b5b-57d0-4a60-a16e-438d81378c05 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:30:00.428454 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf77b5b-57d0-4a60-a16e-438d81378c05 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:30:00.486153 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fcab61-bce6-40bc-a35e-a8c051700809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:30:00.486825 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fcab61-bce6-40bc-a35e-a8c051700809 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:30:00.487116 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fcab61-bce6-40bc-a35e-a8c051700809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:30:00.487391 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fcab61-bce6-40bc-a35e-a8c051700809 admin admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:30:00.488226 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fcab61-bce6-40bc-a35e-a8c051700809 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:30:00.490162 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fcab61-bce6-40bc-a35e-a8c051700809 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:30:00.600966 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1230/2457] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:30:00 2022] POST /identity/v3/users => generated 286 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:30:00.620407 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c8571-44a2-4ce3-96f0-038add3e97d5 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:30:00.620407 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c8571-44a2-4ce3-96f0-038add3e97d5 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:30:00.622117 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab6b22-a121-418c-9836-c0452ef618f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:30:00.622782 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab6b22-a121-418c-9836-c0452ef618f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:30:00.623064 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab6b22-a121-418c-9836-c0452ef618f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:30:00.623367 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab6b22-a121-418c-9836-c0452ef618f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:30:00.624062 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab6b22-a121-418c-9836-c0452ef618f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:30:00.625942 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab6b22-a121-418c-9836-c0452ef618f1 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:30:00.637724 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1228/2458] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:30:00.641798 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fcab61-bce6-40bc-a35e-a8c051700809 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:30:00.654845 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fcab61-bce6-40bc-a35e-a8c051700809 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:30:00.659547 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02cbca-6615-4623-aafd-25bced9b9dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:30:00.660825 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02cbca-6615-4623-aafd-25bced9b9dec admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:30:00.661107 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02cbca-6615-4623-aafd-25bced9b9dec admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:30:00.661382 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02cbca-6615-4623-aafd-25bced9b9dec admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:30:00.662099 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c02cbca-6615-4623-aafd-25bced9b9dec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:30:00.663703 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c02cbca-6615-4623-aafd-25bced9b9dec admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:30:00.677670 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1231/2459] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:30:00.679078 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab6b22-a121-418c-9836-c0452ef618f1 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:30:00.689108 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab6b22-a121-418c-9836-c0452ef618f1 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:30:00.694399 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2e663-6da2-4432-9865-8aee3fab735e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:30:00.695282 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2e663-6da2-4432-9865-8aee3fab735e admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:30:00.695563 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2e663-6da2-4432-9865-8aee3fab735e admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:30:00.695836 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2e663-6da2-4432-9865-8aee3fab735e admin admin] PATH_INFO: `/v3/projects/8db1c45b9113447b8ffc69365cf598bc/users/1470975f53c44571be88b20b13d277c2/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:30:00.712880 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e2e663-6da2-4432-9865-8aee3fab735e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8db1c45b9113447b8ffc69365cf598bc, user_id=1470975f53c44571be88b20b13d277c2, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:30:00.715523 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e2e663-6da2-4432-9865-8aee3fab735e admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:30:00.835768 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1229/2460] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:30:00 2022] PUT /identity/v3/projects/8db1c45b9113447b8ffc69365cf598bc/users/1470975f53c44571be88b20b13d277c2/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:30:00.840887 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d71ed-0509-40c8-9156-dacd70fab5f4 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:30:00.841176 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d71ed-0509-40c8-9156-dacd70fab5f4 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:30:00.841451 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d71ed-0509-40c8-9156-dacd70fab5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:30:00.859321 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-b97d71ed-0509-40c8-9156-dacd70fab5f4 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:30:00.860488 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-b97d71ed-0509-40c8-9156-dacd70fab5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:30:00.920167 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1232/2461] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:30:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:30:00.929606 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2e663-6da2-4432-9865-8aee3fab735e admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:30:00.931352 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-10e2e663-6da2-4432-9865-8aee3fab735e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:30:00.990472 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2e663-6da2-4432-9865-8aee3fab735e admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:30:00.995380 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d900c-6800-4b47-b50d-727b64231c51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:30:00.996030 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d900c-6800-4b47-b50d-727b64231c51 service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:30:00.996348 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d900c-6800-4b47-b50d-727b64231c51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:30:00.996691 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d900c-6800-4b47-b50d-727b64231c51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:30:01.008780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d900c-6800-4b47-b50d-727b64231c51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:30:01.010698 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d900c-6800-4b47-b50d-727b64231c51 service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:30:01.021366 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1230/2462] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:30:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:30:02.327959 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b3f73-187e-43e8-9dda-73f9577557b8 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:30:02.328563 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b3f73-187e-43e8-9dda-73f9577557b8 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:30:02.328563 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b3f73-187e-43e8-9dda-73f9577557b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:30:02.359932 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-c10b3f73-187e-43e8-9dda-73f9577557b8 None None] MFA Rules not processed for user `1470975f53c44571be88b20b13d277c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:30:02.361184 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-c10b3f73-187e-43e8-9dda-73f9577557b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:30:02.398471 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:30:02.430299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1233/2463] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:30:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:30:02.441662 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d900c-6800-4b47-b50d-727b64231c51 service neutron] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:30:02.442968 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-4f4d900c-6800-4b47-b50d-727b64231c51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:30:02.499794 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d900c-6800-4b47-b50d-727b64231c51 service neutron] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:30:02.504118 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf8d240-0f23-4770-8dd3-588ac6f46c30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:30:02.504766 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8d240-0f23-4770-8dd3-588ac6f46c30 service cinder] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:30:02.505044 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8d240-0f23-4770-8dd3-588ac6f46c30 service cinder] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:30:02.505317 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8d240-0f23-4770-8dd3-588ac6f46c30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:30:02.513571 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf8d240-0f23-4770-8dd3-588ac6f46c30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:30:02.514994 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf8d240-0f23-4770-8dd3-588ac6f46c30 service cinder] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:30:02.524308 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1231/2464] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:30:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:30:05.470572 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb7129-279a-4fc3-9e9d-759ddbf1ddb0 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:30:05.471077 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb7129-279a-4fc3-9e9d-759ddbf1ddb0 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:30:05.471184 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb7129-279a-4fc3-9e9d-759ddbf1ddb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:30:05.489155 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-cdeb7129-279a-4fc3-9e9d-759ddbf1ddb0 None None] MFA Rules not processed for user `1470975f53c44571be88b20b13d277c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:30:05.490370 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-cdeb7129-279a-4fc3-9e9d-759ddbf1ddb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:30:05.497404 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1234/2465] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:30:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:30:07.521317 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf8d240-0f23-4770-8dd3-588ac6f46c30 service cinder] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:30:07.526494 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-5cf8d240-0f23-4770-8dd3-588ac6f46c30 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:30:07.586928 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:30:07.627207 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf8d240-0f23-4770-8dd3-588ac6f46c30 service cinder] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:30:07.634612 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75591d-f3ec-4ba8-b8c7-056d67e4d086 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5c4ad16c9454b74ae8445b115cf0af4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:30:07.635395 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75591d-f3ec-4ba8-b8c7-056d67e4d086 service placement] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:30:07.635932 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75591d-f3ec-4ba8-b8c7-056d67e4d086 service placement] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:30:07.636270 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75591d-f3ec-4ba8-b8c7-056d67e4d086 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:30:07.639547 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-ec75591d-f3ec-4ba8-b8c7-056d67e4d086 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:30:07.653933 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75591d-f3ec-4ba8-b8c7-056d67e4d086 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:30:07.658033 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75591d-f3ec-4ba8-b8c7-056d67e4d086 service placement] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:30:07.687045 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1232/2466] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:30:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:30:09.531740 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db6ed9-650d-4f76-8644-299d3c49b496 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:30:09.532267 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db6ed9-650d-4f76-8644-299d3c49b496 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:30:09.532371 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db6ed9-650d-4f76-8644-299d3c49b496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:30:09.550020 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-d5db6ed9-650d-4f76-8644-299d3c49b496 None None] MFA Rules not processed for user `06c55d0ea52f40ae9125d2efe1d159a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:30:09.552008 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-d5db6ed9-650d-4f76-8644-299d3c49b496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:30:09.610018 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1235/2467] 10.222.0.61 () {58 vars in 1009 bytes} [Fri Jun 3 13:30:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:30:09.759739 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75591d-f3ec-4ba8-b8c7-056d67e4d086 service placement] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:30:09.761246 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-ec75591d-f3ec-4ba8-b8c7-056d67e4d086 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:30:09.830076 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75591d-f3ec-4ba8-b8c7-056d67e4d086 service placement] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:30:09.838704 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea123f1-4845-4fd1-80ad-6ad742655f94 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07ad3dd7477497ea25c2a01bff35712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:30:09.839508 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea123f1-4845-4fd1-80ad-6ad742655f94 service swift] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:30:09.839894 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea123f1-4845-4fd1-80ad-6ad742655f94 service swift] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:30:09.840381 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea123f1-4845-4fd1-80ad-6ad742655f94 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:30:09.851775 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea123f1-4845-4fd1-80ad-6ad742655f94 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:30:09.853373 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea123f1-4845-4fd1-80ad-6ad742655f94 service swift] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:30:09.861325 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1233/2468] 10.222.0.61 () {60 vars in 1384 bytes} [Fri Jun 3 13:30:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 13:30:19.603170 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=39 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:30:19.863447 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=49 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:30:32.285038 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364c51c-9ff3-4306-8a73-4bdc69a2ebef None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:30:32.289819 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364c51c-9ff3-4306-8a73-4bdc69a2ebef None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:30:32.289819 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364c51c-9ff3-4306-8a73-4bdc69a2ebef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:30:32.312263 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-e364c51c-9ff3-4306-8a73-4bdc69a2ebef None None] MFA Rules not processed for user `1470975f53c44571be88b20b13d277c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:30:32.313736 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-e364c51c-9ff3-4306-8a73-4bdc69a2ebef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:30:32.323770 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1236/2469] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:30:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:30:37.727961 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e580f0-fc0a-4ef6-8c8c-ee15657ebdb1 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:30:37.728544 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e580f0-fc0a-4ef6-8c8c-ee15657ebdb1 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:30:37.728544 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e580f0-fc0a-4ef6-8c8c-ee15657ebdb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:30:37.762219 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-60e580f0-fc0a-4ef6-8c8c-ee15657ebdb1 None None] MFA Rules not processed for user `06c55d0ea52f40ae9125d2efe1d159a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:30:37.767469 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-60e580f0-fc0a-4ef6-8c8c-ee15657ebdb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:30:37.781987 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1234/2470] 10.222.0.61 () {58 vars in 1009 bytes} [Fri Jun 3 13:30:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:30:37.806380 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e364c51c-9ff3-4306-8a73-4bdc69a2ebef None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:30:37.833568 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e364c51c-9ff3-4306-8a73-4bdc69a2ebef None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:30:37.840074 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8857e255-d729-47c8-a0a5-0e3ac2834a90 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07ad3dd7477497ea25c2a01bff35712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:30:37.840969 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857e255-d729-47c8-a0a5-0e3ac2834a90 service swift] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:30:37.841440 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857e255-d729-47c8-a0a5-0e3ac2834a90 service swift] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:30:37.841719 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857e255-d729-47c8-a0a5-0e3ac2834a90 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:30:37.851766 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8857e255-d729-47c8-a0a5-0e3ac2834a90 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:30:37.855150 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8857e255-d729-47c8-a0a5-0e3ac2834a90 service swift] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:30:37.896859 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1237/2471] 10.222.0.61 () {60 vars in 1384 bytes} [Fri Jun 3 13:30:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 13:30:38.556002 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9ac77-a3a2-4cd0-84b8-09873403c053 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:30:38.556346 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9ac77-a3a2-4cd0-84b8-09873403c053 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:30:38.556761 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9ac77-a3a2-4cd0-84b8-09873403c053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:30:38.584265 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-0af9ac77-a3a2-4cd0-84b8-09873403c053 None None] MFA Rules not processed for user `267a2b59a70245dfb7ec1b779f7fdd51`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:30:38.586661 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-0af9ac77-a3a2-4cd0-84b8-09873403c053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:30:38.737998 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1235/2472] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:30:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:30:47.862633 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=9 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:30:48.728690 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=28 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:31:03.056895 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4f19b-0a52-4826-a8aa-d567afe08efb None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:31:03.057830 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4f19b-0a52-4826-a8aa-d567afe08efb None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:31:03.057830 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4f19b-0a52-4826-a8aa-d567afe08efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:31:03.075543 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-f0a4f19b-0a52-4826-a8aa-d567afe08efb None None] MFA Rules not processed for user `06c55d0ea52f40ae9125d2efe1d159a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:31:03.076789 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-f0a4f19b-0a52-4826-a8aa-d567afe08efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:31:03.083786 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1238/2473] 10.222.0.61 () {58 vars in 967 bytes} [Fri Jun 3 13:31:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:31:03.096471 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9ac77-a3a2-4cd0-84b8-09873403c053 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:31:03.108317 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9ac77-a3a2-4cd0-84b8-09873403c053 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:31:03.113203 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34752b8-58cf-4f7d-beda-2245528a4155 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07ad3dd7477497ea25c2a01bff35712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:31:03.113839 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34752b8-58cf-4f7d-beda-2245528a4155 service swift] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:31:03.114120 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34752b8-58cf-4f7d-beda-2245528a4155 service swift] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:31:03.114393 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34752b8-58cf-4f7d-beda-2245528a4155 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:31:03.123037 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34752b8-58cf-4f7d-beda-2245528a4155 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:31:03.124640 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34752b8-58cf-4f7d-beda-2245528a4155 service swift] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:31:03.133579 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1236/2474] 10.222.0.61 () {60 vars in 1384 bytes} [Fri Jun 3 13:31:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 13:31:13.070727 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=3 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:31:13.129936 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=6 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:31:20.568542 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197f885-1f68-480a-82ad-10fc4e698615 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:31:20.569077 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197f885-1f68-480a-82ad-10fc4e698615 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:31:20.569185 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197f885-1f68-480a-82ad-10fc4e698615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:31:20.587996 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-f197f885-1f68-480a-82ad-10fc4e698615 None None] MFA Rules not processed for user `06c55d0ea52f40ae9125d2efe1d159a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:31:20.589208 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-f197f885-1f68-480a-82ad-10fc4e698615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:31:20.597057 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1239/2475] 10.222.0.61 () {58 vars in 1009 bytes} [Fri Jun 3 13:31:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:31:20.618658 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34752b8-58cf-4f7d-beda-2245528a4155 service swift] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:31:20.630685 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34752b8-58cf-4f7d-beda-2245528a4155 service swift] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:31:20.636458 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f395c526-0d4f-4e9a-9647-96e60c6065a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07ad3dd7477497ea25c2a01bff35712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:31:20.637083 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395c526-0d4f-4e9a-9647-96e60c6065a0 service swift] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:31:20.637446 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395c526-0d4f-4e9a-9647-96e60c6065a0 service swift] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:31:20.637726 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395c526-0d4f-4e9a-9647-96e60c6065a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:31:20.645939 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f395c526-0d4f-4e9a-9647-96e60c6065a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:31:20.647618 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f395c526-0d4f-4e9a-9647-96e60c6065a0 service swift] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:31:20.656315 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1237/2476] 10.222.0.61 () {60 vars in 1384 bytes} [Fri Jun 3 13:31:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 13:31:30.582414 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=3 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:31:30.653231 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=6 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:31:38.560035 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f197f885-1f68-480a-82ad-10fc4e698615 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:31:38.569431 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f197f885-1f68-480a-82ad-10fc4e698615 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:31:38.573030 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8d90c-0d98-4c56-8225-ac32f249b73d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:31:38.573675 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8d90c-0d98-4c56-8225-ac32f249b73d service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:31:38.573959 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8d90c-0d98-4c56-8225-ac32f249b73d service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:31:38.574235 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8d90c-0d98-4c56-8225-ac32f249b73d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:31:38.576022 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-d5f8d90c-0d98-4c56-8225-ac32f249b73d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:31:38.588752 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f8d90c-0d98-4c56-8225-ac32f249b73d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:31:38.590197 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f8d90c-0d98-4c56-8225-ac32f249b73d service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:31:38.600119 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1240/2477] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:31:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:31:38.782187 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6038744-2cc1-4eae-a745-112f90d1682c None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:31:38.782672 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6038744-2cc1-4eae-a745-112f90d1682c None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:31:38.782766 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6038744-2cc1-4eae-a745-112f90d1682c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:31:38.801646 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-b6038744-2cc1-4eae-a745-112f90d1682c None None] MFA Rules not processed for user `06c55d0ea52f40ae9125d2efe1d159a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:31:38.802840 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-b6038744-2cc1-4eae-a745-112f90d1682c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:31:38.811521 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1238/2478] 10.222.0.61 () {58 vars in 967 bytes} [Fri Jun 3 13:31:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:31:38.827516 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8d90c-0d98-4c56-8225-ac32f249b73d service neutron] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:31:38.837454 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8d90c-0d98-4c56-8225-ac32f249b73d service neutron] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:31:38.842468 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169569b-942c-43ca-9e5f-658b1a228b96 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07ad3dd7477497ea25c2a01bff35712', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:31:38.843121 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169569b-942c-43ca-9e5f-658b1a228b96 service swift] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:31:38.843403 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169569b-942c-43ca-9e5f-658b1a228b96 service swift] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:31:38.843680 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169569b-942c-43ca-9e5f-658b1a228b96 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:31:38.853514 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f169569b-942c-43ca-9e5f-658b1a228b96 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:31:38.855111 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f169569b-942c-43ca-9e5f-658b1a228b96 service swift] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:31:38.866086 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1241/2479] 10.222.0.61 () {60 vars in 1384 bytes} [Fri Jun 3 13:31:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 13:31:41.899115 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6038744-2cc1-4eae-a745-112f90d1682c None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:31:41.925456 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6038744-2cc1-4eae-a745-112f90d1682c None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:31:41.931383 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ebe92-1ebd-4f51-81bf-0fb3ec35a68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:31:41.932669 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ebe92-1ebd-4f51-81bf-0fb3ec35a68d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:31:41.932954 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ebe92-1ebd-4f51-81bf-0fb3ec35a68d admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:31:41.933225 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ebe92-1ebd-4f51-81bf-0fb3ec35a68d admin admin] PATH_INFO: `/v3/users/1470975f53c44571be88b20b13d277c2` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:31:41.934616 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ebe92-1ebd-4f51-81bf-0fb3ec35a68d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1470975f53c44571be88b20b13d277c2)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:31:41.936834 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ebe92-1ebd-4f51-81bf-0fb3ec35a68d admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:31:42.119250 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-1a1ebe92-1ebd-4f51-81bf-0fb3ec35a68d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1470975f53c44571be88b20b13d277c2'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:31:42.136844 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-1a1ebe92-1ebd-4f51-81bf-0fb3ec35a68d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1470975f53c44571be88b20b13d277c2'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:31:42.137816 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-1a1ebe92-1ebd-4f51-81bf-0fb3ec35a68d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1470975f53c44571be88b20b13d277c2'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:31:42.145019 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-1a1ebe92-1ebd-4f51-81bf-0fb3ec35a68d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1470975f53c44571be88b20b13d277c2'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:31:42.145776 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-1a1ebe92-1ebd-4f51-81bf-0fb3ec35a68d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1470975f53c44571be88b20b13d277c2'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:31:42.231887 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1239/2480] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:31:41 2022] DELETE /identity/v3/users/1470975f53c44571be88b20b13d277c2 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:31:42.509676 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169569b-942c-43ca-9e5f-658b1a228b96 service swift] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:31:42.518051 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169569b-942c-43ca-9e5f-658b1a228b96 service swift] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:31:42.577353 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c410d9-806b-4ab3-8b32-1c97c1963090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:31:42.578154 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c410d9-806b-4ab3-8b32-1c97c1963090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:31:42.578434 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c410d9-806b-4ab3-8b32-1c97c1963090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:31:42.578705 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c410d9-806b-4ab3-8b32-1c97c1963090 admin admin] PATH_INFO: `/v3/projects/8db1c45b9113447b8ffc69365cf598bc` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:31:42.579870 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c410d9-806b-4ab3-8b32-1c97c1963090 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8db1c45b9113447b8ffc69365cf598bc)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:31:42.581826 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c410d9-806b-4ab3-8b32-1c97c1963090 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:31:42.625826 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ebe92-1ebd-4f51-81bf-0fb3ec35a68d admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:31:42.627276 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-1a1ebe92-1ebd-4f51-81bf-0fb3ec35a68d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:31:42.641060 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ebe92-1ebd-4f51-81bf-0fb3ec35a68d admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:31:42.645997 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c8dd5-3bb2-43e4-9dd5-9128cbc17c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:31:42.646920 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c8dd5-3bb2-43e4-9dd5-9128cbc17c72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:31:42.647199 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c8dd5-3bb2-43e4-9dd5-9128cbc17c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:31:42.647471 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c8dd5-3bb2-43e4-9dd5-9128cbc17c72 admin admin] PATH_INFO: `/v3/users/7254adba100f4453b2b9a953990dbb41` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:31:42.662242 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927c8dd5-3bb2-43e4-9dd5-9128cbc17c72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7254adba100f4453b2b9a953990dbb41)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:31:42.664829 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927c8dd5-3bb2-43e4-9dd5-9128cbc17c72 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:31:42.746551 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-43c410d9-806b-4ab3-8b32-1c97c1963090 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8db1c45b9113447b8ffc69365cf598bc', 'request_id': 'req-43c410d9-806b-4ab3-8b32-1c97c1963090'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:31:42.752912 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-43c410d9-806b-4ab3-8b32-1c97c1963090 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8db1c45b9113447b8ffc69365cf598bc', 'request_id': 'req-43c410d9-806b-4ab3-8b32-1c97c1963090'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:31:42.759040 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-43c410d9-806b-4ab3-8b32-1c97c1963090 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8db1c45b9113447b8ffc69365cf598bc', 'request_id': 'req-43c410d9-806b-4ab3-8b32-1c97c1963090'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:31:42.847337 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-43c410d9-806b-4ab3-8b32-1c97c1963090 admin admin] The token cache is being invalidate because project 8db1c45b9113447b8ffc69365cf598bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:31:42.847571 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-43c410d9-806b-4ab3-8b32-1c97c1963090 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:31:42.848167 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-43c410d9-806b-4ab3-8b32-1c97c1963090 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:31:42.849728 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1242/2481] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:31:42 2022] DELETE /identity/v3/projects/8db1c45b9113447b8ffc69365cf598bc => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:31:42.855195 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ef829-e7dd-4df4-aeb5-77202fe1e65a None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:31:42.855483 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ef829-e7dd-4df4-aeb5-77202fe1e65a None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:31:42.855762 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ef829-e7dd-4df4-aeb5-77202fe1e65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:31:42.873430 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-385ef829-e7dd-4df4-aeb5-77202fe1e65a None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:31:42.874630 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-385ef829-e7dd-4df4-aeb5-77202fe1e65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:31:42.893117 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-927c8dd5-3bb2-43e4-9dd5-9128cbc17c72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7254adba100f4453b2b9a953990dbb41'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:31:42.906710 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-927c8dd5-3bb2-43e4-9dd5-9128cbc17c72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7254adba100f4453b2b9a953990dbb41'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:31:42.908052 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-927c8dd5-3bb2-43e4-9dd5-9128cbc17c72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7254adba100f4453b2b9a953990dbb41'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:31:42.915880 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-927c8dd5-3bb2-43e4-9dd5-9128cbc17c72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7254adba100f4453b2b9a953990dbb41'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:31:42.916542 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-927c8dd5-3bb2-43e4-9dd5-9128cbc17c72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7254adba100f4453b2b9a953990dbb41'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:31:42.933950 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1243/2482] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:31:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:31:42.941286 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0064ad2-849c-4918-a114-c24bafff8f9a None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:31:42.941572 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0064ad2-849c-4918-a114-c24bafff8f9a None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:31:42.941842 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0064ad2-849c-4918-a114-c24bafff8f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:31:42.949111 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:31:42.959585 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-e0064ad2-849c-4918-a114-c24bafff8f9a None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:31:42.960793 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-e0064ad2-849c-4918-a114-c24bafff8f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:31:42.969523 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1244/2483] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:31:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:31:42.973375 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0064ad2-849c-4918-a114-c24bafff8f9a None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:31:42.982625 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0064ad2-849c-4918-a114-c24bafff8f9a None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:31:42.987120 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6ed84-3b4a-403a-8b45-5fb714d2c9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:31:42.987773 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6ed84-3b4a-403a-8b45-5fb714d2c9a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:31:42.988060 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6ed84-3b4a-403a-8b45-5fb714d2c9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:31:42.988363 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6ed84-3b4a-403a-8b45-5fb714d2c9a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:31:42.989066 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a6ed84-3b4a-403a-8b45-5fb714d2c9a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:31:42.989366 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a6ed84-3b4a-403a-8b45-5fb714d2c9a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:31:42.990978 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a6ed84-3b4a-403a-8b45-5fb714d2c9a5 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:31:43.003376 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1245/2484] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:31:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:31:43.007597 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6ed84-3b4a-403a-8b45-5fb714d2c9a5 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:31:43.018115 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6ed84-3b4a-403a-8b45-5fb714d2c9a5 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:31:43.022233 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1240/2485] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:31:42 2022] DELETE /identity/v3/users/7254adba100f4453b2b9a953990dbb41 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:31:43.028887 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da480305-460d-42a1-93a8-17fcec2b15a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:31:43.028887 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da480305-460d-42a1-93a8-17fcec2b15a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:31:43.028887 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da480305-460d-42a1-93a8-17fcec2b15a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:31:43.028887 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da480305-460d-42a1-93a8-17fcec2b15a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:31:43.029312 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da480305-460d-42a1-93a8-17fcec2b15a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:31:43.029312 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da480305-460d-42a1-93a8-17fcec2b15a0 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:31:43.143477 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1246/2486] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:31:43 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:31:43.147379 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c8dd5-3bb2-43e4-9dd5-9128cbc17c72 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:31:43.178418 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:31:43.214783 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c8dd5-3bb2-43e4-9dd5-9128cbc17c72 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:31:43.271059 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef7940-eb4c-4fe1-8dc4-1b828d356a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:31:43.271749 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef7940-eb4c-4fe1-8dc4-1b828d356a77 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:31:43.272034 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef7940-eb4c-4fe1-8dc4-1b828d356a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:31:43.272354 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef7940-eb4c-4fe1-8dc4-1b828d356a77 admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:31:43.273047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ef7940-eb4c-4fe1-8dc4-1b828d356a77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:31:43.275999 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ef7940-eb4c-4fe1-8dc4-1b828d356a77 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:31:43.301064 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da480305-460d-42a1-93a8-17fcec2b15a0 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:31:43.302808 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-da480305-460d-42a1-93a8-17fcec2b15a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:31:43.317037 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da480305-460d-42a1-93a8-17fcec2b15a0 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:31:43.322707 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714be0a-ebfe-49a1-a9c3-febff810d273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:31:43.323572 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714be0a-ebfe-49a1-a9c3-febff810d273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:31:43.323882 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714be0a-ebfe-49a1-a9c3-febff810d273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:31:43.324175 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714be0a-ebfe-49a1-a9c3-febff810d273 admin admin] PATH_INFO: `/v3/projects/5a4dd3e8d45a4dee9be95d8326e00edf` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:31:43.335950 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0714be0a-ebfe-49a1-a9c3-febff810d273 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a4dd3e8d45a4dee9be95d8326e00edf)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:31:43.338807 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0714be0a-ebfe-49a1-a9c3-febff810d273 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:31:43.371854 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1241/2487] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:31:43 2022] POST /identity/v3/users => generated 286 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:31:43.381959 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef7940-eb4c-4fe1-8dc4-1b828d356a77 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:31:43.387086 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef7940-eb4c-4fe1-8dc4-1b828d356a77 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:31:43.391838 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eca5e2-8679-475d-a457-8225f10a52df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:31:43.392512 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eca5e2-8679-475d-a457-8225f10a52df admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:31:43.392790 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eca5e2-8679-475d-a457-8225f10a52df admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:31:43.393058 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eca5e2-8679-475d-a457-8225f10a52df admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:31:43.393768 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eca5e2-8679-475d-a457-8225f10a52df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:31:43.395331 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eca5e2-8679-475d-a457-8225f10a52df admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:31:43.405781 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1242/2488] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:31:43.409426 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eca5e2-8679-475d-a457-8225f10a52df admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:31:43.419510 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eca5e2-8679-475d-a457-8225f10a52df admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:31:43.424220 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c43ff4-cfef-4315-8d1e-205cd8471128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:31:43.424853 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c43ff4-cfef-4315-8d1e-205cd8471128 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:31:43.425133 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c43ff4-cfef-4315-8d1e-205cd8471128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:31:43.425405 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c43ff4-cfef-4315-8d1e-205cd8471128 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:31:43.426082 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c43ff4-cfef-4315-8d1e-205cd8471128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:31:43.427599 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c43ff4-cfef-4315-8d1e-205cd8471128 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:31:43.438290 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1243/2489] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:31:43.442010 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c43ff4-cfef-4315-8d1e-205cd8471128 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:31:43.452216 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c43ff4-cfef-4315-8d1e-205cd8471128 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:31:43.463879 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-0714be0a-ebfe-49a1-a9c3-febff810d273 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a4dd3e8d45a4dee9be95d8326e00edf', 'request_id': 'req-0714be0a-ebfe-49a1-a9c3-febff810d273'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:31:43.470803 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-0714be0a-ebfe-49a1-a9c3-febff810d273 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a4dd3e8d45a4dee9be95d8326e00edf', 'request_id': 'req-0714be0a-ebfe-49a1-a9c3-febff810d273'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:31:43.476475 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-0714be0a-ebfe-49a1-a9c3-febff810d273 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a4dd3e8d45a4dee9be95d8326e00edf', 'request_id': 'req-0714be0a-ebfe-49a1-a9c3-febff810d273'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:31:43.510037 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e53689-a6af-4a73-9478-a1d375117e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:31:43.513811 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e53689-a6af-4a73-9478-a1d375117e99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:31:43.513811 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e53689-a6af-4a73-9478-a1d375117e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:31:43.513811 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e53689-a6af-4a73-9478-a1d375117e99 admin admin] PATH_INFO: `/v3/projects/225191825c1d49c795151c7bedf35d97/users/a7da9a3f3e5f4eb4b1a01d33dcdb4bf2/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:31:43.526080 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e53689-a6af-4a73-9478-a1d375117e99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=225191825c1d49c795151c7bedf35d97, user_id=a7da9a3f3e5f4eb4b1a01d33dcdb4bf2, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:31:43.528995 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e53689-a6af-4a73-9478-a1d375117e99 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:31:43.622596 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-0714be0a-ebfe-49a1-a9c3-febff810d273 admin admin] The token cache is being invalidate because project 5a4dd3e8d45a4dee9be95d8326e00edf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:31:43.623247 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-0714be0a-ebfe-49a1-a9c3-febff810d273 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:31:43.623365 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1244/2490] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:31:43 2022] PUT /identity/v3/projects/225191825c1d49c795151c7bedf35d97/users/a7da9a3f3e5f4eb4b1a01d33dcdb4bf2/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:31:43.623650 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-0714be0a-ebfe-49a1-a9c3-febff810d273 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:31:43.625281 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1247/2491] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:31:43 2022] DELETE /identity/v3/projects/5a4dd3e8d45a4dee9be95d8326e00edf => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:31:43.628077 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de7ca1-bab3-4234-89e9-4dc246a9387a None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:31:43.628396 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de7ca1-bab3-4234-89e9-4dc246a9387a None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:31:43.628674 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de7ca1-bab3-4234-89e9-4dc246a9387a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:31:43.630218 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36978363-c9a6-40c1-b835-b0ede65b8b0e None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:31:43.630640 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36978363-c9a6-40c1-b835-b0ede65b8b0e None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:31:43.630920 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36978363-c9a6-40c1-b835-b0ede65b8b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:31:43.646350 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-c0de7ca1-bab3-4234-89e9-4dc246a9387a None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:31:43.647515 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-c0de7ca1-bab3-4234-89e9-4dc246a9387a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:31:43.649193 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-36978363-c9a6-40c1-b835-b0ede65b8b0e None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:31:43.650368 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-36978363-c9a6-40c1-b835-b0ede65b8b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:31:43.667444 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:31:43.710467 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1245/2492] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:31:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:31:43.715452 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1248/2493] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:31:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:31:43.728171 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de7ca1-bab3-4234-89e9-4dc246a9387a None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:31:43.728171 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-c0de7ca1-bab3-4234-89e9-4dc246a9387a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:31:43.730306 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a2dd8-1868-4a7e-ad06-783c8b8f57c0 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:31:43.730592 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a2dd8-1868-4a7e-ad06-783c8b8f57c0 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:31:43.730871 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a2dd8-1868-4a7e-ad06-783c8b8f57c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:31:43.754594 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-bd7a2dd8-1868-4a7e-ad06-783c8b8f57c0 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:31:43.755909 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-bd7a2dd8-1868-4a7e-ad06-783c8b8f57c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:31:43.766174 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1249/2494] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:31:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:31:43.769996 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a2dd8-1868-4a7e-ad06-783c8b8f57c0 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:31:43.781358 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a2dd8-1868-4a7e-ad06-783c8b8f57c0 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:31:43.786876 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc984bf-f509-4615-adcd-51ce996d965e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:31:43.787784 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc984bf-f509-4615-adcd-51ce996d965e admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:31:43.788065 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc984bf-f509-4615-adcd-51ce996d965e admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:31:43.789987 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc984bf-f509-4615-adcd-51ce996d965e admin admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:31:43.790819 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc984bf-f509-4615-adcd-51ce996d965e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:31:43.791415 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc984bf-f509-4615-adcd-51ce996d965e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:31:43.795204 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de7ca1-bab3-4234-89e9-4dc246a9387a None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:31:43.799922 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330311b7-fcbc-4e53-a530-eb3dc9637ab2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:31:43.800667 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330311b7-fcbc-4e53-a530-eb3dc9637ab2 service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:31:43.801013 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330311b7-fcbc-4e53-a530-eb3dc9637ab2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:31:43.801661 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330311b7-fcbc-4e53-a530-eb3dc9637ab2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:31:43.802653 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc984bf-f509-4615-adcd-51ce996d965e admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:31:43.812750 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330311b7-fcbc-4e53-a530-eb3dc9637ab2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:31:43.814754 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330311b7-fcbc-4e53-a530-eb3dc9637ab2 service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:31:43.821276 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1250/2495] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:31:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:31:43.822566 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc984bf-f509-4615-adcd-51ce996d965e admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:31:43.826151 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1246/2496] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:31:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:31:43.835089 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc984bf-f509-4615-adcd-51ce996d965e admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:31:43.840064 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b27804-50f7-401b-9b3c-ff520eb73bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:31:43.840813 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b27804-50f7-401b-9b3c-ff520eb73bcc admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:31:43.841014 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b27804-50f7-401b-9b3c-ff520eb73bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:31:43.841309 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b27804-50f7-401b-9b3c-ff520eb73bcc admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:31:43.841985 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b27804-50f7-401b-9b3c-ff520eb73bcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:31:43.843886 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b27804-50f7-401b-9b3c-ff520eb73bcc admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:31:43.859307 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:31:43.993942 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1251/2497] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:31:43 2022] POST /identity/v3/projects => generated 381 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:31:43.995564 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330311b7-fcbc-4e53-a530-eb3dc9637ab2 service neutron] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:31:44.006181 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330311b7-fcbc-4e53-a530-eb3dc9637ab2 service neutron] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:31:44.066113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8313b6d9-b0d4-4273-a056-f57ca15886ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:31:44.066819 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313b6d9-b0d4-4273-a056-f57ca15886ec admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:31:44.067055 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313b6d9-b0d4-4273-a056-f57ca15886ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:31:44.067331 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313b6d9-b0d4-4273-a056-f57ca15886ec admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:31:44.068026 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8313b6d9-b0d4-4273-a056-f57ca15886ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:31:44.069968 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8313b6d9-b0d4-4273-a056-f57ca15886ec admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:31:44.151224 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1247/2498] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:31:43 2022] POST /identity/v3/users => generated 291 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:31:44.152783 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b27804-50f7-401b-9b3c-ff520eb73bcc admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:31:44.163986 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b27804-50f7-401b-9b3c-ff520eb73bcc admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:31:44.169782 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f576268-a404-4001-93d5-9945f43a760c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:31:44.170551 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f576268-a404-4001-93d5-9945f43a760c admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:31:44.171052 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f576268-a404-4001-93d5-9945f43a760c admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:31:44.171427 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f576268-a404-4001-93d5-9945f43a760c admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:31:44.172250 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f576268-a404-4001-93d5-9945f43a760c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:31:44.173913 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f576268-a404-4001-93d5-9945f43a760c admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:31:44.187917 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1252/2499] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:31:44.192020 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8313b6d9-b0d4-4273-a056-f57ca15886ec admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:31:44.202845 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8313b6d9-b0d4-4273-a056-f57ca15886ec admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:31:44.207863 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46665aa0-2e89-4dbd-b0ea-bf25dd2d755e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:31:44.208794 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46665aa0-2e89-4dbd-b0ea-bf25dd2d755e admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:31:44.209167 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46665aa0-2e89-4dbd-b0ea-bf25dd2d755e admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:31:44.209442 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46665aa0-2e89-4dbd-b0ea-bf25dd2d755e admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:31:44.210157 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46665aa0-2e89-4dbd-b0ea-bf25dd2d755e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:31:44.212476 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46665aa0-2e89-4dbd-b0ea-bf25dd2d755e admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:31:44.223157 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1248/2500] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:31:44.228277 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f576268-a404-4001-93d5-9945f43a760c admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:31:44.238515 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f576268-a404-4001-93d5-9945f43a760c admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:31:44.243122 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6622fb5-bc2c-4daa-a5da-0ed9305ceae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:31:44.243999 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6622fb5-bc2c-4daa-a5da-0ed9305ceae7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:31:44.245277 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6622fb5-bc2c-4daa-a5da-0ed9305ceae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:31:44.245277 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6622fb5-bc2c-4daa-a5da-0ed9305ceae7 admin admin] PATH_INFO: `/v3/projects/f98bb4e7829d4aa3b924ce9b711b054c/users/976a144105524c47a35f5a8a32888210/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:31:44.259795 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6622fb5-bc2c-4daa-a5da-0ed9305ceae7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f98bb4e7829d4aa3b924ce9b711b054c, user_id=976a144105524c47a35f5a8a32888210, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:31:44.262544 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6622fb5-bc2c-4daa-a5da-0ed9305ceae7 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:31:44.358572 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1253/2501] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:31:44 2022] PUT /identity/v3/projects/f98bb4e7829d4aa3b924ce9b711b054c/users/976a144105524c47a35f5a8a32888210/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:31:44.369302 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56076b-afd0-43d9-ab59-ab493fb33433 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:31:44.369576 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56076b-afd0-43d9-ab59-ab493fb33433 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:31:44.369851 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56076b-afd0-43d9-ab59-ab493fb33433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:31:44.398008 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-6c56076b-afd0-43d9-ab59-ab493fb33433 None None] MFA Rules not processed for user `976a144105524c47a35f5a8a32888210`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:31:44.399749 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-6c56076b-afd0-43d9-ab59-ab493fb33433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:31:44.434208 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:31:44.465387 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1249/2502] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:31:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:31:44.469835 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6622fb5-bc2c-4daa-a5da-0ed9305ceae7 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:31:44.533747 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6622fb5-bc2c-4daa-a5da-0ed9305ceae7 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:31:44.538590 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5fee11-9ec0-42eb-8af2-1ac42e20ebe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:31:44.539246 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5fee11-9ec0-42eb-8af2-1ac42e20ebe4 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:31:44.539531 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5fee11-9ec0-42eb-8af2-1ac42e20ebe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:31:44.540514 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5fee11-9ec0-42eb-8af2-1ac42e20ebe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:31:44.545752 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5fee11-9ec0-42eb-8af2-1ac42e20ebe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:31:44.545752 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5fee11-9ec0-42eb-8af2-1ac42e20ebe4 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:31:44.661494 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1254/2503] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:31:44 2022] POST /identity/v3/projects => generated 381 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:31:44.666125 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56076b-afd0-43d9-ab59-ab493fb33433 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:31:44.676707 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56076b-afd0-43d9-ab59-ab493fb33433 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:31:44.735659 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b83c96-f874-427b-979f-b6c98812d7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:31:44.736277 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b83c96-f874-427b-979f-b6c98812d7ad admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:31:44.736561 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b83c96-f874-427b-979f-b6c98812d7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:31:44.736837 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b83c96-f874-427b-979f-b6c98812d7ad admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:31:44.737520 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b83c96-f874-427b-979f-b6c98812d7ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:31:44.739432 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b83c96-f874-427b-979f-b6c98812d7ad admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:31:44.840927 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1250/2504] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:31:44 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:31:44.842185 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5fee11-9ec0-42eb-8af2-1ac42e20ebe4 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:31:44.853102 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5fee11-9ec0-42eb-8af2-1ac42e20ebe4 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:31:44.857760 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8676f3d-9991-4d6c-add7-3d0c18385d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:31:44.858428 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8676f3d-9991-4d6c-add7-3d0c18385d71 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:31:44.858726 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8676f3d-9991-4d6c-add7-3d0c18385d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:31:44.859084 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8676f3d-9991-4d6c-add7-3d0c18385d71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:31:44.859722 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8676f3d-9991-4d6c-add7-3d0c18385d71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:31:44.861525 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8676f3d-9991-4d6c-add7-3d0c18385d71 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:31:44.872400 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1255/2505] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:31:44.881909 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b83c96-f874-427b-979f-b6c98812d7ad admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:31:44.892040 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b83c96-f874-427b-979f-b6c98812d7ad admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:31:44.898359 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7697287-41d3-4296-8ef0-94c843abc7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:31:44.903804 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7697287-41d3-4296-8ef0-94c843abc7c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:31:44.903804 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7697287-41d3-4296-8ef0-94c843abc7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:31:44.903804 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7697287-41d3-4296-8ef0-94c843abc7c2 admin admin] PATH_INFO: `/v3/projects/53cecfe0283a4bfcb5f4204df941e7f7/users/85ad182ef8c3487bac1d3cb924e2dbf3/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:31:44.917900 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7697287-41d3-4296-8ef0-94c843abc7c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53cecfe0283a4bfcb5f4204df941e7f7, user_id=85ad182ef8c3487bac1d3cb924e2dbf3, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:31:44.920579 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7697287-41d3-4296-8ef0-94c843abc7c2 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:31:45.008862 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1251/2506] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:31:44 2022] PUT /identity/v3/projects/53cecfe0283a4bfcb5f4204df941e7f7/users/85ad182ef8c3487bac1d3cb924e2dbf3/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:31:45.013055 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8676f3d-9991-4d6c-add7-3d0c18385d71 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:31:45.022976 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8676f3d-9991-4d6c-add7-3d0c18385d71 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:31:45.081854 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b457c5ed-8b82-47a5-8811-ce6c72ea3d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:31:45.082527 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457c5ed-8b82-47a5-8811-ce6c72ea3d59 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:31:45.082812 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457c5ed-8b82-47a5-8811-ce6c72ea3d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:31:45.083084 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457c5ed-8b82-47a5-8811-ce6c72ea3d59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:31:45.084047 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b457c5ed-8b82-47a5-8811-ce6c72ea3d59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:31:45.085468 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b457c5ed-8b82-47a5-8811-ce6c72ea3d59 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:31:45.098366 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1256/2507] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:31:45.102430 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7697287-41d3-4296-8ef0-94c843abc7c2 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:31:45.113755 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7697287-41d3-4296-8ef0-94c843abc7c2 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:31:45.119322 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afcf233-4f9a-4630-9fe8-32b553b0ada5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:31:45.120247 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afcf233-4f9a-4630-9fe8-32b553b0ada5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:31:45.120541 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afcf233-4f9a-4630-9fe8-32b553b0ada5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:31:45.121164 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afcf233-4f9a-4630-9fe8-32b553b0ada5 admin admin] PATH_INFO: `/v3/projects/53cecfe0283a4bfcb5f4204df941e7f7/users/85ad182ef8c3487bac1d3cb924e2dbf3/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:31:45.122864 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afcf233-4f9a-4630-9fe8-32b553b0ada5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53cecfe0283a4bfcb5f4204df941e7f7, user_id=85ad182ef8c3487bac1d3cb924e2dbf3, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:31:45.125453 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afcf233-4f9a-4630-9fe8-32b553b0ada5 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:31:45.137350 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1252/2508] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:31:45 2022] PUT /identity/v3/projects/53cecfe0283a4bfcb5f4204df941e7f7/users/85ad182ef8c3487bac1d3cb924e2dbf3/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:31:45.147554 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd62224-736f-40da-9880-75d5558c6f94 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:31:45.147930 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd62224-736f-40da-9880-75d5558c6f94 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:31:45.148259 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd62224-736f-40da-9880-75d5558c6f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:31:45.184002 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-cfd62224-736f-40da-9880-75d5558c6f94 None None] MFA Rules not processed for user `85ad182ef8c3487bac1d3cb924e2dbf3`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:31:45.185518 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-cfd62224-736f-40da-9880-75d5558c6f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:31:45.208645 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:31:45.260539 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1257/2509] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:31:45 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:31:45.273191 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afcf233-4f9a-4630-9fe8-32b553b0ada5 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:31:45.276300 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-0afcf233-4f9a-4630-9fe8-32b553b0ada5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:31:45.362166 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afcf233-4f9a-4630-9fe8-32b553b0ada5 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:31:45.365924 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d1e9e-d5f4-4fca-9d1f-6f1c73f027a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:31:45.366563 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d1e9e-d5f4-4fca-9d1f-6f1c73f027a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:31:45.366840 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d1e9e-d5f4-4fca-9d1f-6f1c73f027a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:31:45.367109 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d1e9e-d5f4-4fca-9d1f-6f1c73f027a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:31:45.377513 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770d1e9e-d5f4-4fca-9d1f-6f1c73f027a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:31:45.379200 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770d1e9e-d5f4-4fca-9d1f-6f1c73f027a2 service cinder] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:31:45.389687 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1253/2510] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:31:45 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:31:45.622843 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd62224-736f-40da-9880-75d5558c6f94 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:31:45.634922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd62224-736f-40da-9880-75d5558c6f94 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:31:45.639000 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c8420-9054-41d9-9bfe-2d6734dcb106 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:31:45.639735 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c8420-9054-41d9-9bfe-2d6734dcb106 service cinder] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:31:45.640015 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c8420-9054-41d9-9bfe-2d6734dcb106 service cinder] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:31:45.640321 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c8420-9054-41d9-9bfe-2d6734dcb106 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:31:45.712266 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c8420-9054-41d9-9bfe-2d6734dcb106 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:31:45.713880 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c8420-9054-41d9-9bfe-2d6734dcb106 service cinder] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:31:45.723941 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1258/2511] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:31:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:31:49.341923 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0c554-e934-47ee-85e5-e3721900f09b None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:31:49.342474 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0c554-e934-47ee-85e5-e3721900f09b None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:31:49.342630 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0c554-e934-47ee-85e5-e3721900f09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:31:49.371771 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-6ca0c554-e934-47ee-85e5-e3721900f09b None None] MFA Rules not processed for user `a7da9a3f3e5f4eb4b1a01d33dcdb4bf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:31:49.373135 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-6ca0c554-e934-47ee-85e5-e3721900f09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:31:49.397506 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:31:49.448474 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1254/2512] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:31:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:31:49.453079 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c8420-9054-41d9-9bfe-2d6734dcb106 service cinder] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:31:49.455056 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-171c8420-9054-41d9-9bfe-2d6734dcb106 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:31:49.527524 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c8420-9054-41d9-9bfe-2d6734dcb106 service cinder] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:31:49.532346 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a7733-954e-4aa6-a0c8-849f77113e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:31:49.533789 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a7733-954e-4aa6-a0c8-849f77113e7a admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:31:49.533789 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a7733-954e-4aa6-a0c8-849f77113e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:31:49.533789 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a7733-954e-4aa6-a0c8-849f77113e7a admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:31:49.534454 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a7733-954e-4aa6-a0c8-849f77113e7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:31:49.536426 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a7733-954e-4aa6-a0c8-849f77113e7a admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:31:49.620432 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1259/2513] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:31:49 2022] POST /identity/v3/projects => generated 373 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:31:49.624599 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca0c554-e934-47ee-85e5-e3721900f09b None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:31:49.636741 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca0c554-e934-47ee-85e5-e3721900f09b None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:31:49.695539 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bea6e2-6f91-4edb-b276-aed24ff49fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:31:49.697170 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bea6e2-6f91-4edb-b276-aed24ff49fef admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:31:49.697506 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bea6e2-6f91-4edb-b276-aed24ff49fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:31:49.697790 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bea6e2-6f91-4edb-b276-aed24ff49fef admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:31:49.698490 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bea6e2-6f91-4edb-b276-aed24ff49fef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:31:49.700669 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bea6e2-6f91-4edb-b276-aed24ff49fef admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:31:49.794815 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1255/2514] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:31:49 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:31:49.798886 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a7733-954e-4aa6-a0c8-849f77113e7a admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:31:49.814611 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a7733-954e-4aa6-a0c8-849f77113e7a admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:31:49.815686 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c8bb0e-8035-406b-91be-1590a0b2f496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:31:49.816390 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8bb0e-8035-406b-91be-1590a0b2f496 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:31:49.816677 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8bb0e-8035-406b-91be-1590a0b2f496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:31:49.816953 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8bb0e-8035-406b-91be-1590a0b2f496 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:31:49.817715 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c8bb0e-8035-406b-91be-1590a0b2f496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:31:49.819584 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c8bb0e-8035-406b-91be-1590a0b2f496 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:31:49.833079 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1260/2515] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:31:49.837732 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bea6e2-6f91-4edb-b276-aed24ff49fef admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:31:49.847821 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bea6e2-6f91-4edb-b276-aed24ff49fef admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:31:49.854152 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257913bc-8a84-4691-af3a-fdd3f73c0040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:31:49.855786 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257913bc-8a84-4691-af3a-fdd3f73c0040 admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:31:49.856075 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257913bc-8a84-4691-af3a-fdd3f73c0040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:31:49.861168 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257913bc-8a84-4691-af3a-fdd3f73c0040 admin admin] PATH_INFO: `/v3/projects/8621790ad7ad4af5bcab94c4013a159b/users/ec6c189d0fac4aa39ea320ab2c00f913/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:31:49.872060 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257913bc-8a84-4691-af3a-fdd3f73c0040 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8621790ad7ad4af5bcab94c4013a159b, user_id=ec6c189d0fac4aa39ea320ab2c00f913, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:31:49.874910 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257913bc-8a84-4691-af3a-fdd3f73c0040 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:31:49.952533 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1256/2516] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:31:49 2022] PUT /identity/v3/projects/8621790ad7ad4af5bcab94c4013a159b/users/ec6c189d0fac4aa39ea320ab2c00f913/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:31:49.962317 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c8bb0e-8035-406b-91be-1590a0b2f496 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:31:49.972399 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c8bb0e-8035-406b-91be-1590a0b2f496 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:31:50.001212 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:31:50.033773 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd4821-cf3a-4187-a1a1-20ad0b3b7a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:31:50.034556 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd4821-cf3a-4187-a1a1-20ad0b3b7a40 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:31:50.034844 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd4821-cf3a-4187-a1a1-20ad0b3b7a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:31:50.035119 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd4821-cf3a-4187-a1a1-20ad0b3b7a40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:31:50.035957 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd4821-cf3a-4187-a1a1-20ad0b3b7a40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:31:50.037488 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd4821-cf3a-4187-a1a1-20ad0b3b7a40 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:31:50.048846 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1261/2517] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:31:50.052943 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257913bc-8a84-4691-af3a-fdd3f73c0040 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:31:50.067501 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257913bc-8a84-4691-af3a-fdd3f73c0040 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:31:50.073336 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38eed19-a929-4d7d-9886-0efd1ef1a6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:31:50.082058 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38eed19-a929-4d7d-9886-0efd1ef1a6d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:31:50.082058 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38eed19-a929-4d7d-9886-0efd1ef1a6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:31:50.082058 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38eed19-a929-4d7d-9886-0efd1ef1a6d2 admin admin] PATH_INFO: `/v3/projects/8621790ad7ad4af5bcab94c4013a159b/users/ec6c189d0fac4aa39ea320ab2c00f913/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:31:50.082058 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38eed19-a929-4d7d-9886-0efd1ef1a6d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8621790ad7ad4af5bcab94c4013a159b, user_id=ec6c189d0fac4aa39ea320ab2c00f913, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:31:50.082058 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38eed19-a929-4d7d-9886-0efd1ef1a6d2 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:31:50.091569 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1257/2518] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:31:50 2022] PUT /identity/v3/projects/8621790ad7ad4af5bcab94c4013a159b/users/ec6c189d0fac4aa39ea320ab2c00f913/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:31:55.335278 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be318b-c365-4f7a-9510-d90a5c8c7871 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:31:55.337035 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be318b-c365-4f7a-9510-d90a5c8c7871 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:31:55.337325 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be318b-c365-4f7a-9510-d90a5c8c7871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:31:55.372747 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-67be318b-c365-4f7a-9510-d90a5c8c7871 None None] MFA Rules not processed for user `ec6c189d0fac4aa39ea320ab2c00f913`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:31:55.374146 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-67be318b-c365-4f7a-9510-d90a5c8c7871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:31:55.446677 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1262/2519] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:31:55 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:31:55.464877 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38eed19-a929-4d7d-9886-0efd1ef1a6d2 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:31:55.464877 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-c38eed19-a929-4d7d-9886-0efd1ef1a6d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:31:55.567778 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38eed19-a929-4d7d-9886-0efd1ef1a6d2 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:31:55.573553 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f93c1-5d63-49f3-9816-554ae3ac1340 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066aaba3e9af4f85ab0cba89a3d32e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:31:55.574193 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f93c1-5d63-49f3-9816-554ae3ac1340 service nova] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:31:55.574479 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f93c1-5d63-49f3-9816-554ae3ac1340 service nova] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:31:55.574757 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f93c1-5d63-49f3-9816-554ae3ac1340 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:31:55.583118 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:31:55.649846 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f93c1-5d63-49f3-9816-554ae3ac1340 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:31:55.651564 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f93c1-5d63-49f3-9816-554ae3ac1340 service nova] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:31:55.668437 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1258/2520] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:31:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:31:59.270216 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745a3b3-038b-4962-8ca1-ebaff6234f51 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:31:59.271263 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745a3b3-038b-4962-8ca1-ebaff6234f51 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:31:59.271375 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745a3b3-038b-4962-8ca1-ebaff6234f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:31:59.291601 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-b745a3b3-038b-4962-8ca1-ebaff6234f51 None None] MFA Rules not processed for user `a7da9a3f3e5f4eb4b1a01d33dcdb4bf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:31:59.293337 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-b745a3b3-038b-4962-8ca1-ebaff6234f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:31:59.302308 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1263/2521] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:31:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:31:59.957877 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f93c1-5d63-49f3-9816-554ae3ac1340 service nova] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:00.039613 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f93c1-5d63-49f3-9816-554ae3ac1340 service nova] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:00.044673 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7769e-ca0c-480c-9519-b12254e0bc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:00.045666 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7769e-ca0c-480c-9519-b12254e0bc44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:00.046025 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7769e-ca0c-480c-9519-b12254e0bc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:00.046481 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7769e-ca0c-480c-9519-b12254e0bc44 admin admin] PATH_INFO: `/v3/users/976a144105524c47a35f5a8a32888210` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:00.047929 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a7769e-ca0c-480c-9519-b12254e0bc44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=976a144105524c47a35f5a8a32888210)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:00.049971 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a7769e-ca0c-480c-9519-b12254e0bc44 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:00.269008 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-15a7769e-ca0c-480c-9519-b12254e0bc44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '976a144105524c47a35f5a8a32888210'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:00.288056 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-15a7769e-ca0c-480c-9519-b12254e0bc44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '976a144105524c47a35f5a8a32888210'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:00.288834 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-15a7769e-ca0c-480c-9519-b12254e0bc44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '976a144105524c47a35f5a8a32888210'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:00.296764 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-15a7769e-ca0c-480c-9519-b12254e0bc44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '976a144105524c47a35f5a8a32888210'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:00.297420 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-15a7769e-ca0c-480c-9519-b12254e0bc44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '976a144105524c47a35f5a8a32888210'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:00.382105 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1259/2522] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:31:59 2022] DELETE /identity/v3/users/976a144105524c47a35f5a8a32888210 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:32:00.387158 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7a8aa-db1a-4a4a-9651-40779bdde24b None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:00.387638 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7a8aa-db1a-4a4a-9651-40779bdde24b None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:00.387737 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7a8aa-db1a-4a4a-9651-40779bdde24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:00.406478 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-f1c7a8aa-db1a-4a4a-9651-40779bdde24b None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:32:00.407786 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-f1c7a8aa-db1a-4a4a-9651-40779bdde24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:00.466509 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1264/2523] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:32:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:32:00.476391 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7769e-ca0c-480c-9519-b12254e0bc44 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:00.477853 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-15a7769e-ca0c-480c-9519-b12254e0bc44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:00.509834 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:00.534318 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7769e-ca0c-480c-9519-b12254e0bc44 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:00.537900 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f2f34-12ee-4fbc-a354-5d4511872970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:00.538537 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f2f34-12ee-4fbc-a354-5d4511872970 service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:00.538812 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f2f34-12ee-4fbc-a354-5d4511872970 service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:00.539082 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f2f34-12ee-4fbc-a354-5d4511872970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:00.548969 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f2f34-12ee-4fbc-a354-5d4511872970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:00.550417 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f2f34-12ee-4fbc-a354-5d4511872970 service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:00.559934 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1260/2524] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:32:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:32:00.989926 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c7a8aa-db1a-4a4a-9651-40779bdde24b None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:00.992198 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-f1c7a8aa-db1a-4a4a-9651-40779bdde24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:01.005319 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c7a8aa-db1a-4a4a-9651-40779bdde24b None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:01.010731 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab951b70-6772-4c90-8edb-d03e044e2265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:01.011604 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab951b70-6772-4c90-8edb-d03e044e2265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:01.011888 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab951b70-6772-4c90-8edb-d03e044e2265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:01.012188 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab951b70-6772-4c90-8edb-d03e044e2265 admin admin] PATH_INFO: `/v3/projects/f98bb4e7829d4aa3b924ce9b711b054c` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:01.013411 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab951b70-6772-4c90-8edb-d03e044e2265 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f98bb4e7829d4aa3b924ce9b711b054c)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:01.015375 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab951b70-6772-4c90-8edb-d03e044e2265 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:01.118809 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:01.125805 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-ab951b70-6772-4c90-8edb-d03e044e2265 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f98bb4e7829d4aa3b924ce9b711b054c', 'request_id': 'req-ab951b70-6772-4c90-8edb-d03e044e2265'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:01.132994 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-ab951b70-6772-4c90-8edb-d03e044e2265 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f98bb4e7829d4aa3b924ce9b711b054c', 'request_id': 'req-ab951b70-6772-4c90-8edb-d03e044e2265'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:01.139234 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-ab951b70-6772-4c90-8edb-d03e044e2265 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f98bb4e7829d4aa3b924ce9b711b054c', 'request_id': 'req-ab951b70-6772-4c90-8edb-d03e044e2265'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:01.227497 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-ab951b70-6772-4c90-8edb-d03e044e2265 admin admin] The token cache is being invalidate because project f98bb4e7829d4aa3b924ce9b711b054c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:32:01.227947 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-ab951b70-6772-4c90-8edb-d03e044e2265 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:01.228591 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-ab951b70-6772-4c90-8edb-d03e044e2265 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:01.230152 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1265/2525] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:32:00 2022] DELETE /identity/v3/projects/f98bb4e7829d4aa3b924ce9b711b054c => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:32:01.234214 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f2f34-12ee-4fbc-a354-5d4511872970 service neutron] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:01.244438 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f2f34-12ee-4fbc-a354-5d4511872970 service neutron] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:01.308290 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37728057-990c-4d96-b4b3-8db7a9e558a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:01.309164 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37728057-990c-4d96-b4b3-8db7a9e558a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:01.309441 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37728057-990c-4d96-b4b3-8db7a9e558a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:01.309710 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37728057-990c-4d96-b4b3-8db7a9e558a8 admin admin] PATH_INFO: `/v3/users/85ad182ef8c3487bac1d3cb924e2dbf3` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:01.310889 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37728057-990c-4d96-b4b3-8db7a9e558a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85ad182ef8c3487bac1d3cb924e2dbf3)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:01.312837 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37728057-990c-4d96-b4b3-8db7a9e558a8 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:01.486306 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-37728057-990c-4d96-b4b3-8db7a9e558a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85ad182ef8c3487bac1d3cb924e2dbf3'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:01.500255 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-37728057-990c-4d96-b4b3-8db7a9e558a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85ad182ef8c3487bac1d3cb924e2dbf3'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:01.503188 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-37728057-990c-4d96-b4b3-8db7a9e558a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85ad182ef8c3487bac1d3cb924e2dbf3'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:01.508981 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-37728057-990c-4d96-b4b3-8db7a9e558a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85ad182ef8c3487bac1d3cb924e2dbf3'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:01.509742 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-37728057-990c-4d96-b4b3-8db7a9e558a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85ad182ef8c3487bac1d3cb924e2dbf3'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:01.574259 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1261/2526] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:32:01 2022] DELETE /identity/v3/users/85ad182ef8c3487bac1d3cb924e2dbf3 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:32:02.021705 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab951b70-6772-4c90-8edb-d03e044e2265 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:02.021705 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-ab951b70-6772-4c90-8edb-d03e044e2265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:02.031375 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab951b70-6772-4c90-8edb-d03e044e2265 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:02.094828 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158b709-f751-4a9f-a0e6-fd8b155d7b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:02.095724 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158b709-f751-4a9f-a0e6-fd8b155d7b91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:02.096004 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158b709-f751-4a9f-a0e6-fd8b155d7b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:02.096455 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158b709-f751-4a9f-a0e6-fd8b155d7b91 admin admin] PATH_INFO: `/v3/projects/53cecfe0283a4bfcb5f4204df941e7f7` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:02.104724 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d158b709-f751-4a9f-a0e6-fd8b155d7b91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53cecfe0283a4bfcb5f4204df941e7f7)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:02.104724 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d158b709-f751-4a9f-a0e6-fd8b155d7b91 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:02.203977 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-d158b709-f751-4a9f-a0e6-fd8b155d7b91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53cecfe0283a4bfcb5f4204df941e7f7', 'request_id': 'req-d158b709-f751-4a9f-a0e6-fd8b155d7b91'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:02.210815 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-d158b709-f751-4a9f-a0e6-fd8b155d7b91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53cecfe0283a4bfcb5f4204df941e7f7', 'request_id': 'req-d158b709-f751-4a9f-a0e6-fd8b155d7b91'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:02.216879 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-d158b709-f751-4a9f-a0e6-fd8b155d7b91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53cecfe0283a4bfcb5f4204df941e7f7', 'request_id': 'req-d158b709-f751-4a9f-a0e6-fd8b155d7b91'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:02.290426 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-d158b709-f751-4a9f-a0e6-fd8b155d7b91 admin admin] The token cache is being invalidate because project 53cecfe0283a4bfcb5f4204df941e7f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:32:02.290737 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-d158b709-f751-4a9f-a0e6-fd8b155d7b91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:02.291369 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-d158b709-f751-4a9f-a0e6-fd8b155d7b91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:02.292948 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1266/2527] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:32:02 2022] DELETE /identity/v3/projects/53cecfe0283a4bfcb5f4204df941e7f7 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:32:02.298005 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ad590-a257-4b7f-8e02-b607be029b7c None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:02.298837 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ad590-a257-4b7f-8e02-b607be029b7c None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:02.299118 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ad590-a257-4b7f-8e02-b607be029b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:02.317355 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-d91ad590-a257-4b7f-8e02-b607be029b7c None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:32:02.318558 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-d91ad590-a257-4b7f-8e02-b607be029b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:02.364505 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:02.378805 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1262/2528] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:32:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:32:02.386942 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca77ba-7f67-40c4-b323-eaf0b2105dd1 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:02.387236 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca77ba-7f67-40c4-b323-eaf0b2105dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:02.387522 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca77ba-7f67-40c4-b323-eaf0b2105dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:02.408120 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-9bca77ba-7f67-40c4-b323-eaf0b2105dd1 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:32:02.409368 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-9bca77ba-7f67-40c4-b323-eaf0b2105dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:02.417976 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1267/2529] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:32:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:32:02.422236 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ad590-a257-4b7f-8e02-b607be029b7c None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:02.433838 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ad590-a257-4b7f-8e02-b607be029b7c None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:02.439251 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19248163-ec7b-4398-9e6b-5a90fe1e00e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:02.443850 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19248163-ec7b-4398-9e6b-5a90fe1e00e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:02.443850 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19248163-ec7b-4398-9e6b-5a90fe1e00e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:02.443850 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19248163-ec7b-4398-9e6b-5a90fe1e00e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:02.443850 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19248163-ec7b-4398-9e6b-5a90fe1e00e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:32:02.443850 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19248163-ec7b-4398-9e6b-5a90fe1e00e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:02.443850 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19248163-ec7b-4398-9e6b-5a90fe1e00e6 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:02.455659 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1263/2530] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:32:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:32:02.459966 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca77ba-7f67-40c4-b323-eaf0b2105dd1 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:02.470136 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca77ba-7f67-40c4-b323-eaf0b2105dd1 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:02.475020 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd49534-3521-4ff6-88a1-31cf6cd4a8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:02.475700 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd49534-3521-4ff6-88a1-31cf6cd4a8fd admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:02.475985 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd49534-3521-4ff6-88a1-31cf6cd4a8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:02.476308 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd49534-3521-4ff6-88a1-31cf6cd4a8fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:02.477044 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd49534-3521-4ff6-88a1-31cf6cd4a8fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:02.478992 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd49534-3521-4ff6-88a1-31cf6cd4a8fd admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:02.579031 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1268/2531] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:32:02 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:32:02.583278 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19248163-ec7b-4398-9e6b-5a90fe1e00e6 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:02.595137 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19248163-ec7b-4398-9e6b-5a90fe1e00e6 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:02.651902 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea92e8-c1b2-416c-b68b-3a13e9e1e59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:02.652593 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea92e8-c1b2-416c-b68b-3a13e9e1e59f admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:02.652875 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea92e8-c1b2-416c-b68b-3a13e9e1e59f admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:02.653154 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea92e8-c1b2-416c-b68b-3a13e9e1e59f admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:02.653823 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ea92e8-c1b2-416c-b68b-3a13e9e1e59f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:02.655713 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ea92e8-c1b2-416c-b68b-3a13e9e1e59f admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:02.791733 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1264/2532] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:32:02 2022] POST /identity/v3/users => generated 292 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:32:02.795961 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd49534-3521-4ff6-88a1-31cf6cd4a8fd admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:02.808178 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd49534-3521-4ff6-88a1-31cf6cd4a8fd admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:02.812948 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3278981c-b720-44f1-bea4-b479d8945d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:02.813609 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278981c-b720-44f1-bea4-b479d8945d05 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:02.813890 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278981c-b720-44f1-bea4-b479d8945d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:02.814160 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278981c-b720-44f1-bea4-b479d8945d05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:02.814965 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3278981c-b720-44f1-bea4-b479d8945d05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:02.816689 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3278981c-b720-44f1-bea4-b479d8945d05 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:02.828346 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1269/2533] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:32:02.832488 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea92e8-c1b2-416c-b68b-3a13e9e1e59f admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:02.843679 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea92e8-c1b2-416c-b68b-3a13e9e1e59f admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:02.848450 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa09dfd-cc3c-4ba5-ab1d-2ef6c87654b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:02.849095 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa09dfd-cc3c-4ba5-ab1d-2ef6c87654b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:02.849506 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa09dfd-cc3c-4ba5-ab1d-2ef6c87654b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:02.849774 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa09dfd-cc3c-4ba5-ab1d-2ef6c87654b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:02.850679 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa09dfd-cc3c-4ba5-ab1d-2ef6c87654b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:02.852541 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa09dfd-cc3c-4ba5-ab1d-2ef6c87654b7 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:02.863565 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1265/2534] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:32:02.870720 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3278981c-b720-44f1-bea4-b479d8945d05 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:02.881130 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3278981c-b720-44f1-bea4-b479d8945d05 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:02.886503 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab7b67-55e4-4928-ab4d-7f50a8725531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:02.887387 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab7b67-55e4-4928-ab4d-7f50a8725531 admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:02.887669 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab7b67-55e4-4928-ab4d-7f50a8725531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:02.887942 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab7b67-55e4-4928-ab4d-7f50a8725531 admin admin] PATH_INFO: `/v3/projects/34b9ca4b5a344b7ea64a2121735502b0/users/a0427fcc35c04fd0be9cf0424952733c/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:02.904563 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eab7b67-55e4-4928-ab4d-7f50a8725531 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34b9ca4b5a344b7ea64a2121735502b0, user_id=a0427fcc35c04fd0be9cf0424952733c, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:02.907304 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eab7b67-55e4-4928-ab4d-7f50a8725531 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:02.909685 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:02.976460 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1270/2535] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:32:02 2022] PUT /identity/v3/projects/34b9ca4b5a344b7ea64a2121735502b0/users/a0427fcc35c04fd0be9cf0424952733c/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:32:02.987376 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa05615-5691-404b-9c77-aa433c67acef None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:02.987659 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa05615-5691-404b-9c77-aa433c67acef None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:02.987934 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa05615-5691-404b-9c77-aa433c67acef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:03.020079 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-baa05615-5691-404b-9c77-aa433c67acef None None] MFA Rules not processed for user `a0427fcc35c04fd0be9cf0424952733c`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:32:03.021344 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-baa05615-5691-404b-9c77-aa433c67acef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:03.093211 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1266/2536] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:32:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:32:03.097954 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab7b67-55e4-4928-ab4d-7f50a8725531 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:03.160296 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab7b67-55e4-4928-ab4d-7f50a8725531 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:03.165025 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84515d82-bbb3-499c-a2eb-e2e2879e60f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:03.165686 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84515d82-bbb3-499c-a2eb-e2e2879e60f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:03.165966 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84515d82-bbb3-499c-a2eb-e2e2879e60f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:03.166240 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84515d82-bbb3-499c-a2eb-e2e2879e60f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:03.166922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84515d82-bbb3-499c-a2eb-e2e2879e60f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:03.168886 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84515d82-bbb3-499c-a2eb-e2e2879e60f7 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:03.274986 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1271/2537] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:32:03 2022] POST /identity/v3/projects => generated 383 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:32:03.279138 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa05615-5691-404b-9c77-aa433c67acef None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:03.290930 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa05615-5691-404b-9c77-aa433c67acef None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:03.339263 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:03.349977 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a195c5c-5d6c-47f5-aa70-de2e0e01bbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:03.350590 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a195c5c-5d6c-47f5-aa70-de2e0e01bbd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:03.350869 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a195c5c-5d6c-47f5-aa70-de2e0e01bbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:03.351140 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a195c5c-5d6c-47f5-aa70-de2e0e01bbd0 admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:03.352583 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a195c5c-5d6c-47f5-aa70-de2e0e01bbd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:03.354518 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a195c5c-5d6c-47f5-aa70-de2e0e01bbd0 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:03.490548 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1267/2538] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:32:03 2022] POST /identity/v3/users => generated 298 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:32:03.495198 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84515d82-bbb3-499c-a2eb-e2e2879e60f7 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:03.507372 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84515d82-bbb3-499c-a2eb-e2e2879e60f7 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:03.512061 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7ca77-5760-43a1-ad71-1156e0cd8531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:03.512835 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7ca77-5760-43a1-ad71-1156e0cd8531 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:03.513112 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7ca77-5760-43a1-ad71-1156e0cd8531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:03.513410 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7ca77-5760-43a1-ad71-1156e0cd8531 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:03.514123 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb7ca77-5760-43a1-ad71-1156e0cd8531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:03.515719 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb7ca77-5760-43a1-ad71-1156e0cd8531 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:03.526612 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1272/2539] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:32:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:32:03.530900 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a195c5c-5d6c-47f5-aa70-de2e0e01bbd0 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:03.542085 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a195c5c-5d6c-47f5-aa70-de2e0e01bbd0 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:03.547258 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba970288-4f6c-4e23-acb0-8fa967f27647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:03.548190 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba970288-4f6c-4e23-acb0-8fa967f27647 admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:03.548480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba970288-4f6c-4e23-acb0-8fa967f27647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:03.548761 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba970288-4f6c-4e23-acb0-8fa967f27647 admin admin] PATH_INFO: `/v3/projects/04abc2db1a1d4dbaa70a7dac1559bebd/users/7912a5585a614c978249239422a782dc/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:03.564786 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba970288-4f6c-4e23-acb0-8fa967f27647 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04abc2db1a1d4dbaa70a7dac1559bebd, user_id=7912a5585a614c978249239422a782dc, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:03.567454 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba970288-4f6c-4e23-acb0-8fa967f27647 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:03.666361 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1268/2540] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:32:03 2022] PUT /identity/v3/projects/04abc2db1a1d4dbaa70a7dac1559bebd/users/7912a5585a614c978249239422a782dc/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:32:03.678241 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7ca77-5760-43a1-ad71-1156e0cd8531 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:03.689832 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7ca77-5760-43a1-ad71-1156e0cd8531 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:03.751825 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe02ebf-fec4-4312-a359-71d7abfe10ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:03.752677 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe02ebf-fec4-4312-a359-71d7abfe10ee admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:03.753212 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe02ebf-fec4-4312-a359-71d7abfe10ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:03.753607 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe02ebf-fec4-4312-a359-71d7abfe10ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:03.754446 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe02ebf-fec4-4312-a359-71d7abfe10ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:03.756262 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe02ebf-fec4-4312-a359-71d7abfe10ee admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:03.767913 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1273/2541] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:32:03 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:32:03.772101 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba970288-4f6c-4e23-acb0-8fa967f27647 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:03.783010 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba970288-4f6c-4e23-acb0-8fa967f27647 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:03.787578 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b90ce-f543-4c02-bd2c-47d454f9f8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:03.788507 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b90ce-f543-4c02-bd2c-47d454f9f8a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:03.788789 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b90ce-f543-4c02-bd2c-47d454f9f8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:03.789062 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b90ce-f543-4c02-bd2c-47d454f9f8a9 admin admin] PATH_INFO: `/v3/projects/04abc2db1a1d4dbaa70a7dac1559bebd/users/7912a5585a614c978249239422a782dc/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:03.791091 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b90ce-f543-4c02-bd2c-47d454f9f8a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04abc2db1a1d4dbaa70a7dac1559bebd, user_id=7912a5585a614c978249239422a782dc, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:03.794512 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b90ce-f543-4c02-bd2c-47d454f9f8a9 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:03.806329 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1269/2542] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:32:03 2022] PUT /identity/v3/projects/04abc2db1a1d4dbaa70a7dac1559bebd/users/7912a5585a614c978249239422a782dc/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:32:03.817540 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c496c03-a229-410f-8e29-af27e17c9f85 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:03.818805 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c496c03-a229-410f-8e29-af27e17c9f85 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:03.818805 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c496c03-a229-410f-8e29-af27e17c9f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:03.845714 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-9c496c03-a229-410f-8e29-af27e17c9f85 None None] MFA Rules not processed for user `7912a5585a614c978249239422a782dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:32:03.846956 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-9c496c03-a229-410f-8e29-af27e17c9f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:03.896904 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:03.915953 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1274/2543] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:32:03 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:32:03.927218 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b90ce-f543-4c02-bd2c-47d454f9f8a9 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:03.929115 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-162b90ce-f543-4c02-bd2c-47d454f9f8a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:03.990596 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b90ce-f543-4c02-bd2c-47d454f9f8a9 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:03.995063 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d52563-27fb-4877-877a-b812043d04e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:03.995738 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d52563-27fb-4877-877a-b812043d04e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:03.996088 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d52563-27fb-4877-877a-b812043d04e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:03.996410 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d52563-27fb-4877-877a-b812043d04e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:04.006439 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d52563-27fb-4877-877a-b812043d04e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:04.007863 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d52563-27fb-4877-877a-b812043d04e2 service cinder] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:04.018362 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1270/2544] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:32:03 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:32:04.118571 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c496c03-a229-410f-8e29-af27e17c9f85 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:04.128860 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c496c03-a229-410f-8e29-af27e17c9f85 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:04.132379 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1027c5e-241f-46fe-9bf1-930c838e7e73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:04.133007 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1027c5e-241f-46fe-9bf1-930c838e7e73 service cinder] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:04.133282 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1027c5e-241f-46fe-9bf1-930c838e7e73 service cinder] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:04.133550 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1027c5e-241f-46fe-9bf1-930c838e7e73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:04.192993 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1027c5e-241f-46fe-9bf1-930c838e7e73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:04.194402 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1027c5e-241f-46fe-9bf1-930c838e7e73 service cinder] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:04.203864 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1275/2545] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:32:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:32:07.300935 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d52563-27fb-4877-877a-b812043d04e2 service cinder] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:07.364263 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d52563-27fb-4877-877a-b812043d04e2 service cinder] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:07.368673 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d1640-0da1-404b-95f1-ffcb116aa0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:07.370139 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d1640-0da1-404b-95f1-ffcb116aa0ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:07.370415 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d1640-0da1-404b-95f1-ffcb116aa0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:07.370685 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d1640-0da1-404b-95f1-ffcb116aa0ad admin admin] PATH_INFO: `/v3/users/a0427fcc35c04fd0be9cf0424952733c` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:07.371864 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d1640-0da1-404b-95f1-ffcb116aa0ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0427fcc35c04fd0be9cf0424952733c)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:07.373791 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d1640-0da1-404b-95f1-ffcb116aa0ad admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:07.588651 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:07.591403 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-cf1d1640-0da1-404b-95f1-ffcb116aa0ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0427fcc35c04fd0be9cf0424952733c'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:07.604682 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-cf1d1640-0da1-404b-95f1-ffcb116aa0ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0427fcc35c04fd0be9cf0424952733c'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:07.605401 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-cf1d1640-0da1-404b-95f1-ffcb116aa0ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0427fcc35c04fd0be9cf0424952733c'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:07.612324 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-cf1d1640-0da1-404b-95f1-ffcb116aa0ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0427fcc35c04fd0be9cf0424952733c'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:07.612950 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-cf1d1640-0da1-404b-95f1-ffcb116aa0ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0427fcc35c04fd0be9cf0424952733c'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:07.711567 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1271/2546] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:32:07 2022] DELETE /identity/v3/users/a0427fcc35c04fd0be9cf0424952733c => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:32:07.715943 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3eb61-13eb-4308-8b75-937cf66add72 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:07.716383 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3eb61-13eb-4308-8b75-937cf66add72 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:07.716556 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3eb61-13eb-4308-8b75-937cf66add72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:07.734387 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-1cd3eb61-13eb-4308-8b75-937cf66add72 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:32:07.735613 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-1cd3eb61-13eb-4308-8b75-937cf66add72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:07.795305 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1276/2547] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:32:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:32:07.805105 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d1640-0da1-404b-95f1-ffcb116aa0ad admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:07.807273 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-cf1d1640-0da1-404b-95f1-ffcb116aa0ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:07.866371 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d1640-0da1-404b-95f1-ffcb116aa0ad admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:07.870300 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ad65c-0e98-4aac-a1fa-a6361d785be4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:07.870965 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ad65c-0e98-4aac-a1fa-a6361d785be4 service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:07.871250 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ad65c-0e98-4aac-a1fa-a6361d785be4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:07.871698 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ad65c-0e98-4aac-a1fa-a6361d785be4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:07.880850 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ad65c-0e98-4aac-a1fa-a6361d785be4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:07.882369 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ad65c-0e98-4aac-a1fa-a6361d785be4 service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:07.892785 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1272/2548] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:32:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:32:08.308085 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd3eb61-13eb-4308-8b75-937cf66add72 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:08.309957 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-1cd3eb61-13eb-4308-8b75-937cf66add72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:08.325211 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd3eb61-13eb-4308-8b75-937cf66add72 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:08.330241 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da347af-9e1e-43d0-87ce-483daf44d8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:08.331149 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da347af-9e1e-43d0-87ce-483daf44d8e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:08.331434 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da347af-9e1e-43d0-87ce-483daf44d8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:08.331713 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da347af-9e1e-43d0-87ce-483daf44d8e7 admin admin] PATH_INFO: `/v3/projects/34b9ca4b5a344b7ea64a2121735502b0` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:08.332974 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da347af-9e1e-43d0-87ce-483daf44d8e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34b9ca4b5a344b7ea64a2121735502b0)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:08.335093 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da347af-9e1e-43d0-87ce-483daf44d8e7 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:08.432424 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-6da347af-9e1e-43d0-87ce-483daf44d8e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34b9ca4b5a344b7ea64a2121735502b0', 'request_id': 'req-6da347af-9e1e-43d0-87ce-483daf44d8e7'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:08.438692 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-6da347af-9e1e-43d0-87ce-483daf44d8e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34b9ca4b5a344b7ea64a2121735502b0', 'request_id': 'req-6da347af-9e1e-43d0-87ce-483daf44d8e7'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:08.444820 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-6da347af-9e1e-43d0-87ce-483daf44d8e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34b9ca4b5a344b7ea64a2121735502b0', 'request_id': 'req-6da347af-9e1e-43d0-87ce-483daf44d8e7'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:08.532881 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-6da347af-9e1e-43d0-87ce-483daf44d8e7 admin admin] The token cache is being invalidate because project 34b9ca4b5a344b7ea64a2121735502b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:32:08.533181 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-6da347af-9e1e-43d0-87ce-483daf44d8e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:08.533780 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-6da347af-9e1e-43d0-87ce-483daf44d8e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:08.535311 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1277/2549] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:32:08 2022] DELETE /identity/v3/projects/34b9ca4b5a344b7ea64a2121735502b0 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:32:08.539327 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ad65c-0e98-4aac-a1fa-a6361d785be4 service neutron] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:08.550042 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ad65c-0e98-4aac-a1fa-a6361d785be4 service neutron] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:08.612510 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabaf776-d97b-4e1f-8f3b-8d5714368c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:08.613393 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabaf776-d97b-4e1f-8f3b-8d5714368c2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:08.613676 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabaf776-d97b-4e1f-8f3b-8d5714368c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:08.613956 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabaf776-d97b-4e1f-8f3b-8d5714368c2c admin admin] PATH_INFO: `/v3/users/7912a5585a614c978249239422a782dc` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:08.615145 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabaf776-d97b-4e1f-8f3b-8d5714368c2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7912a5585a614c978249239422a782dc)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:08.617147 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabaf776-d97b-4e1f-8f3b-8d5714368c2c admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:08.782135 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-aabaf776-d97b-4e1f-8f3b-8d5714368c2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7912a5585a614c978249239422a782dc'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:08.794725 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-aabaf776-d97b-4e1f-8f3b-8d5714368c2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7912a5585a614c978249239422a782dc'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:08.795510 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-aabaf776-d97b-4e1f-8f3b-8d5714368c2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7912a5585a614c978249239422a782dc'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:08.796735 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:08.802642 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-aabaf776-d97b-4e1f-8f3b-8d5714368c2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7912a5585a614c978249239422a782dc'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:08.803293 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-aabaf776-d97b-4e1f-8f3b-8d5714368c2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7912a5585a614c978249239422a782dc'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:08.893597 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1273/2550] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:32:08 2022] DELETE /identity/v3/users/7912a5585a614c978249239422a782dc => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:32:09.284199 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da347af-9e1e-43d0-87ce-483daf44d8e7 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:09.286268 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-6da347af-9e1e-43d0-87ce-483daf44d8e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:09.302986 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da347af-9e1e-43d0-87ce-483daf44d8e7 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:09.314752 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:09.365804 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d3866-e931-4d7a-89a3-3ae62d20f891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:09.366601 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d3866-e931-4d7a-89a3-3ae62d20f891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:09.367122 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d3866-e931-4d7a-89a3-3ae62d20f891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:09.367592 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d3866-e931-4d7a-89a3-3ae62d20f891 admin admin] PATH_INFO: `/v3/projects/04abc2db1a1d4dbaa70a7dac1559bebd` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:09.370051 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152d3866-e931-4d7a-89a3-3ae62d20f891 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04abc2db1a1d4dbaa70a7dac1559bebd)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:09.372063 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152d3866-e931-4d7a-89a3-3ae62d20f891 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:09.495234 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-152d3866-e931-4d7a-89a3-3ae62d20f891 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04abc2db1a1d4dbaa70a7dac1559bebd', 'request_id': 'req-152d3866-e931-4d7a-89a3-3ae62d20f891'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:09.502194 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-152d3866-e931-4d7a-89a3-3ae62d20f891 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04abc2db1a1d4dbaa70a7dac1559bebd', 'request_id': 'req-152d3866-e931-4d7a-89a3-3ae62d20f891'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:09.508293 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-152d3866-e931-4d7a-89a3-3ae62d20f891 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04abc2db1a1d4dbaa70a7dac1559bebd', 'request_id': 'req-152d3866-e931-4d7a-89a3-3ae62d20f891'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:09.578658 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-152d3866-e931-4d7a-89a3-3ae62d20f891 admin admin] The token cache is being invalidate because project 04abc2db1a1d4dbaa70a7dac1559bebd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:32:09.578969 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-152d3866-e931-4d7a-89a3-3ae62d20f891 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:09.579584 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-152d3866-e931-4d7a-89a3-3ae62d20f891 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:09.581162 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1278/2551] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:32:09 2022] DELETE /identity/v3/projects/04abc2db1a1d4dbaa70a7dac1559bebd => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:32:09.586143 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f2679-e14f-4081-bff4-5377ea9cc859 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:09.586608 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f2679-e14f-4081-bff4-5377ea9cc859 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:09.586722 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f2679-e14f-4081-bff4-5377ea9cc859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:09.608055 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-2f0f2679-e14f-4081-bff4-5377ea9cc859 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:32:09.609328 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-2f0f2679-e14f-4081-bff4-5377ea9cc859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:09.671601 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1274/2552] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:32:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:32:09.679966 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9723e-8673-4bd9-ad62-2da5454366cf None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:09.680317 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9723e-8673-4bd9-ad62-2da5454366cf None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:09.680630 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9723e-8673-4bd9-ad62-2da5454366cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:09.699965 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-2ab9723e-8673-4bd9-ad62-2da5454366cf None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:32:09.701207 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-2ab9723e-8673-4bd9-ad62-2da5454366cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:09.709127 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1279/2553] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:32:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:32:09.714066 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f2679-e14f-4081-bff4-5377ea9cc859 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:09.724185 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f2679-e14f-4081-bff4-5377ea9cc859 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:09.729432 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ecebf-e27e-4348-9721-d89b85fbdaf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:09.730089 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ecebf-e27e-4348-9721-d89b85fbdaf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:09.730372 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ecebf-e27e-4348-9721-d89b85fbdaf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:09.730646 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ecebf-e27e-4348-9721-d89b85fbdaf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:09.731364 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502ecebf-e27e-4348-9721-d89b85fbdaf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:32:09.731669 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502ecebf-e27e-4348-9721-d89b85fbdaf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:09.733304 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502ecebf-e27e-4348-9721-d89b85fbdaf9 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:09.745077 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1275/2554] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:32:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:32:09.749465 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9723e-8673-4bd9-ad62-2da5454366cf None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:09.758834 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9723e-8673-4bd9-ad62-2da5454366cf None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:09.764258 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c80b5ab-99dd-40a5-80bb-fa1bd7726028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:09.764928 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80b5ab-99dd-40a5-80bb-fa1bd7726028 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:09.765211 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80b5ab-99dd-40a5-80bb-fa1bd7726028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:09.765486 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80b5ab-99dd-40a5-80bb-fa1bd7726028 admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:09.766187 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c80b5ab-99dd-40a5-80bb-fa1bd7726028 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:09.768115 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c80b5ab-99dd-40a5-80bb-fa1bd7726028 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:09.881664 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1280/2555] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:32:09 2022] POST /identity/v3/projects => generated 381 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:32:09.887698 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ecebf-e27e-4348-9721-d89b85fbdaf9 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:09.898227 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ecebf-e27e-4348-9721-d89b85fbdaf9 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:09.959553 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9f560-2363-4f13-88ee-3adff24c18a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:09.960262 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9f560-2363-4f13-88ee-3adff24c18a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:09.960546 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9f560-2363-4f13-88ee-3adff24c18a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:09.960821 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9f560-2363-4f13-88ee-3adff24c18a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:09.961505 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d9f560-2363-4f13-88ee-3adff24c18a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:09.964133 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d9f560-2363-4f13-88ee-3adff24c18a7 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:10.037016 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1276/2556] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:32:09 2022] POST /identity/v3/users => generated 291 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:32:10.041129 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c80b5ab-99dd-40a5-80bb-fa1bd7726028 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:10.051371 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c80b5ab-99dd-40a5-80bb-fa1bd7726028 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:10.055933 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5947c31-8ba5-4ac8-ac86-a396a28c4109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:10.056630 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5947c31-8ba5-4ac8-ac86-a396a28c4109 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:10.056913 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5947c31-8ba5-4ac8-ac86-a396a28c4109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:10.057261 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5947c31-8ba5-4ac8-ac86-a396a28c4109 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:10.067212 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5947c31-8ba5-4ac8-ac86-a396a28c4109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:10.067212 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5947c31-8ba5-4ac8-ac86-a396a28c4109 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:10.070099 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1281/2557] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:32:10.074974 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9f560-2363-4f13-88ee-3adff24c18a7 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:10.085325 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9f560-2363-4f13-88ee-3adff24c18a7 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:10.090682 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1543303-ae58-4003-984f-53c143ad25fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:10.091334 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1543303-ae58-4003-984f-53c143ad25fd admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:10.091621 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1543303-ae58-4003-984f-53c143ad25fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:10.091922 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1543303-ae58-4003-984f-53c143ad25fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:10.092675 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1543303-ae58-4003-984f-53c143ad25fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:10.094249 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1543303-ae58-4003-984f-53c143ad25fd admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:10.104133 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1277/2558] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:32:10.108207 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5947c31-8ba5-4ac8-ac86-a396a28c4109 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:10.118047 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5947c31-8ba5-4ac8-ac86-a396a28c4109 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:10.122843 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010c0c0-3829-4d0d-aff5-3079d5782543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:10.123712 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010c0c0-3829-4d0d-aff5-3079d5782543 admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:10.123989 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010c0c0-3829-4d0d-aff5-3079d5782543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:10.124295 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010c0c0-3829-4d0d-aff5-3079d5782543 admin admin] PATH_INFO: `/v3/projects/7861fae5100d47eab00bb9331a3030a2/users/b62e35f760a647bb9d16441af04d2580/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:10.141123 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010c0c0-3829-4d0d-aff5-3079d5782543 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7861fae5100d47eab00bb9331a3030a2, user_id=b62e35f760a647bb9d16441af04d2580, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:10.143676 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010c0c0-3829-4d0d-aff5-3079d5782543 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:10.208028 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1282/2559] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:32:10 2022] PUT /identity/v3/projects/7861fae5100d47eab00bb9331a3030a2/users/b62e35f760a647bb9d16441af04d2580/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:32:10.224036 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de9f79-b32f-4ef8-9480-5c42c4493651 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:10.224357 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de9f79-b32f-4ef8-9480-5c42c4493651 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:10.224627 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de9f79-b32f-4ef8-9480-5c42c4493651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:10.251032 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-74de9f79-b32f-4ef8-9480-5c42c4493651 None None] MFA Rules not processed for user `b62e35f760a647bb9d16441af04d2580`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:32:10.252318 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-74de9f79-b32f-4ef8-9480-5c42c4493651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:10.292183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:10.318984 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1278/2560] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:32:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:32:10.324313 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010c0c0-3829-4d0d-aff5-3079d5782543 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:10.366930 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:10.389670 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010c0c0-3829-4d0d-aff5-3079d5782543 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:10.394472 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf52d25-baa7-4df5-b07a-54525d9db7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:10.395119 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf52d25-baa7-4df5-b07a-54525d9db7d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:10.395399 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf52d25-baa7-4df5-b07a-54525d9db7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:10.395669 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf52d25-baa7-4df5-b07a-54525d9db7d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:10.396376 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf52d25-baa7-4df5-b07a-54525d9db7d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:10.398277 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf52d25-baa7-4df5-b07a-54525d9db7d8 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:10.480967 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1283/2561] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:32:10 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:32:10.485305 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de9f79-b32f-4ef8-9480-5c42c4493651 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:10.497507 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de9f79-b32f-4ef8-9480-5c42c4493651 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:10.553227 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e0912-1bb9-4d0b-84d1-f0430b9b2aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:10.553889 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e0912-1bb9-4d0b-84d1-f0430b9b2aa3 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:10.554168 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e0912-1bb9-4d0b-84d1-f0430b9b2aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:10.554440 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e0912-1bb9-4d0b-84d1-f0430b9b2aa3 admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:10.555121 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e0912-1bb9-4d0b-84d1-f0430b9b2aa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:10.557882 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e0912-1bb9-4d0b-84d1-f0430b9b2aa3 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:10.635059 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1279/2562] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:32:10 2022] POST /identity/v3/users => generated 299 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:32:10.639857 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf52d25-baa7-4df5-b07a-54525d9db7d8 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:10.654245 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf52d25-baa7-4df5-b07a-54525d9db7d8 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:10.658379 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fac332-f5e5-43c1-a140-50cd23bd4f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:10.659049 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fac332-f5e5-43c1-a140-50cd23bd4f6e admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:10.659331 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fac332-f5e5-43c1-a140-50cd23bd4f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:10.659607 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fac332-f5e5-43c1-a140-50cd23bd4f6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:10.660472 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fac332-f5e5-43c1-a140-50cd23bd4f6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:10.662115 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fac332-f5e5-43c1-a140-50cd23bd4f6e admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:10.674100 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1284/2563] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:32:10.678160 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e0912-1bb9-4d0b-84d1-f0430b9b2aa3 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:10.689606 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e0912-1bb9-4d0b-84d1-f0430b9b2aa3 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:10.694670 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fa1e0-6f98-4ba0-92e7-e528a1acd9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:10.695668 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fa1e0-6f98-4ba0-92e7-e528a1acd9ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:10.695950 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fa1e0-6f98-4ba0-92e7-e528a1acd9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:10.696259 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fa1e0-6f98-4ba0-92e7-e528a1acd9ce admin admin] PATH_INFO: `/v3/projects/8c2384dd02464f77a37feb962b7356bb/users/61f8743a68174763b5fe68d27d1e04b8/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:10.711320 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278fa1e0-6f98-4ba0-92e7-e528a1acd9ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c2384dd02464f77a37feb962b7356bb, user_id=61f8743a68174763b5fe68d27d1e04b8, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:10.714090 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278fa1e0-6f98-4ba0-92e7-e528a1acd9ce admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:10.794291 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1280/2564] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:32:10 2022] PUT /identity/v3/projects/8c2384dd02464f77a37feb962b7356bb/users/61f8743a68174763b5fe68d27d1e04b8/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:32:10.798358 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fac332-f5e5-43c1-a140-50cd23bd4f6e admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:10.810635 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fac332-f5e5-43c1-a140-50cd23bd4f6e admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:10.872823 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f478b2-d199-41d4-bc48-adcdd058a24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:10.873496 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f478b2-d199-41d4-bc48-adcdd058a24f admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:10.873780 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f478b2-d199-41d4-bc48-adcdd058a24f admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:10.874056 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f478b2-d199-41d4-bc48-adcdd058a24f admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:10.874776 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f478b2-d199-41d4-bc48-adcdd058a24f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:10.876427 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f478b2-d199-41d4-bc48-adcdd058a24f admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:10.887191 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1285/2565] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:32:10.891380 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fa1e0-6f98-4ba0-92e7-e528a1acd9ce admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:10.901907 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fa1e0-6f98-4ba0-92e7-e528a1acd9ce admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:10.906932 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ff454-45e7-44b7-aed4-90212194fb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:10.907798 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ff454-45e7-44b7-aed4-90212194fb45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:10.908091 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ff454-45e7-44b7-aed4-90212194fb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:10.908516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ff454-45e7-44b7-aed4-90212194fb45 admin admin] PATH_INFO: `/v3/projects/8c2384dd02464f77a37feb962b7356bb/users/61f8743a68174763b5fe68d27d1e04b8/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:10.910494 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ff454-45e7-44b7-aed4-90212194fb45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c2384dd02464f77a37feb962b7356bb, user_id=61f8743a68174763b5fe68d27d1e04b8, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:10.913194 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ff454-45e7-44b7-aed4-90212194fb45 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:10.924509 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1281/2566] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:32:10 2022] PUT /identity/v3/projects/8c2384dd02464f77a37feb962b7356bb/users/61f8743a68174763b5fe68d27d1e04b8/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:32:10.937184 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388625e-7a20-4cbd-97e3-47936d203606 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:10.937567 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388625e-7a20-4cbd-97e3-47936d203606 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:10.937850 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388625e-7a20-4cbd-97e3-47936d203606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:10.965074 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-5388625e-7a20-4cbd-97e3-47936d203606 None None] MFA Rules not processed for user `61f8743a68174763b5fe68d27d1e04b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:32:10.966271 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-5388625e-7a20-4cbd-97e3-47936d203606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:11.036351 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1286/2567] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:32:10 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:32:11.047617 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ff454-45e7-44b7-aed4-90212194fb45 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:11.049371 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-6b1ff454-45e7-44b7-aed4-90212194fb45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:11.106047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ff454-45e7-44b7-aed4-90212194fb45 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:11.109663 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f90c4-d71c-4ad4-8ab5-6bf8ca84bb3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:11.110294 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f90c4-d71c-4ad4-8ab5-6bf8ca84bb3e service cinder] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:11.110578 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f90c4-d71c-4ad4-8ab5-6bf8ca84bb3e service cinder] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:11.110852 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f90c4-d71c-4ad4-8ab5-6bf8ca84bb3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:11.153713 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:11.166611 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f90c4-d71c-4ad4-8ab5-6bf8ca84bb3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:11.167804 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f90c4-d71c-4ad4-8ab5-6bf8ca84bb3e service cinder] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:11.177036 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1282/2568] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:32:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:32:14.267523 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388625e-7a20-4cbd-97e3-47936d203606 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:14.269114 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-5388625e-7a20-4cbd-97e3-47936d203606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:14.303846 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:14.324806 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388625e-7a20-4cbd-97e3-47936d203606 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:14.329086 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c21403-d5eb-436d-b65e-caf82327b2ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:14.331129 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c21403-d5eb-436d-b65e-caf82327b2ed service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:14.331416 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c21403-d5eb-436d-b65e-caf82327b2ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:14.331688 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c21403-d5eb-436d-b65e-caf82327b2ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:14.333503 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-d0c21403-d5eb-436d-b65e-caf82327b2ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:14.404545 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c21403-d5eb-436d-b65e-caf82327b2ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:14.405991 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c21403-d5eb-436d-b65e-caf82327b2ed service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:14.417410 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1287/2569] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:32:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:32:15.597483 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f90c4-d71c-4ad4-8ab5-6bf8ca84bb3e service cinder] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:15.598926 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-cb2f90c4-d71c-4ad4-8ab5-6bf8ca84bb3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:15.610965 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f90c4-d71c-4ad4-8ab5-6bf8ca84bb3e service cinder] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:15.614538 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef3eb1-bad3-47ed-b4e8-5720677d68a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:15.615166 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef3eb1-bad3-47ed-b4e8-5720677d68a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:15.615449 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef3eb1-bad3-47ed-b4e8-5720677d68a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:15.615728 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef3eb1-bad3-47ed-b4e8-5720677d68a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:15.617513 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-10ef3eb1-bad3-47ed-b4e8-5720677d68a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:15.631533 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ef3eb1-bad3-47ed-b4e8-5720677d68a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:15.632972 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ef3eb1-bad3-47ed-b4e8-5720677d68a1 service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:15.645288 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1283/2570] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:32:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:32:19.629667 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c21403-d5eb-436d-b65e-caf82327b2ed service neutron] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:19.640929 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c21403-d5eb-436d-b65e-caf82327b2ed service neutron] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:19.644960 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc76c8-7570-472d-b995-a83ffe0e8846 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:19.645618 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc76c8-7570-472d-b995-a83ffe0e8846 service cinder] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:19.645905 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc76c8-7570-472d-b995-a83ffe0e8846 service cinder] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:19.646281 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc76c8-7570-472d-b995-a83ffe0e8846 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:19.659027 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc76c8-7570-472d-b995-a83ffe0e8846 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:19.659027 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc76c8-7570-472d-b995-a83ffe0e8846 service cinder] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:19.669704 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1288/2571] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:32:19 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:32:23.100892 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef3eb1-bad3-47ed-b4e8-5720677d68a1 service neutron] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:23.110003 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef3eb1-bad3-47ed-b4e8-5720677d68a1 service neutron] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:23.113611 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148c06b-4a93-4c1a-a5c1-d49bb3b52862 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:23.114238 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148c06b-4a93-4c1a-a5c1-d49bb3b52862 service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:23.114519 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148c06b-4a93-4c1a-a5c1-d49bb3b52862 service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:23.114791 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148c06b-4a93-4c1a-a5c1-d49bb3b52862 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:23.116585 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-1148c06b-4a93-4c1a-a5c1-d49bb3b52862 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:23.181828 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1148c06b-4a93-4c1a-a5c1-d49bb3b52862 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:23.183461 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1148c06b-4a93-4c1a-a5c1-d49bb3b52862 service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:23.193123 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1284/2572] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:32:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:32:25.773644 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc76c8-7570-472d-b995-a83ffe0e8846 service cinder] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:25.783905 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc76c8-7570-472d-b995-a83ffe0e8846 service cinder] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:25.787905 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8aedcc-4eff-41e4-b92b-b1cb69c979ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:25.788584 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8aedcc-4eff-41e4-b92b-b1cb69c979ce service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:25.788866 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8aedcc-4eff-41e4-b92b-b1cb69c979ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:25.789190 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8aedcc-4eff-41e4-b92b-b1cb69c979ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:25.791029 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-7a8aedcc-4eff-41e4-b92b-b1cb69c979ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:25.801566 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8aedcc-4eff-41e4-b92b-b1cb69c979ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:25.803014 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8aedcc-4eff-41e4-b92b-b1cb69c979ce service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:25.813333 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1289/2573] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:32:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:32:26.700093 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148c06b-4a93-4c1a-a5c1-d49bb3b52862 service neutron] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:26.702091 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-1148c06b-4a93-4c1a-a5c1-d49bb3b52862 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:26.709493 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8aedcc-4eff-41e4-b92b-b1cb69c979ce service neutron] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:26.721874 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8aedcc-4eff-41e4-b92b-b1cb69c979ce service neutron] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:26.733506 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e91baba-2672-417b-81b0-2bc0277c2e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:26.733506 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91baba-2672-417b-81b0-2bc0277c2e98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:26.733506 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91baba-2672-417b-81b0-2bc0277c2e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:26.733506 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91baba-2672-417b-81b0-2bc0277c2e98 admin admin] PATH_INFO: `/v3/users/b62e35f760a647bb9d16441af04d2580` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:26.733999 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e91baba-2672-417b-81b0-2bc0277c2e98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b62e35f760a647bb9d16441af04d2580)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:26.735768 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e91baba-2672-417b-81b0-2bc0277c2e98 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:26.792919 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148c06b-4a93-4c1a-a5c1-d49bb3b52862 service neutron] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:26.797974 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b8073-4af1-4ed7-a081-02b4f6089f32 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5c4ad16c9454b74ae8445b115cf0af4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:26.798619 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b8073-4af1-4ed7-a081-02b4f6089f32 service placement] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:26.798908 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b8073-4af1-4ed7-a081-02b4f6089f32 service placement] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:26.799239 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b8073-4af1-4ed7-a081-02b4f6089f32 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:26.801074 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-ab1b8073-4af1-4ed7-a081-02b4f6089f32 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:26.813826 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b8073-4af1-4ed7-a081-02b4f6089f32 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:26.815451 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b8073-4af1-4ed7-a081-02b4f6089f32 service placement] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:26.825867 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1285/2574] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:32:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:32:26.826666 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b8073-4af1-4ed7-a081-02b4f6089f32 service placement] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:26.827942 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-ab1b8073-4af1-4ed7-a081-02b4f6089f32 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:26.843703 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b8073-4af1-4ed7-a081-02b4f6089f32 service placement] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:26.848538 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ad20d-2416-4d21-841b-8b354897fd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:26.849395 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ad20d-2416-4d21-841b-8b354897fd08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:26.849680 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ad20d-2416-4d21-841b-8b354897fd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:26.849958 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ad20d-2416-4d21-841b-8b354897fd08 admin admin] PATH_INFO: `/v3/users/965645bc86f44cf38c5f571406722e32` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:26.865702 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ad20d-2416-4d21-841b-8b354897fd08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=965645bc86f44cf38c5f571406722e32)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:26.867656 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ad20d-2416-4d21-841b-8b354897fd08 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:26.924875 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-4e91baba-2672-417b-81b0-2bc0277c2e98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b62e35f760a647bb9d16441af04d2580'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:26.937617 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-4e91baba-2672-417b-81b0-2bc0277c2e98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b62e35f760a647bb9d16441af04d2580'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:26.942727 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-4e91baba-2672-417b-81b0-2bc0277c2e98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b62e35f760a647bb9d16441af04d2580'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:26.945455 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-4e91baba-2672-417b-81b0-2bc0277c2e98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b62e35f760a647bb9d16441af04d2580'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:26.946095 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-4e91baba-2672-417b-81b0-2bc0277c2e98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b62e35f760a647bb9d16441af04d2580'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:27.031211 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1290/2575] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:32:26 2022] DELETE /identity/v3/users/b62e35f760a647bb9d16441af04d2580 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:32:27.035605 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8034152-2310-4bca-a506-8ed9249be0d4 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:27.035916 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8034152-2310-4bca-a506-8ed9249be0d4 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:27.036213 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8034152-2310-4bca-a506-8ed9249be0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:27.054920 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-b8034152-2310-4bca-a506-8ed9249be0d4 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:32:27.056238 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-b8034152-2310-4bca-a506-8ed9249be0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:27.068304 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:27.090338 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:27.096118 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-646ad20d-2416-4d21-841b-8b354897fd08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '965645bc86f44cf38c5f571406722e32'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:27.110940 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-646ad20d-2416-4d21-841b-8b354897fd08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '965645bc86f44cf38c5f571406722e32'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:27.112088 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-646ad20d-2416-4d21-841b-8b354897fd08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '965645bc86f44cf38c5f571406722e32'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:27.117813 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1291/2576] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:32:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:32:27.119271 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-646ad20d-2416-4d21-841b-8b354897fd08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '965645bc86f44cf38c5f571406722e32'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:27.119972 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-646ad20d-2416-4d21-841b-8b354897fd08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '965645bc86f44cf38c5f571406722e32'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:27.127504 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8034152-2310-4bca-a506-8ed9249be0d4 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:27.136290 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-b8034152-2310-4bca-a506-8ed9249be0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:27.184628 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8034152-2310-4bca-a506-8ed9249be0d4 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:27.188581 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed560209-7297-4996-99fa-4e4cbf0bb9f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:27.189225 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed560209-7297-4996-99fa-4e4cbf0bb9f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:27.189507 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed560209-7297-4996-99fa-4e4cbf0bb9f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:27.189782 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed560209-7297-4996-99fa-4e4cbf0bb9f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:27.191546 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-ed560209-7297-4996-99fa-4e4cbf0bb9f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:27.204227 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed560209-7297-4996-99fa-4e4cbf0bb9f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:27.205799 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed560209-7297-4996-99fa-4e4cbf0bb9f3 service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:27.217565 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1292/2577] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:32:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 13:32:27.221196 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1286/2578] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:32:26 2022] DELETE /identity/v3/users/965645bc86f44cf38c5f571406722e32 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:32:27.522316 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed560209-7297-4996-99fa-4e4cbf0bb9f3 service neutron] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:27.524645 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-ed560209-7297-4996-99fa-4e4cbf0bb9f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:27.543016 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed560209-7297-4996-99fa-4e4cbf0bb9f3 service neutron] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:27.625097 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e9202-9fc7-4ce5-95b3-a724cc1d0202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:27.625955 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e9202-9fc7-4ce5-95b3-a724cc1d0202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:27.626233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e9202-9fc7-4ce5-95b3-a724cc1d0202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:27.626502 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e9202-9fc7-4ce5-95b3-a724cc1d0202 admin admin] PATH_INFO: `/v3/projects/ab17731336f54a7eb5dfd954ddc8e688` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:27.637859 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e9202-9fc7-4ce5-95b3-a724cc1d0202 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab17731336f54a7eb5dfd954ddc8e688)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:27.639806 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e9202-9fc7-4ce5-95b3-a724cc1d0202 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:27.735236 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ad20d-2416-4d21-841b-8b354897fd08 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:27.736867 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-646ad20d-2416-4d21-841b-8b354897fd08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:27.758502 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ad20d-2416-4d21-841b-8b354897fd08 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:27.783195 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-fe6e9202-9fc7-4ce5-95b3-a724cc1d0202 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab17731336f54a7eb5dfd954ddc8e688', 'request_id': 'req-fe6e9202-9fc7-4ce5-95b3-a724cc1d0202'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:27.794414 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-fe6e9202-9fc7-4ce5-95b3-a724cc1d0202 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab17731336f54a7eb5dfd954ddc8e688', 'request_id': 'req-fe6e9202-9fc7-4ce5-95b3-a724cc1d0202'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:27.796903 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:27.806976 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-fe6e9202-9fc7-4ce5-95b3-a724cc1d0202 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab17731336f54a7eb5dfd954ddc8e688', 'request_id': 'req-fe6e9202-9fc7-4ce5-95b3-a724cc1d0202'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:27.865108 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce501d-fa45-43d9-a0c7-e37f44cc1044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:27.866003 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce501d-fa45-43d9-a0c7-e37f44cc1044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:27.866289 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce501d-fa45-43d9-a0c7-e37f44cc1044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:27.866566 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce501d-fa45-43d9-a0c7-e37f44cc1044 admin admin] PATH_INFO: `/v3/projects/7861fae5100d47eab00bb9331a3030a2` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:27.867745 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ce501d-fa45-43d9-a0c7-e37f44cc1044 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7861fae5100d47eab00bb9331a3030a2)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:27.870093 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ce501d-fa45-43d9-a0c7-e37f44cc1044 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:27.918965 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-fe6e9202-9fc7-4ce5-95b3-a724cc1d0202 admin admin] The token cache is being invalidate because project ab17731336f54a7eb5dfd954ddc8e688 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:32:27.919256 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-fe6e9202-9fc7-4ce5-95b3-a724cc1d0202 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:27.919871 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-fe6e9202-9fc7-4ce5-95b3-a724cc1d0202 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:27.921485 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1293/2579] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:32:27 2022] DELETE /identity/v3/projects/ab17731336f54a7eb5dfd954ddc8e688 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:32:27.926047 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f7153-ee15-48a2-bff1-086cc6176468 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:27.926602 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f7153-ee15-48a2-bff1-086cc6176468 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:27.926602 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f7153-ee15-48a2-bff1-086cc6176468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:27.944180 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-238f7153-ee15-48a2-bff1-086cc6176468 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:32:27.945368 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-238f7153-ee15-48a2-bff1-086cc6176468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:27.953825 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1294/2580] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:32:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:32:27.961344 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e0d47-32df-405c-b22b-2e1934ba87f4 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:27.961631 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e0d47-32df-405c-b22b-2e1934ba87f4 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:27.962980 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e0d47-32df-405c-b22b-2e1934ba87f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:27.979665 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-6f1e0d47-32df-405c-b22b-2e1934ba87f4 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:32:27.980824 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-6f1e0d47-32df-405c-b22b-2e1934ba87f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:27.990951 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1295/2581] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:32:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:32:27.992807 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e0d47-32df-405c-b22b-2e1934ba87f4 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:28.001749 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e0d47-32df-405c-b22b-2e1934ba87f4 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:28.014351 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-f9ce501d-fa45-43d9-a0c7-e37f44cc1044 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7861fae5100d47eab00bb9331a3030a2', 'request_id': 'req-f9ce501d-fa45-43d9-a0c7-e37f44cc1044'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:28.057794 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904ce15-b245-4e45-97a6-31effd65adc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:28.058463 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904ce15-b245-4e45-97a6-31effd65adc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:28.058748 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904ce15-b245-4e45-97a6-31effd65adc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:28.059023 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904ce15-b245-4e45-97a6-31effd65adc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:28.059745 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e904ce15-b245-4e45-97a6-31effd65adc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:32:28.060051 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e904ce15-b245-4e45-97a6-31effd65adc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:28.062954 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e904ce15-b245-4e45-97a6-31effd65adc5 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:28.075880 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1296/2582] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:32:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:32:28.080305 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904ce15-b245-4e45-97a6-31effd65adc5 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:28.089753 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904ce15-b245-4e45-97a6-31effd65adc5 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:28.094446 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913313d4-a963-450e-8ca5-6ef64bc1d7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:28.095068 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913313d4-a963-450e-8ca5-6ef64bc1d7a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:28.095352 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913313d4-a963-450e-8ca5-6ef64bc1d7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:28.095629 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913313d4-a963-450e-8ca5-6ef64bc1d7a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:28.096347 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913313d4-a963-450e-8ca5-6ef64bc1d7a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:28.098362 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913313d4-a963-450e-8ca5-6ef64bc1d7a1 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:28.098569 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-f9ce501d-fa45-43d9-a0c7-e37f44cc1044 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7861fae5100d47eab00bb9331a3030a2', 'request_id': 'req-f9ce501d-fa45-43d9-a0c7-e37f44cc1044'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:28.105422 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-f9ce501d-fa45-43d9-a0c7-e37f44cc1044 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7861fae5100d47eab00bb9331a3030a2', 'request_id': 'req-f9ce501d-fa45-43d9-a0c7-e37f44cc1044'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:28.116951 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-f9ce501d-fa45-43d9-a0c7-e37f44cc1044 admin admin] The token cache is being invalidate because project 7861fae5100d47eab00bb9331a3030a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:32:28.117238 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-f9ce501d-fa45-43d9-a0c7-e37f44cc1044 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:28.117995 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-f9ce501d-fa45-43d9-a0c7-e37f44cc1044 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:28.120172 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1287/2583] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:32:27 2022] DELETE /identity/v3/projects/7861fae5100d47eab00bb9331a3030a2 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:32:28.124355 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce501d-fa45-43d9-a0c7-e37f44cc1044 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:28.126994 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-f9ce501d-fa45-43d9-a0c7-e37f44cc1044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:28.138409 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce501d-fa45-43d9-a0c7-e37f44cc1044 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:28.142950 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bcf451-1c3e-4175-9472-da2086cf364b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:28.143790 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bcf451-1c3e-4175-9472-da2086cf364b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:28.144075 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bcf451-1c3e-4175-9472-da2086cf364b admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:28.144383 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bcf451-1c3e-4175-9472-da2086cf364b admin admin] PATH_INFO: `/v3/users/61f8743a68174763b5fe68d27d1e04b8` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:28.145586 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bcf451-1c3e-4175-9472-da2086cf364b admin admin] RBAC: Authorizing `identity:delete_user(user_id=61f8743a68174763b5fe68d27d1e04b8)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:28.147483 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bcf451-1c3e-4175-9472-da2086cf364b admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:28.207066 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1297/2584] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:32:28 2022] POST /identity/v3/projects => generated 387 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:32:28.211155 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913313d4-a963-450e-8ca5-6ef64bc1d7a1 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:28.212868 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-913313d4-a963-450e-8ca5-6ef64bc1d7a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:28.276125 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913313d4-a963-450e-8ca5-6ef64bc1d7a1 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:28.280927 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e97f59-d6b0-463e-abe4-ebaa8be0e851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:28.281597 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e97f59-d6b0-463e-abe4-ebaa8be0e851 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:28.281879 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e97f59-d6b0-463e-abe4-ebaa8be0e851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:28.282156 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e97f59-d6b0-463e-abe4-ebaa8be0e851 admin admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:28.282881 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e97f59-d6b0-463e-abe4-ebaa8be0e851 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:28.284864 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e97f59-d6b0-463e-abe4-ebaa8be0e851 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:28.321728 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:28.326743 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-45bcf451-1c3e-4175-9472-da2086cf364b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61f8743a68174763b5fe68d27d1e04b8'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:28.338830 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-45bcf451-1c3e-4175-9472-da2086cf364b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61f8743a68174763b5fe68d27d1e04b8'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:28.339508 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-45bcf451-1c3e-4175-9472-da2086cf364b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61f8743a68174763b5fe68d27d1e04b8'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:28.346650 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-45bcf451-1c3e-4175-9472-da2086cf364b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61f8743a68174763b5fe68d27d1e04b8'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:28.350840 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-45bcf451-1c3e-4175-9472-da2086cf364b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61f8743a68174763b5fe68d27d1e04b8'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:28.405706 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1298/2585] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:32:28 2022] POST /identity/v3/users => generated 294 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:32:28.409760 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e97f59-d6b0-463e-abe4-ebaa8be0e851 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:28.411467 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-37e97f59-d6b0-463e-abe4-ebaa8be0e851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:28.424401 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e97f59-d6b0-463e-abe4-ebaa8be0e851 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:28.429248 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1506bd4-f940-4a52-8506-d395006a7453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:28.429887 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1506bd4-f940-4a52-8506-d395006a7453 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:28.430178 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1506bd4-f940-4a52-8506-d395006a7453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:28.430455 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1506bd4-f940-4a52-8506-d395006a7453 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:28.431323 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1506bd4-f940-4a52-8506-d395006a7453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:28.433248 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1506bd4-f940-4a52-8506-d395006a7453 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:28.433461 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1288/2586] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:32:28 2022] DELETE /identity/v3/users/61f8743a68174763b5fe68d27d1e04b8 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:32:28.447203 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1299/2587] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:32:28.451569 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bcf451-1c3e-4175-9472-da2086cf364b admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:28.522319 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bcf451-1c3e-4175-9472-da2086cf364b admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:28.528104 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceafac2f-dbb2-47db-87d2-960c49805b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:28.528747 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceafac2f-dbb2-47db-87d2-960c49805b48 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:28.529030 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceafac2f-dbb2-47db-87d2-960c49805b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:28.529306 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceafac2f-dbb2-47db-87d2-960c49805b48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:28.530032 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceafac2f-dbb2-47db-87d2-960c49805b48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:28.531626 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceafac2f-dbb2-47db-87d2-960c49805b48 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:28.542041 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1289/2588] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:32:28.546190 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1506bd4-f940-4a52-8506-d395006a7453 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:28.556739 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1506bd4-f940-4a52-8506-d395006a7453 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:28.561366 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d01fa-cb9b-48c5-b802-891d56209a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:28.562240 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d01fa-cb9b-48c5-b802-891d56209a48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:28.562522 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d01fa-cb9b-48c5-b802-891d56209a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:28.562797 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d01fa-cb9b-48c5-b802-891d56209a48 admin admin] PATH_INFO: `/v3/projects/8e1a25bae1ef4313af4e0fe2503a000c/users/e56e2fb73e1b40b2a35fea84308951eb/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:28.578229 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d01fa-cb9b-48c5-b802-891d56209a48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e1a25bae1ef4313af4e0fe2503a000c, user_id=e56e2fb73e1b40b2a35fea84308951eb, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:28.580988 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d01fa-cb9b-48c5-b802-891d56209a48 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:28.700160 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=92,keystone:DELETE=2,keystone:INSERT=6 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:28.717977 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1300/2589] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:32:28 2022] PUT /identity/v3/projects/8e1a25bae1ef4313af4e0fe2503a000c/users/e56e2fb73e1b40b2a35fea84308951eb/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:32:28.729889 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3163c-3a0c-441d-925b-03a8dffb8f39 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:28.730180 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3163c-3a0c-441d-925b-03a8dffb8f39 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:28.730481 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3163c-3a0c-441d-925b-03a8dffb8f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:28.758658 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-c3e3163c-3a0c-441d-925b-03a8dffb8f39 None None] MFA Rules not processed for user `e56e2fb73e1b40b2a35fea84308951eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:32:28.760399 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-c3e3163c-3a0c-441d-925b-03a8dffb8f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:28.826237 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1290/2590] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:32:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:32:28.830564 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d01fa-cb9b-48c5-b802-891d56209a48 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:28.895197 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d01fa-cb9b-48c5-b802-891d56209a48 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:28.900521 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9515d824-6e54-44fd-89d4-267fc0e9fe59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:28.901184 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515d824-6e54-44fd-89d4-267fc0e9fe59 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:28.901461 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515d824-6e54-44fd-89d4-267fc0e9fe59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:28.901738 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515d824-6e54-44fd-89d4-267fc0e9fe59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:28.902471 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9515d824-6e54-44fd-89d4-267fc0e9fe59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:28.904393 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9515d824-6e54-44fd-89d4-267fc0e9fe59 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:28.917947 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3163c-3a0c-441d-925b-03a8dffb8f39 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:28.919442 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-c3e3163c-3a0c-441d-925b-03a8dffb8f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:28.936310 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3163c-3a0c-441d-925b-03a8dffb8f39 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:28.941476 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750436e5-116b-4877-b895-3a856be585b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:28.943408 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750436e5-116b-4877-b895-3a856be585b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:28.943408 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750436e5-116b-4877-b895-3a856be585b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:28.943408 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750436e5-116b-4877-b895-3a856be585b6 admin admin] PATH_INFO: `/v3/projects/8c2384dd02464f77a37feb962b7356bb` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:28.944818 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750436e5-116b-4877-b895-3a856be585b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c2384dd02464f77a37feb962b7356bb)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:28.949489 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750436e5-116b-4877-b895-3a856be585b6 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:29.032708 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1301/2591] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:32:28 2022] POST /identity/v3/projects => generated 385 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:32:29.036609 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9515d824-6e54-44fd-89d4-267fc0e9fe59 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:29.082387 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:29.090085 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-750436e5-116b-4877-b895-3a856be585b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c2384dd02464f77a37feb962b7356bb', 'request_id': 'req-750436e5-116b-4877-b895-3a856be585b6'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:29.100166 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9515d824-6e54-44fd-89d4-267fc0e9fe59 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:29.144542 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-750436e5-116b-4877-b895-3a856be585b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c2384dd02464f77a37feb962b7356bb', 'request_id': 'req-750436e5-116b-4877-b895-3a856be585b6'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:29.151590 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-750436e5-116b-4877-b895-3a856be585b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c2384dd02464f77a37feb962b7356bb', 'request_id': 'req-750436e5-116b-4877-b895-3a856be585b6'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:29.158103 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190fec58-6169-48ed-bd71-85d041f9c2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:29.158778 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190fec58-6169-48ed-bd71-85d041f9c2be admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:29.159066 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190fec58-6169-48ed-bd71-85d041f9c2be admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:29.159343 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190fec58-6169-48ed-bd71-85d041f9c2be admin admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:29.160099 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190fec58-6169-48ed-bd71-85d041f9c2be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:29.162071 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190fec58-6169-48ed-bd71-85d041f9c2be admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:29.162539 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-750436e5-116b-4877-b895-3a856be585b6 admin admin] The token cache is being invalidate because project 8c2384dd02464f77a37feb962b7356bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:32:29.162825 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-750436e5-116b-4877-b895-3a856be585b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:29.163487 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-750436e5-116b-4877-b895-3a856be585b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:29.165061 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1291/2592] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:32:28 2022] DELETE /identity/v3/projects/8c2384dd02464f77a37feb962b7356bb => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:32:29.171733 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3bbb9-baa7-4983-8e0d-889a5cf97203 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:29.172021 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3bbb9-baa7-4983-8e0d-889a5cf97203 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:29.175878 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3bbb9-baa7-4983-8e0d-889a5cf97203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:29.191117 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-a2b3bbb9-baa7-4983-8e0d-889a5cf97203 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:32:29.192334 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-a2b3bbb9-baa7-4983-8e0d-889a5cf97203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:29.201463 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1292/2593] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:32:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:32:29.209421 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ad463-0064-4b8e-94a2-ade4024454a7 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:29.209707 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ad463-0064-4b8e-94a2-ade4024454a7 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:29.209980 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ad463-0064-4b8e-94a2-ade4024454a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:29.229283 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-c95ad463-0064-4b8e-94a2-ade4024454a7 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:32:29.230534 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-c95ad463-0064-4b8e-94a2-ade4024454a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:29.238595 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1293/2594] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:32:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:32:29.242609 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ad463-0064-4b8e-94a2-ade4024454a7 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:29.252323 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ad463-0064-4b8e-94a2-ade4024454a7 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:29.253869 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1302/2595] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:32:29 2022] POST /identity/v3/users => generated 299 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:32:29.257610 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190fec58-6169-48ed-bd71-85d041f9c2be admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:29.259498 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-190fec58-6169-48ed-bd71-85d041f9c2be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:29.260938 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759dc3f1-5cf1-4a76-a66e-3006a582344f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:29.261694 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759dc3f1-5cf1-4a76-a66e-3006a582344f admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:29.262046 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759dc3f1-5cf1-4a76-a66e-3006a582344f admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:29.262390 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759dc3f1-5cf1-4a76-a66e-3006a582344f admin admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:29.263244 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759dc3f1-5cf1-4a76-a66e-3006a582344f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:32:29.263622 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759dc3f1-5cf1-4a76-a66e-3006a582344f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:29.265469 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759dc3f1-5cf1-4a76-a66e-3006a582344f admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:29.272532 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190fec58-6169-48ed-bd71-85d041f9c2be admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:29.279945 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1294/2596] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:32:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:32:29.282449 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765dc99-d60f-4fa6-829f-494ee7500ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:29.282449 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765dc99-d60f-4fa6-829f-494ee7500ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:29.282449 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765dc99-d60f-4fa6-829f-494ee7500ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:29.282449 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765dc99-d60f-4fa6-829f-494ee7500ee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:29.283015 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7765dc99-d60f-4fa6-829f-494ee7500ee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:29.283233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7765dc99-d60f-4fa6-829f-494ee7500ee7 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:29.285637 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759dc3f1-5cf1-4a76-a66e-3006a582344f admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:29.298289 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1303/2597] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:32:29.298517 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759dc3f1-5cf1-4a76-a66e-3006a582344f admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:29.299364 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765dc99-d60f-4fa6-829f-494ee7500ee7 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:29.302024 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340cf90-3dea-4be0-b022-b7d89da3d542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:29.302767 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340cf90-3dea-4be0-b022-b7d89da3d542 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:29.303119 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340cf90-3dea-4be0-b022-b7d89da3d542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:29.303463 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340cf90-3dea-4be0-b022-b7d89da3d542 admin admin] PATH_INFO: `/v3/projects` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:29.304260 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1340cf90-3dea-4be0-b022-b7d89da3d542 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:29.306428 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1340cf90-3dea-4be0-b022-b7d89da3d542 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:29.311421 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765dc99-d60f-4fa6-829f-494ee7500ee7 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:29.317061 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50576e-69be-4769-a6cb-2f8fcbe8169c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:29.318008 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50576e-69be-4769-a6cb-2f8fcbe8169c admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:29.318289 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50576e-69be-4769-a6cb-2f8fcbe8169c admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:29.318581 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50576e-69be-4769-a6cb-2f8fcbe8169c admin admin] PATH_INFO: `/v3/projects/c11c2170babc44c9a3cdac600b44e17a/users/c5a24d8ca73e471c8572a474aa93cdaf/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:29.322623 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:29.339918 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d50576e-69be-4769-a6cb-2f8fcbe8169c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c11c2170babc44c9a3cdac600b44e17a, user_id=c5a24d8ca73e471c8572a474aa93cdaf, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:29.339918 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d50576e-69be-4769-a6cb-2f8fcbe8169c admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:29.416411 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1295/2598] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:32:29 2022] POST /identity/v3/projects => generated 381 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:32:29.420568 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340cf90-3dea-4be0-b022-b7d89da3d542 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:29.450522 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1304/2599] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:32:29 2022] PUT /identity/v3/projects/c11c2170babc44c9a3cdac600b44e17a/users/c5a24d8ca73e471c8572a474aa93cdaf/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:32:29.453928 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50576e-69be-4769-a6cb-2f8fcbe8169c admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:29.490645 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340cf90-3dea-4be0-b022-b7d89da3d542 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:29.526113 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50576e-69be-4769-a6cb-2f8fcbe8169c admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:29.530999 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c228415-edcf-4982-b414-41f117de2416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:29.531660 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c228415-edcf-4982-b414-41f117de2416 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:29.535016 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c228415-edcf-4982-b414-41f117de2416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:29.535016 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c228415-edcf-4982-b414-41f117de2416 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:29.535016 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c228415-edcf-4982-b414-41f117de2416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:29.535016 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c228415-edcf-4982-b414-41f117de2416 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:29.549784 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1305/2600] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:32:29.551166 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c228415-edcf-4982-b414-41f117de2416 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:29.561594 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07268611-6883-499a-994f-01eec2c1b46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:29.562276 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07268611-6883-499a-994f-01eec2c1b46f admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:29.562585 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07268611-6883-499a-994f-01eec2c1b46f admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:29.562864 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07268611-6883-499a-994f-01eec2c1b46f admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:29.563556 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07268611-6883-499a-994f-01eec2c1b46f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:29.564510 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c228415-edcf-4982-b414-41f117de2416 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:29.565569 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07268611-6883-499a-994f-01eec2c1b46f admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:29.569255 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b2a76-a6cc-4532-9ab4-ffb6197d54ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:29.570269 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b2a76-a6cc-4532-9ab4-ffb6197d54ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:29.570547 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b2a76-a6cc-4532-9ab4-ffb6197d54ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:29.570825 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b2a76-a6cc-4532-9ab4-ffb6197d54ad admin admin] PATH_INFO: `/v3/projects/c11c2170babc44c9a3cdac600b44e17a/users/c5a24d8ca73e471c8572a474aa93cdaf/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:29.578516 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b2a76-a6cc-4532-9ab4-ffb6197d54ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=c11c2170babc44c9a3cdac600b44e17a, user_id=c5a24d8ca73e471c8572a474aa93cdaf, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:29.582026 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b2a76-a6cc-4532-9ab4-ffb6197d54ad admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:29.594245 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1306/2601] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:32:29 2022] PUT /identity/v3/projects/c11c2170babc44c9a3cdac600b44e17a/users/c5a24d8ca73e471c8572a474aa93cdaf/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:32:29.605731 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5287736-e6e9-4419-af65-6754dff39ab0 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:29.606106 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5287736-e6e9-4419-af65-6754dff39ab0 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:29.606442 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5287736-e6e9-4419-af65-6754dff39ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:29.636527 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-e5287736-e6e9-4419-af65-6754dff39ab0 None None] MFA Rules not processed for user `c5a24d8ca73e471c8572a474aa93cdaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:32:29.637786 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-e5287736-e6e9-4419-af65-6754dff39ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:29.663201 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1296/2602] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:32:29 2022] POST /identity/v3/users => generated 291 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:32:29.664315 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07268611-6883-499a-994f-01eec2c1b46f admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:29.676423 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07268611-6883-499a-994f-01eec2c1b46f admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:29.691031 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:29.722965 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1307/2603] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:32:29 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:32:29.736990 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5287736-e6e9-4419-af65-6754dff39ab0 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:29.738715 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-e5287736-e6e9-4419-af65-6754dff39ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:29.752359 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb6585-ddf1-4d75-846a-485b1a0fe9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:29.753697 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb6585-ddf1-4d75-846a-485b1a0fe9fe admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:29.753697 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb6585-ddf1-4d75-846a-485b1a0fe9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:29.753950 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb6585-ddf1-4d75-846a-485b1a0fe9fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:29.754624 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbb6585-ddf1-4d75-846a-485b1a0fe9fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:29.756402 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbb6585-ddf1-4d75-846a-485b1a0fe9fe admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:29.768492 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1297/2604] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:32:29.773055 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb6585-ddf1-4d75-846a-485b1a0fe9fe admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:29.784323 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb6585-ddf1-4d75-846a-485b1a0fe9fe admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:29.790089 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe86b6-766f-4cd5-b293-6cbb47e628da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:29.790978 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe86b6-766f-4cd5-b293-6cbb47e628da admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:29.791343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe86b6-766f-4cd5-b293-6cbb47e628da admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:29.791723 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe86b6-766f-4cd5-b293-6cbb47e628da admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:29.792627 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe86b6-766f-4cd5-b293-6cbb47e628da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:29.794323 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe86b6-766f-4cd5-b293-6cbb47e628da admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:29.805065 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1298/2605] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:32:29.809637 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe86b6-766f-4cd5-b293-6cbb47e628da admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:29.813895 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5287736-e6e9-4419-af65-6754dff39ab0 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:29.818379 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae16e27-612e-4d4a-81bc-0817ba7846db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:29.819094 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae16e27-612e-4d4a-81bc-0817ba7846db service cinder] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:29.819437 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae16e27-612e-4d4a-81bc-0817ba7846db service cinder] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:29.819723 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae16e27-612e-4d4a-81bc-0817ba7846db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:29.821209 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe86b6-766f-4cd5-b293-6cbb47e628da admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:29.827537 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15063794-e578-47e6-a12f-d7343fa57d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:29.828831 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15063794-e578-47e6-a12f-d7343fa57d8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:29.828831 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15063794-e578-47e6-a12f-d7343fa57d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:29.829133 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15063794-e578-47e6-a12f-d7343fa57d8d admin admin] PATH_INFO: `/v3/projects/103565c121b94db4979a8b3b4c0820e4/users/835b0a316e5244a68ee218646a3bcb84/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:29.829522 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:29.832254 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae16e27-612e-4d4a-81bc-0817ba7846db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:29.833952 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae16e27-612e-4d4a-81bc-0817ba7846db service cinder] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:29.845344 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15063794-e578-47e6-a12f-d7343fa57d8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=103565c121b94db4979a8b3b4c0820e4, user_id=835b0a316e5244a68ee218646a3bcb84, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:29.845556 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1308/2606] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:32:29 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:32:29.848124 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15063794-e578-47e6-a12f-d7343fa57d8d admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:29.914202 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae16e27-612e-4d4a-81bc-0817ba7846db service cinder] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:29.924190 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1299/2607] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:32:29 2022] PUT /identity/v3/projects/103565c121b94db4979a8b3b4c0820e4/users/835b0a316e5244a68ee218646a3bcb84/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:32:29.927332 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae16e27-612e-4d4a-81bc-0817ba7846db service cinder] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:29.937166 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf40ac6-71a4-4311-8665-ce249d5e506a None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:29.937486 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf40ac6-71a4-4311-8665-ce249d5e506a None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:29.937732 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf40ac6-71a4-4311-8665-ce249d5e506a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:29.965557 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-6cf40ac6-71a4-4311-8665-ce249d5e506a None None] MFA Rules not processed for user `835b0a316e5244a68ee218646a3bcb84`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:32:29.967122 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-6cf40ac6-71a4-4311-8665-ce249d5e506a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:30.016897 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd7f8e-88bc-4a95-bd16-b1bb59b8a269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:30.017891 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd7f8e-88bc-4a95-bd16-b1bb59b8a269 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:30.018591 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd7f8e-88bc-4a95-bd16-b1bb59b8a269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:30.019241 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd7f8e-88bc-4a95-bd16-b1bb59b8a269 admin admin] PATH_INFO: `/v3/users/e56e2fb73e1b40b2a35fea84308951eb` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:30.021112 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd7f8e-88bc-4a95-bd16-b1bb59b8a269 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e56e2fb73e1b40b2a35fea84308951eb)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:30.023045 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd7f8e-88bc-4a95-bd16-b1bb59b8a269 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:30.058457 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1300/2608] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:32:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:32:30.072327 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf40ac6-71a4-4311-8665-ce249d5e506a None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:30.139526 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf40ac6-71a4-4311-8665-ce249d5e506a None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:30.153576 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d85d10-a61d-4567-89b0-b8c74ea1f310 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:30.153576 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d85d10-a61d-4567-89b0-b8c74ea1f310 service cinder] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:30.153576 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d85d10-a61d-4567-89b0-b8c74ea1f310 service cinder] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:30.153576 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d85d10-a61d-4567-89b0-b8c74ea1f310 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:30.157127 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d85d10-a61d-4567-89b0-b8c74ea1f310 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:30.158648 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d85d10-a61d-4567-89b0-b8c74ea1f310 service cinder] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:30.168862 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1301/2609] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:32:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:32:30.193941 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d85d10-a61d-4567-89b0-b8c74ea1f310 service cinder] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:30.206103 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d85d10-a61d-4567-89b0-b8c74ea1f310 service cinder] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:30.211289 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e29c6c2-ffe7-44b8-acb1-11420508bece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:30.212488 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29c6c2-ffe7-44b8-acb1-11420508bece admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:30.213028 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29c6c2-ffe7-44b8-acb1-11420508bece admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:30.213549 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29c6c2-ffe7-44b8-acb1-11420508bece admin admin] PATH_INFO: `/v3/users/835b0a316e5244a68ee218646a3bcb84` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:30.215132 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e29c6c2-ffe7-44b8-acb1-11420508bece admin admin] RBAC: Authorizing `identity:delete_user(user_id=835b0a316e5244a68ee218646a3bcb84)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:30.217041 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e29c6c2-ffe7-44b8-acb1-11420508bece admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:30.219817 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:30.296598 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-5ccd7f8e-88bc-4a95-bd16-b1bb59b8a269 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e56e2fb73e1b40b2a35fea84308951eb'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:30.311241 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-5ccd7f8e-88bc-4a95-bd16-b1bb59b8a269 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e56e2fb73e1b40b2a35fea84308951eb'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:30.312084 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-5ccd7f8e-88bc-4a95-bd16-b1bb59b8a269 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e56e2fb73e1b40b2a35fea84308951eb'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:30.321555 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-5ccd7f8e-88bc-4a95-bd16-b1bb59b8a269 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e56e2fb73e1b40b2a35fea84308951eb'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:30.322274 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-5ccd7f8e-88bc-4a95-bd16-b1bb59b8a269 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e56e2fb73e1b40b2a35fea84308951eb'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:30.473672 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1309/2610] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:32:29 2022] DELETE /identity/v3/users/e56e2fb73e1b40b2a35fea84308951eb => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:32:30.474832 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd7f8e-88bc-4a95-bd16-b1bb59b8a269 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:30.476584 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-5ccd7f8e-88bc-4a95-bd16-b1bb59b8a269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:30.482225 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-6e29c6c2-ffe7-44b8-acb1-11420508bece admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '835b0a316e5244a68ee218646a3bcb84'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:30.496844 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-6e29c6c2-ffe7-44b8-acb1-11420508bece admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '835b0a316e5244a68ee218646a3bcb84'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:30.497879 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-6e29c6c2-ffe7-44b8-acb1-11420508bece admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '835b0a316e5244a68ee218646a3bcb84'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:30.504824 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-6e29c6c2-ffe7-44b8-acb1-11420508bece admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '835b0a316e5244a68ee218646a3bcb84'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:30.505456 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-6e29c6c2-ffe7-44b8-acb1-11420508bece admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '835b0a316e5244a68ee218646a3bcb84'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:30.536791 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd7f8e-88bc-4a95-bd16-b1bb59b8a269 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:30.541190 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8090cd-8d7a-4990-8f3e-576c103a2a47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:30.546492 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8090cd-8d7a-4990-8f3e-576c103a2a47 service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:30.546492 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8090cd-8d7a-4990-8f3e-576c103a2a47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:30.546492 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8090cd-8d7a-4990-8f3e-576c103a2a47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:30.546492 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-be8090cd-8d7a-4990-8f3e-576c103a2a47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:30.553932 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8090cd-8d7a-4990-8f3e-576c103a2a47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:30.555380 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8090cd-8d7a-4990-8f3e-576c103a2a47 service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:30.564472 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1310/2611] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:32:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:32:30.565770 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05629369-e2b2-4cad-8bce-3ad264030ad6 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:30.566016 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05629369-e2b2-4cad-8bce-3ad264030ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:30.566295 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05629369-e2b2-4cad-8bce-3ad264030ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:30.584593 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-05629369-e2b2-4cad-8bce-3ad264030ad6 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:32:30.585850 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-05629369-e2b2-4cad-8bce-3ad264030ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:30.595210 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1302/2612] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:32:30 2022] DELETE /identity/v3/users/835b0a316e5244a68ee218646a3bcb84 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:32:30.599416 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6615c-847e-412e-8bef-d95d256a75f1 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:30.599757 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6615c-847e-412e-8bef-d95d256a75f1 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:30.600035 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6615c-847e-412e-8bef-d95d256a75f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:30.604136 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:30.621163 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-0fa6615c-847e-412e-8bef-d95d256a75f1 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:32:30.623215 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-0fa6615c-847e-412e-8bef-d95d256a75f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:30.662706 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1311/2613] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:32:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:32:30.672509 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05629369-e2b2-4cad-8bce-3ad264030ad6 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:30.674025 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-05629369-e2b2-4cad-8bce-3ad264030ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:30.690806 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05629369-e2b2-4cad-8bce-3ad264030ad6 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:30.701979 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1303/2614] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:32:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:32:30.719452 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6615c-847e-412e-8bef-d95d256a75f1 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:30.752482 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8fce61-6f17-4198-90db-65bcfdf9f8df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:30.753242 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8fce61-6f17-4198-90db-65bcfdf9f8df service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:30.753838 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8fce61-6f17-4198-90db-65bcfdf9f8df service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:30.754119 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8fce61-6f17-4198-90db-65bcfdf9f8df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:30.766428 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8fce61-6f17-4198-90db-65bcfdf9f8df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:30.768007 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8fce61-6f17-4198-90db-65bcfdf9f8df service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:30.781332 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1312/2615] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:32:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 13:32:30.783779 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6615c-847e-412e-8bef-d95d256a75f1 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:30.787652 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b0dac-6b34-4d38-bde5-48ed4a932402 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:30.788343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b0dac-6b34-4d38-bde5-48ed4a932402 service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:30.788624 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b0dac-6b34-4d38-bde5-48ed4a932402 service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:30.789020 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b0dac-6b34-4d38-bde5-48ed4a932402 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:30.803545 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428b0dac-6b34-4d38-bde5-48ed4a932402 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:30.805182 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428b0dac-6b34-4d38-bde5-48ed4a932402 service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:30.817341 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1304/2616] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:32:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:32:31.370317 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8fce61-6f17-4198-90db-65bcfdf9f8df service neutron] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:31.372601 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-8f8fce61-6f17-4198-90db-65bcfdf9f8df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:31.395976 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8fce61-6f17-4198-90db-65bcfdf9f8df service neutron] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:31.401432 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf53e6-9861-44cc-8590-07a5577d4123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:31.402387 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf53e6-9861-44cc-8590-07a5577d4123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:31.402747 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf53e6-9861-44cc-8590-07a5577d4123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:31.403092 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf53e6-9861-44cc-8590-07a5577d4123 admin admin] PATH_INFO: `/v3/projects/8e1a25bae1ef4313af4e0fe2503a000c` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:31.404671 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf53e6-9861-44cc-8590-07a5577d4123 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e1a25bae1ef4313af4e0fe2503a000c)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:31.406954 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf53e6-9861-44cc-8590-07a5577d4123 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:31.439382 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b0dac-6b34-4d38-bde5-48ed4a932402 service neutron] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:31.441400 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-428b0dac-6b34-4d38-bde5-48ed4a932402 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:31.471759 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:31.505028 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b0dac-6b34-4d38-bde5-48ed4a932402 service neutron] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:31.509963 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6430ef-bf11-4beb-afe1-d4308ddbc313 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:31.510774 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6430ef-bf11-4beb-afe1-d4308ddbc313 service cinder] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:31.511060 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6430ef-bf11-4beb-afe1-d4308ddbc313 service cinder] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:31.511340 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6430ef-bf11-4beb-afe1-d4308ddbc313 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:31.513424 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-7b6430ef-bf11-4beb-afe1-d4308ddbc313 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:31.540020 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-e7bf53e6-9861-44cc-8590-07a5577d4123 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e1a25bae1ef4313af4e0fe2503a000c', 'request_id': 'req-e7bf53e6-9861-44cc-8590-07a5577d4123'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:31.557216 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-e7bf53e6-9861-44cc-8590-07a5577d4123 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e1a25bae1ef4313af4e0fe2503a000c', 'request_id': 'req-e7bf53e6-9861-44cc-8590-07a5577d4123'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:31.566370 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-e7bf53e6-9861-44cc-8590-07a5577d4123 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e1a25bae1ef4313af4e0fe2503a000c', 'request_id': 'req-e7bf53e6-9861-44cc-8590-07a5577d4123'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:31.614872 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6430ef-bf11-4beb-afe1-d4308ddbc313 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:31.616485 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6430ef-bf11-4beb-afe1-d4308ddbc313 service cinder] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:31.632413 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1305/2617] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:32:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:32:31.633371 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6430ef-bf11-4beb-afe1-d4308ddbc313 service cinder] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:31.635682 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-7b6430ef-bf11-4beb-afe1-d4308ddbc313 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:31.650672 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6430ef-bf11-4beb-afe1-d4308ddbc313 service cinder] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:31.674595 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-e7bf53e6-9861-44cc-8590-07a5577d4123 admin admin] The token cache is being invalidate because project 8e1a25bae1ef4313af4e0fe2503a000c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:32:31.674961 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-e7bf53e6-9861-44cc-8590-07a5577d4123 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:31.679204 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-e7bf53e6-9861-44cc-8590-07a5577d4123 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:31.681796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1313/2618] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:32:31 2022] DELETE /identity/v3/projects/8e1a25bae1ef4313af4e0fe2503a000c => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:32:31.692883 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf53e6-9861-44cc-8590-07a5577d4123 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:31.692883 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-e7bf53e6-9861-44cc-8590-07a5577d4123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:31.742828 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f77e13-be76-41a5-b47e-ace639e601ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:31.744299 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f77e13-be76-41a5-b47e-ace639e601ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:31.744751 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f77e13-be76-41a5-b47e-ace639e601ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:31.744971 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f77e13-be76-41a5-b47e-ace639e601ac admin admin] PATH_INFO: `/v3/projects/103565c121b94db4979a8b3b4c0820e4` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:31.746056 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f77e13-be76-41a5-b47e-ace639e601ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=103565c121b94db4979a8b3b4c0820e4)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:31.747974 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f77e13-be76-41a5-b47e-ace639e601ac admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:31.756587 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:31.780893 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf53e6-9861-44cc-8590-07a5577d4123 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:31.786087 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0159b8a0-2c68-4c6f-8e4b-bbc627725a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:31.786975 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159b8a0-2c68-4c6f-8e4b-bbc627725a0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:31.787262 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159b8a0-2c68-4c6f-8e4b-bbc627725a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:31.787567 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159b8a0-2c68-4c6f-8e4b-bbc627725a0d admin admin] PATH_INFO: `/v3/users/c5a24d8ca73e471c8572a474aa93cdaf` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:31.788813 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0159b8a0-2c68-4c6f-8e4b-bbc627725a0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5a24d8ca73e471c8572a474aa93cdaf)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:31.791337 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0159b8a0-2c68-4c6f-8e4b-bbc627725a0d admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:31.881693 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-74f77e13-be76-41a5-b47e-ace639e601ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '103565c121b94db4979a8b3b4c0820e4', 'request_id': 'req-74f77e13-be76-41a5-b47e-ace639e601ac'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:32.016122 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-74f77e13-be76-41a5-b47e-ace639e601ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '103565c121b94db4979a8b3b4c0820e4', 'request_id': 'req-74f77e13-be76-41a5-b47e-ace639e601ac'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:32.022611 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-74f77e13-be76-41a5-b47e-ace639e601ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '103565c121b94db4979a8b3b4c0820e4', 'request_id': 'req-74f77e13-be76-41a5-b47e-ace639e601ac'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:32.033990 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-74f77e13-be76-41a5-b47e-ace639e601ac admin admin] The token cache is being invalidate because project 103565c121b94db4979a8b3b4c0820e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:32:32.034281 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-74f77e13-be76-41a5-b47e-ace639e601ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:32.034987 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-74f77e13-be76-41a5-b47e-ace639e601ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:32.036336 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-0159b8a0-2c68-4c6f-8e4b-bbc627725a0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5a24d8ca73e471c8572a474aa93cdaf'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:32.036690 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1306/2619] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:32:31 2022] DELETE /identity/v3/projects/103565c121b94db4979a8b3b4c0820e4 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:32:32.045785 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab544019-79e3-4853-83a5-877874f9791e None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:32.046879 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab544019-79e3-4853-83a5-877874f9791e None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:32.050347 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab544019-79e3-4853-83a5-877874f9791e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:32.051076 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-0159b8a0-2c68-4c6f-8e4b-bbc627725a0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5a24d8ca73e471c8572a474aa93cdaf'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:32.051788 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-0159b8a0-2c68-4c6f-8e4b-bbc627725a0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5a24d8ca73e471c8572a474aa93cdaf'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:32.059710 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-0159b8a0-2c68-4c6f-8e4b-bbc627725a0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5a24d8ca73e471c8572a474aa93cdaf'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:32.060560 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-0159b8a0-2c68-4c6f-8e4b-bbc627725a0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5a24d8ca73e471c8572a474aa93cdaf'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:32.075238 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-ab544019-79e3-4853-83a5-877874f9791e None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:32:32.078889 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-ab544019-79e3-4853-83a5-877874f9791e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:32.140604 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1307/2620] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:32:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:32:32.147999 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419b066-0286-4bea-b534-21f75539a83e None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:32.148319 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419b066-0286-4bea-b534-21f75539a83e None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:32.148595 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419b066-0286-4bea-b534-21f75539a83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:32.158527 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1314/2621] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:32:31 2022] DELETE /identity/v3/users/c5a24d8ca73e471c8572a474aa93cdaf => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:32:32.168576 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-8419b066-0286-4bea-b534-21f75539a83e None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:32:32.169910 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-8419b066-0286-4bea-b534-21f75539a83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:32.232969 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:32.267316 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1308/2622] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:32:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:32:32.271597 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0159b8a0-2c68-4c6f-8e4b-bbc627725a0d admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:32.282726 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0159b8a0-2c68-4c6f-8e4b-bbc627725a0d admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:32.288046 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a812b-9bae-4f1c-93b0-6f02a4c76e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:32.288820 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a812b-9bae-4f1c-93b0-6f02a4c76e94 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:32.289145 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a812b-9bae-4f1c-93b0-6f02a4c76e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:32.289479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a812b-9bae-4f1c-93b0-6f02a4c76e94 admin admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:32.290215 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a812b-9bae-4f1c-93b0-6f02a4c76e94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:32:32.290825 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a812b-9bae-4f1c-93b0-6f02a4c76e94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:32.292815 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a812b-9bae-4f1c-93b0-6f02a4c76e94 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:32.304886 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1315/2623] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:32:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:32:32.310049 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419b066-0286-4bea-b534-21f75539a83e None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:32.321503 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419b066-0286-4bea-b534-21f75539a83e None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:32.327410 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480dc812-d0f3-4d21-a7ce-987701bfc1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:32.328079 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480dc812-d0f3-4d21-a7ce-987701bfc1ca admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:32.328474 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480dc812-d0f3-4d21-a7ce-987701bfc1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:32.328673 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480dc812-d0f3-4d21-a7ce-987701bfc1ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:32.329358 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480dc812-d0f3-4d21-a7ce-987701bfc1ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:32.331265 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480dc812-d0f3-4d21-a7ce-987701bfc1ca admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:32.444345 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1309/2624] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:32:32 2022] POST /identity/v3/projects => generated 375 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:32:32.447922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a812b-9bae-4f1c-93b0-6f02a4c76e94 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:32.458578 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a812b-9bae-4f1c-93b0-6f02a4c76e94 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:32.526290 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c67ec-8c0a-48f4-ad51-845a63089438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:32.527869 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c67ec-8c0a-48f4-ad51-845a63089438 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:32.528274 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c67ec-8c0a-48f4-ad51-845a63089438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:32.528651 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c67ec-8c0a-48f4-ad51-845a63089438 admin admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:32.529481 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c67ec-8c0a-48f4-ad51-845a63089438 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:32.531633 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c67ec-8c0a-48f4-ad51-845a63089438 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:32.615107 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1316/2625] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:32:32 2022] POST /identity/v3/users => generated 288 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:32:32.616777 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480dc812-d0f3-4d21-a7ce-987701bfc1ca admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:32.619644 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-480dc812-d0f3-4d21-a7ce-987701bfc1ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:32.621022 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c67ec-8c0a-48f4-ad51-845a63089438 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:32.635668 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c67ec-8c0a-48f4-ad51-845a63089438 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:32.641128 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd69e8-0256-4f80-9980-d7d30ab92954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:32.641843 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd69e8-0256-4f80-9980-d7d30ab92954 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:32.642125 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd69e8-0256-4f80-9980-d7d30ab92954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:32.642396 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd69e8-0256-4f80-9980-d7d30ab92954 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:32.643190 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd69e8-0256-4f80-9980-d7d30ab92954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:32.643838 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480dc812-d0f3-4d21-a7ce-987701bfc1ca admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:32.644973 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd69e8-0256-4f80-9980-d7d30ab92954 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:32.652112 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40c2d7-267f-41ae-abf2-ac54e4a3c8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:32.653576 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40c2d7-267f-41ae-abf2-ac54e4a3c8bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:32.653924 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40c2d7-267f-41ae-abf2-ac54e4a3c8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:32.654209 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40c2d7-267f-41ae-abf2-ac54e4a3c8bd admin admin] PATH_INFO: `/v3/projects/c11c2170babc44c9a3cdac600b44e17a` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:32.655524 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a40c2d7-267f-41ae-abf2-ac54e4a3c8bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c11c2170babc44c9a3cdac600b44e17a)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:32.662685 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a40c2d7-267f-41ae-abf2-ac54e4a3c8bd admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:32.662793 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1317/2626] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:32:32.664820 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd69e8-0256-4f80-9980-d7d30ab92954 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:32.677572 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd69e8-0256-4f80-9980-d7d30ab92954 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:32.683987 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c007caff-df11-4ccb-ba9a-0c819f252130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:32.685264 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007caff-df11-4ccb-ba9a-0c819f252130 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:32.685553 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007caff-df11-4ccb-ba9a-0c819f252130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:32.685898 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007caff-df11-4ccb-ba9a-0c819f252130 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:32.686982 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c007caff-df11-4ccb-ba9a-0c819f252130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:32.688391 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c007caff-df11-4ccb-ba9a-0c819f252130 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:32.700723 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1318/2627] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:32:32.704764 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c007caff-df11-4ccb-ba9a-0c819f252130 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:32.715209 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c007caff-df11-4ccb-ba9a-0c819f252130 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:32.720011 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ff329-85b3-493a-b1ce-22d3a1364324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:32.720929 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ff329-85b3-493a-b1ce-22d3a1364324 admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:32.721214 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ff329-85b3-493a-b1ce-22d3a1364324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:32.721492 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ff329-85b3-493a-b1ce-22d3a1364324 admin admin] PATH_INFO: `/v3/projects/1d2872d9b45c45bbab8d051db979418c/users/285f4f6a17024cf0aa36751bdffa9a13/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:32.737575 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462ff329-85b3-493a-b1ce-22d3a1364324 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d2872d9b45c45bbab8d051db979418c, user_id=285f4f6a17024cf0aa36751bdffa9a13, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:32.740674 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462ff329-85b3-493a-b1ce-22d3a1364324 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:32.742970 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:32.854377 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1319/2628] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:32:32 2022] PUT /identity/v3/projects/1d2872d9b45c45bbab8d051db979418c/users/285f4f6a17024cf0aa36751bdffa9a13/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:32:32.862859 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-6a40c2d7-267f-41ae-abf2-ac54e4a3c8bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c11c2170babc44c9a3cdac600b44e17a', 'request_id': 'req-6a40c2d7-267f-41ae-abf2-ac54e4a3c8bd'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:32.864843 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142abb9e-5d78-48d0-926b-9e089997fae0 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:32.865142 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142abb9e-5d78-48d0-926b-9e089997fae0 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:32.865407 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142abb9e-5d78-48d0-926b-9e089997fae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:32.891553 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-142abb9e-5d78-48d0-926b-9e089997fae0 None None] MFA Rules not processed for user `285f4f6a17024cf0aa36751bdffa9a13`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:32:32.892774 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-142abb9e-5d78-48d0-926b-9e089997fae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:32.956314 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1320/2629] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:32:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:32:32.960743 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142abb9e-5d78-48d0-926b-9e089997fae0 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:33.004611 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-6a40c2d7-267f-41ae-abf2-ac54e4a3c8bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c11c2170babc44c9a3cdac600b44e17a', 'request_id': 'req-6a40c2d7-267f-41ae-abf2-ac54e4a3c8bd'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:33.011167 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-6a40c2d7-267f-41ae-abf2-ac54e4a3c8bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c11c2170babc44c9a3cdac600b44e17a', 'request_id': 'req-6a40c2d7-267f-41ae-abf2-ac54e4a3c8bd'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:33.023493 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-6a40c2d7-267f-41ae-abf2-ac54e4a3c8bd admin admin] The token cache is being invalidate because project c11c2170babc44c9a3cdac600b44e17a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:32:33.023777 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-6a40c2d7-267f-41ae-abf2-ac54e4a3c8bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:33.024479 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-6a40c2d7-267f-41ae-abf2-ac54e4a3c8bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:33.026049 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142abb9e-5d78-48d0-926b-9e089997fae0 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:33.026794 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1310/2630] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:32:32 2022] DELETE /identity/v3/projects/c11c2170babc44c9a3cdac600b44e17a => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:32:33.030983 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bcdf00-d6d1-46d7-8850-a6f1836411f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:33.031491 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39d60a-ebbc-4992-ab6f-2ba98162a19e None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:33.031638 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bcdf00-d6d1-46d7-8850-a6f1836411f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:33.031846 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39d60a-ebbc-4992-ab6f-2ba98162a19e None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:33.032020 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bcdf00-d6d1-46d7-8850-a6f1836411f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:33.032126 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39d60a-ebbc-4992-ab6f-2ba98162a19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:33.032249 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bcdf00-d6d1-46d7-8850-a6f1836411f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:33.032890 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bcdf00-d6d1-46d7-8850-a6f1836411f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:33.034807 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bcdf00-d6d1-46d7-8850-a6f1836411f7 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:33.050329 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-eb39d60a-ebbc-4992-ab6f-2ba98162a19e None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:32:33.051660 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-eb39d60a-ebbc-4992-ab6f-2ba98162a19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:33.059742 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1311/2631] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:32:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:32:33.067263 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aeba01-d354-4e2a-8d16-85e478151b93 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:33.067557 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aeba01-d354-4e2a-8d16-85e478151b93 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:33.067839 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aeba01-d354-4e2a-8d16-85e478151b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:33.075134 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:33.086115 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-a2aeba01-d354-4e2a-8d16-85e478151b93 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:32:33.087793 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-a2aeba01-d354-4e2a-8d16-85e478151b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:33.095595 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1312/2632] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:32:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:32:33.099610 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aeba01-d354-4e2a-8d16-85e478151b93 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:33.109151 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aeba01-d354-4e2a-8d16-85e478151b93 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:33.115806 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1321/2633] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:32:32 2022] POST /identity/v3/projects => generated 373 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:32:33.115964 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082a7f5-701e-4b2c-9641-bb1649e55c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:33.115964 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082a7f5-701e-4b2c-9641-bb1649e55c1e admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:33.115964 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082a7f5-701e-4b2c-9641-bb1649e55c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:33.115964 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082a7f5-701e-4b2c-9641-bb1649e55c1e admin admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:33.116623 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d082a7f5-701e-4b2c-9641-bb1649e55c1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:32:33.116623 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d082a7f5-701e-4b2c-9641-bb1649e55c1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:33.117289 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bcdf00-d6d1-46d7-8850-a6f1836411f7 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:33.117627 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d082a7f5-701e-4b2c-9641-bb1649e55c1e admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:33.119004 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-f3bcdf00-d6d1-46d7-8850-a6f1836411f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:33.131293 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1313/2634] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:32:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:32:33.139871 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082a7f5-701e-4b2c-9641-bb1649e55c1e admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:33.149483 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082a7f5-701e-4b2c-9641-bb1649e55c1e admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:33.186597 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bcdf00-d6d1-46d7-8850-a6f1836411f7 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:33.191324 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f17ed-8f05-4f76-8a4c-9c947276887b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:33.191980 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f17ed-8f05-4f76-8a4c-9c947276887b admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:33.192294 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f17ed-8f05-4f76-8a4c-9c947276887b admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:33.192563 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f17ed-8f05-4f76-8a4c-9c947276887b admin admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:33.193235 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f17ed-8f05-4f76-8a4c-9c947276887b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:33.195181 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f17ed-8f05-4f76-8a4c-9c947276887b admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:33.206485 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5739460-f367-4c41-b0d9-52dac50091c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:33.207296 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5739460-f367-4c41-b0d9-52dac50091c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:33.207454 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5739460-f367-4c41-b0d9-52dac50091c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:33.207725 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5739460-f367-4c41-b0d9-52dac50091c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:33.208447 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5739460-f367-4c41-b0d9-52dac50091c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:33.210363 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5739460-f367-4c41-b0d9-52dac50091c3 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:33.313710 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:33.319774 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1322/2635] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:32:33 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:32:33.324300 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f17ed-8f05-4f76-8a4c-9c947276887b admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:33.333702 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f17ed-8f05-4f76-8a4c-9c947276887b admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:33.335326 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1314/2636] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:32:33 2022] POST /identity/v3/projects => generated 401 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:32:33.339862 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5739460-f367-4c41-b0d9-52dac50091c3 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:33.391910 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33e762-1a89-4636-8442-30779c1ae289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:33.392613 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33e762-1a89-4636-8442-30779c1ae289 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:33.392899 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33e762-1a89-4636-8442-30779c1ae289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:33.393180 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33e762-1a89-4636-8442-30779c1ae289 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:33.393931 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33e762-1a89-4636-8442-30779c1ae289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:33.395533 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33e762-1a89-4636-8442-30779c1ae289 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:33.401924 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5739460-f367-4c41-b0d9-52dac50091c3 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:33.406581 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa26caa-da60-4a86-8aa4-6bff338b99e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:33.406745 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1323/2637] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:32:33.408856 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa26caa-da60-4a86-8aa4-6bff338b99e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:33.409149 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa26caa-da60-4a86-8aa4-6bff338b99e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:33.409431 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa26caa-da60-4a86-8aa4-6bff338b99e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:33.410217 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa26caa-da60-4a86-8aa4-6bff338b99e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:33.410791 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33e762-1a89-4636-8442-30779c1ae289 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:33.412180 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa26caa-da60-4a86-8aa4-6bff338b99e4 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:33.420523 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33e762-1a89-4636-8442-30779c1ae289 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:33.425828 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2814f4-89c7-4ab7-92ee-481d73cc3601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:33.427017 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2814f4-89c7-4ab7-92ee-481d73cc3601 admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:33.433365 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2814f4-89c7-4ab7-92ee-481d73cc3601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:33.433365 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2814f4-89c7-4ab7-92ee-481d73cc3601 admin admin] PATH_INFO: `/v3/projects/822139dba4f34fa8a0b054fde0e860c4/users/152ad5426b624670bc8800e62a5df889/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:33.441938 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2814f4-89c7-4ab7-92ee-481d73cc3601 admin admin] RBAC: Authorizing `identity:create_grant(project_id=822139dba4f34fa8a0b054fde0e860c4, user_id=152ad5426b624670bc8800e62a5df889, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:33.444588 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2814f4-89c7-4ab7-92ee-481d73cc3601 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:33.524517 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1315/2638] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:32:33 2022] POST /identity/v3/users => generated 301 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:32:33.528924 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa26caa-da60-4a86-8aa4-6bff338b99e4 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:33.538244 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa26caa-da60-4a86-8aa4-6bff338b99e4 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:33.542976 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdadc77b-e9f9-4b75-963a-c7ad8a0a9c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:33.543601 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdadc77b-e9f9-4b75-963a-c7ad8a0a9c9b admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:33.543886 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdadc77b-e9f9-4b75-963a-c7ad8a0a9c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:33.544183 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdadc77b-e9f9-4b75-963a-c7ad8a0a9c9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:33.544896 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdadc77b-e9f9-4b75-963a-c7ad8a0a9c9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:33.546473 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdadc77b-e9f9-4b75-963a-c7ad8a0a9c9b admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:33.556598 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1324/2639] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:32:33 2022] PUT /identity/v3/projects/822139dba4f34fa8a0b054fde0e860c4/users/152ad5426b624670bc8800e62a5df889/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:32:33.558686 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1316/2640] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:32:33.560572 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2814f4-89c7-4ab7-92ee-481d73cc3601 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:33.562282 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdadc77b-e9f9-4b75-963a-c7ad8a0a9c9b admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:33.572793 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdadc77b-e9f9-4b75-963a-c7ad8a0a9c9b admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:33.617041 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:33.625422 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2814f4-89c7-4ab7-92ee-481d73cc3601 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:33.629087 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee370a4-f3ea-4b7a-bf3b-e888c4bb3c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:33.634836 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee370a4-f3ea-4b7a-bf3b-e888c4bb3c70 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:33.634836 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee370a4-f3ea-4b7a-bf3b-e888c4bb3c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:33.634836 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee370a4-f3ea-4b7a-bf3b-e888c4bb3c70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:33.634836 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee370a4-f3ea-4b7a-bf3b-e888c4bb3c70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:33.635205 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34291c-d6a3-4f5c-907f-5012be9e3f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:33.635205 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34291c-d6a3-4f5c-907f-5012be9e3f20 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:33.635205 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34291c-d6a3-4f5c-907f-5012be9e3f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:33.635433 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee370a4-f3ea-4b7a-bf3b-e888c4bb3c70 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:33.635547 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34291c-d6a3-4f5c-907f-5012be9e3f20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:33.635547 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34291c-d6a3-4f5c-907f-5012be9e3f20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:33.635813 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34291c-d6a3-4f5c-907f-5012be9e3f20 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:33.643463 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1317/2641] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:32:33.646774 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1325/2642] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:32:33.648326 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee370a4-f3ea-4b7a-bf3b-e888c4bb3c70 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:33.651145 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34291c-d6a3-4f5c-907f-5012be9e3f20 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:33.659299 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee370a4-f3ea-4b7a-bf3b-e888c4bb3c70 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:33.660966 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34291c-d6a3-4f5c-907f-5012be9e3f20 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:33.663964 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949dee34-866b-4ab5-86a7-ad0afb60e6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:33.664933 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949dee34-866b-4ab5-86a7-ad0afb60e6ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:33.665243 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949dee34-866b-4ab5-86a7-ad0afb60e6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:33.665514 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949dee34-866b-4ab5-86a7-ad0afb60e6ea admin admin] PATH_INFO: `/v3/projects/67dff552e0d04af196dd44201a24f273/users/d6a6374c35ab4f71adc161b4663ce76b/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:33.666648 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a78fb-b994-4e38-9a41-7c417b27bcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:33.667535 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a78fb-b994-4e38-9a41-7c417b27bcaa admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:33.667819 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a78fb-b994-4e38-9a41-7c417b27bcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:33.668094 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a78fb-b994-4e38-9a41-7c417b27bcaa admin admin] PATH_INFO: `/v3/projects/822139dba4f34fa8a0b054fde0e860c4/users/152ad5426b624670bc8800e62a5df889/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:33.670120 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7a78fb-b994-4e38-9a41-7c417b27bcaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=822139dba4f34fa8a0b054fde0e860c4, user_id=152ad5426b624670bc8800e62a5df889, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:33.672896 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7a78fb-b994-4e38-9a41-7c417b27bcaa admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:33.680354 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949dee34-866b-4ab5-86a7-ad0afb60e6ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=67dff552e0d04af196dd44201a24f273, user_id=d6a6374c35ab4f71adc161b4663ce76b, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:33.683958 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949dee34-866b-4ab5-86a7-ad0afb60e6ea admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:33.684381 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1326/2643] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:32:33 2022] PUT /identity/v3/projects/822139dba4f34fa8a0b054fde0e860c4/users/152ad5426b624670bc8800e62a5df889/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:32:33.695489 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d1f13-8d4a-4363-9f25-c5792f4bd424 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:33.695777 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d1f13-8d4a-4363-9f25-c5792f4bd424 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:33.696054 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d1f13-8d4a-4363-9f25-c5792f4bd424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:33.723926 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-532d1f13-8d4a-4363-9f25-c5792f4bd424 None None] MFA Rules not processed for user `152ad5426b624670bc8800e62a5df889`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:32:33.725138 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-532d1f13-8d4a-4363-9f25-c5792f4bd424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:33.749064 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1318/2644] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:32:33 2022] PUT /identity/v3/projects/67dff552e0d04af196dd44201a24f273/users/d6a6374c35ab4f71adc161b4663ce76b/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:32:33.761323 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48a408-62ca-48c4-8ea4-937de44d4b65 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:33.761628 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48a408-62ca-48c4-8ea4-937de44d4b65 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:33.761940 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48a408-62ca-48c4-8ea4-937de44d4b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:33.775484 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:33.792673 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-9d48a408-62ca-48c4-8ea4-937de44d4b65 None None] MFA Rules not processed for user `d6a6374c35ab4f71adc161b4663ce76b`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:32:33.794002 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-9d48a408-62ca-48c4-8ea4-937de44d4b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:33.808335 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1327/2645] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:32:33 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:32:33.819253 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d1f13-8d4a-4363-9f25-c5792f4bd424 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:33.821335 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-532d1f13-8d4a-4363-9f25-c5792f4bd424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:33.863825 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1319/2646] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:32:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:32:33.869203 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48a408-62ca-48c4-8ea4-937de44d4b65 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:33.894952 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d1f13-8d4a-4363-9f25-c5792f4bd424 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:33.931694 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48a408-62ca-48c4-8ea4-937de44d4b65 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:33.936391 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed2243-0a36-400a-b1b0-18f82b3342fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:33.937045 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed2243-0a36-400a-b1b0-18f82b3342fb admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:33.937326 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed2243-0a36-400a-b1b0-18f82b3342fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:33.937605 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed2243-0a36-400a-b1b0-18f82b3342fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:33.938283 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed2243-0a36-400a-b1b0-18f82b3342fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:33.940237 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed2243-0a36-400a-b1b0-18f82b3342fb admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:33.945236 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0824706f-8339-431c-b8af-638ec4d86960 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:33.945892 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824706f-8339-431c-b8af-638ec4d86960 service cinder] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:33.946195 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824706f-8339-431c-b8af-638ec4d86960 service cinder] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:33.947400 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824706f-8339-431c-b8af-638ec4d86960 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:33.949388 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-0824706f-8339-431c-b8af-638ec4d86960 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:34.008881 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0824706f-8339-431c-b8af-638ec4d86960 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:34.010986 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0824706f-8339-431c-b8af-638ec4d86960 service cinder] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:34.020544 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1328/2647] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:32:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 13:32:34.027216 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1320/2648] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:32:33 2022] POST /identity/v3/projects => generated 399 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:32:34.028199 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0824706f-8339-431c-b8af-638ec4d86960 service cinder] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:34.038452 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0824706f-8339-431c-b8af-638ec4d86960 service cinder] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:34.085906 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:34.099318 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3bd22-aec6-41e8-801c-c4871690d69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:34.100327 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3bd22-aec6-41e8-801c-c4871690d69d admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:34.100453 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3bd22-aec6-41e8-801c-c4871690d69d admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:34.100627 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3bd22-aec6-41e8-801c-c4871690d69d admin admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:34.101324 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c3bd22-aec6-41e8-801c-c4871690d69d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:34.103556 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c3bd22-aec6-41e8-801c-c4871690d69d admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:34.219394 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1329/2649] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:32:34 2022] POST /identity/v3/users => generated 306 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:32:34.223474 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed2243-0a36-400a-b1b0-18f82b3342fb admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:34.233694 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed2243-0a36-400a-b1b0-18f82b3342fb admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:34.238199 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a254110-2171-44f8-88f1-bcce685ef038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:34.238854 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a254110-2171-44f8-88f1-bcce685ef038 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:34.239133 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a254110-2171-44f8-88f1-bcce685ef038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:34.239403 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a254110-2171-44f8-88f1-bcce685ef038 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:34.240111 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a254110-2171-44f8-88f1-bcce685ef038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:34.241754 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a254110-2171-44f8-88f1-bcce685ef038 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:34.252437 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1321/2650] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:32:34.256904 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3bd22-aec6-41e8-801c-c4871690d69d admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:34.267653 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3bd22-aec6-41e8-801c-c4871690d69d admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:34.272365 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b916fc09-9a07-4c14-8a81-824d312cc6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:34.273242 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916fc09-9a07-4c14-8a81-824d312cc6ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:34.273525 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916fc09-9a07-4c14-8a81-824d312cc6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:34.273801 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916fc09-9a07-4c14-8a81-824d312cc6ca admin admin] PATH_INFO: `/v3/projects/807f74a7350142b0ab3d3530463e0e53/users/3621dae203774f378714ebef096f3682/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:34.290302 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b916fc09-9a07-4c14-8a81-824d312cc6ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=807f74a7350142b0ab3d3530463e0e53, user_id=3621dae203774f378714ebef096f3682, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:34.294291 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b916fc09-9a07-4c14-8a81-824d312cc6ca admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:34.382088 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1330/2651] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:32:34 2022] PUT /identity/v3/projects/807f74a7350142b0ab3d3530463e0e53/users/3621dae203774f378714ebef096f3682/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:32:34.387080 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a254110-2171-44f8-88f1-bcce685ef038 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:34.396980 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a254110-2171-44f8-88f1-bcce685ef038 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:34.417727 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:34.454692 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8243c4-3bac-4fea-8f46-44e06575c394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:34.455356 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8243c4-3bac-4fea-8f46-44e06575c394 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:34.455643 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8243c4-3bac-4fea-8f46-44e06575c394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:34.455922 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8243c4-3bac-4fea-8f46-44e06575c394 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:34.456704 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8243c4-3bac-4fea-8f46-44e06575c394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:34.458332 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8243c4-3bac-4fea-8f46-44e06575c394 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:34.468218 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1322/2652] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:32:34.473000 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b916fc09-9a07-4c14-8a81-824d312cc6ca admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:34.483262 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b916fc09-9a07-4c14-8a81-824d312cc6ca admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:34.487854 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51445e66-9024-4a9a-8532-17ac32a784cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:34.488792 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51445e66-9024-4a9a-8532-17ac32a784cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:34.489067 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51445e66-9024-4a9a-8532-17ac32a784cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:34.489334 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51445e66-9024-4a9a-8532-17ac32a784cf admin admin] PATH_INFO: `/v3/projects/807f74a7350142b0ab3d3530463e0e53/users/3621dae203774f378714ebef096f3682/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:34.491299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51445e66-9024-4a9a-8532-17ac32a784cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=807f74a7350142b0ab3d3530463e0e53, user_id=3621dae203774f378714ebef096f3682, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:34.494636 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51445e66-9024-4a9a-8532-17ac32a784cf admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:34.505114 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1331/2653] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:32:34 2022] PUT /identity/v3/projects/807f74a7350142b0ab3d3530463e0e53/users/3621dae203774f378714ebef096f3682/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:32:34.516300 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa301e-295f-4a5e-ad57-83f269f7f7dc None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:34.516606 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa301e-295f-4a5e-ad57-83f269f7f7dc None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:34.516883 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa301e-295f-4a5e-ad57-83f269f7f7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:34.545078 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-38fa301e-295f-4a5e-ad57-83f269f7f7dc None None] MFA Rules not processed for user `3621dae203774f378714ebef096f3682`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:32:34.545276 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-38fa301e-295f-4a5e-ad57-83f269f7f7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:34.611598 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1323/2654] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:32:34 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:32:34.623208 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51445e66-9024-4a9a-8532-17ac32a784cf admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:34.624946 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-51445e66-9024-4a9a-8532-17ac32a784cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:34.684654 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51445e66-9024-4a9a-8532-17ac32a784cf admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:34.688312 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7a010-965c-4eb7-b582-5c1433bed9d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:34.688952 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7a010-965c-4eb7-b582-5c1433bed9d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:34.689233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7a010-965c-4eb7-b582-5c1433bed9d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:34.689506 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7a010-965c-4eb7-b582-5c1433bed9d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:34.699148 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced7a010-965c-4eb7-b582-5c1433bed9d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:34.700668 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced7a010-965c-4eb7-b582-5c1433bed9d2 service cinder] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:34.710210 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1332/2655] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:32:34 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 13:32:34.975247 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa301e-295f-4a5e-ad57-83f269f7f7dc None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:34.986087 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa301e-295f-4a5e-ad57-83f269f7f7dc None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:34.991002 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f83dc8-d22c-489b-aaf3-ef140c3c9c90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:34.991665 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f83dc8-d22c-489b-aaf3-ef140c3c9c90 service cinder] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:34.991967 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f83dc8-d22c-489b-aaf3-ef140c3c9c90 service cinder] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:34.993924 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f83dc8-d22c-489b-aaf3-ef140c3c9c90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:35.055094 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f83dc8-d22c-489b-aaf3-ef140c3c9c90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:35.057847 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f83dc8-d22c-489b-aaf3-ef140c3c9c90 service cinder] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:35.067092 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1324/2656] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:32:34 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:32:39.278130 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7a010-965c-4eb7-b582-5c1433bed9d2 service cinder] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:39.366980 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7a010-965c-4eb7-b582-5c1433bed9d2 service cinder] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:39.377849 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd579138-82d1-41dc-953f-8c41aded6f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:39.378991 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd579138-82d1-41dc-953f-8c41aded6f20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:39.379279 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd579138-82d1-41dc-953f-8c41aded6f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:39.379551 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd579138-82d1-41dc-953f-8c41aded6f20 admin admin] PATH_INFO: `/v3/users/285f4f6a17024cf0aa36751bdffa9a13` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:39.380860 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd579138-82d1-41dc-953f-8c41aded6f20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=285f4f6a17024cf0aa36751bdffa9a13)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:39.382972 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd579138-82d1-41dc-953f-8c41aded6f20 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:39.669233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:39.671035 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-fd579138-82d1-41dc-953f-8c41aded6f20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '285f4f6a17024cf0aa36751bdffa9a13'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:39.683681 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-fd579138-82d1-41dc-953f-8c41aded6f20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '285f4f6a17024cf0aa36751bdffa9a13'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:39.684489 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-fd579138-82d1-41dc-953f-8c41aded6f20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '285f4f6a17024cf0aa36751bdffa9a13'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:39.692605 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-fd579138-82d1-41dc-953f-8c41aded6f20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '285f4f6a17024cf0aa36751bdffa9a13'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:39.692605 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-fd579138-82d1-41dc-953f-8c41aded6f20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '285f4f6a17024cf0aa36751bdffa9a13'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:39.788304 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1333/2657] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:32:39 2022] DELETE /identity/v3/users/285f4f6a17024cf0aa36751bdffa9a13 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:32:39.793741 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b28694-4fed-45f6-9d69-2e1420c7c405 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:39.794250 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b28694-4fed-45f6-9d69-2e1420c7c405 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:39.794348 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b28694-4fed-45f6-9d69-2e1420c7c405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:39.811199 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-93b28694-4fed-45f6-9d69-2e1420c7c405 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:32:39.812413 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-93b28694-4fed-45f6-9d69-2e1420c7c405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:39.852169 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=100 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:39.871425 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1325/2658] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:32:39.881653 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd579138-82d1-41dc-953f-8c41aded6f20 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:39.883137 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-fd579138-82d1-41dc-953f-8c41aded6f20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:39.940549 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd579138-82d1-41dc-953f-8c41aded6f20 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:39.944114 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f51c8-9da4-49c2-b956-81919e1a0fda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:39.944900 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f51c8-9da4-49c2-b956-81919e1a0fda service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:39.945067 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f51c8-9da4-49c2-b956-81919e1a0fda service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:39.945349 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f51c8-9da4-49c2-b956-81919e1a0fda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:39.955609 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f51c8-9da4-49c2-b956-81919e1a0fda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:39.957228 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f51c8-9da4-49c2-b956-81919e1a0fda service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:39.967927 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1334/2659] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:32:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:32:40.419291 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b28694-4fed-45f6-9d69-2e1420c7c405 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:40.420858 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-93b28694-4fed-45f6-9d69-2e1420c7c405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:40.434660 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b28694-4fed-45f6-9d69-2e1420c7c405 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:40.442996 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48917c86-25e0-4d43-8b4a-4ccddaf26bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:40.443951 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48917c86-25e0-4d43-8b4a-4ccddaf26bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:40.444518 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48917c86-25e0-4d43-8b4a-4ccddaf26bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:40.444795 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48917c86-25e0-4d43-8b4a-4ccddaf26bd1 admin admin] PATH_INFO: `/v3/projects/1d2872d9b45c45bbab8d051db979418c` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:40.447669 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48917c86-25e0-4d43-8b4a-4ccddaf26bd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d2872d9b45c45bbab8d051db979418c)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:40.450899 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48917c86-25e0-4d43-8b4a-4ccddaf26bd1 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:40.564224 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-48917c86-25e0-4d43-8b4a-4ccddaf26bd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d2872d9b45c45bbab8d051db979418c', 'request_id': 'req-48917c86-25e0-4d43-8b4a-4ccddaf26bd1'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:40.653238 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-48917c86-25e0-4d43-8b4a-4ccddaf26bd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d2872d9b45c45bbab8d051db979418c', 'request_id': 'req-48917c86-25e0-4d43-8b4a-4ccddaf26bd1'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:40.659144 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-48917c86-25e0-4d43-8b4a-4ccddaf26bd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d2872d9b45c45bbab8d051db979418c', 'request_id': 'req-48917c86-25e0-4d43-8b4a-4ccddaf26bd1'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:40.671303 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-48917c86-25e0-4d43-8b4a-4ccddaf26bd1 admin admin] The token cache is being invalidate because project 1d2872d9b45c45bbab8d051db979418c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:32:40.671589 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-48917c86-25e0-4d43-8b4a-4ccddaf26bd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:40.672247 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-48917c86-25e0-4d43-8b4a-4ccddaf26bd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:40.673798 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1326/2660] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:32:40 2022] DELETE /identity/v3/projects/1d2872d9b45c45bbab8d051db979418c => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:32:40.678121 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f51c8-9da4-49c2-b956-81919e1a0fda service neutron] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:40.688475 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f51c8-9da4-49c2-b956-81919e1a0fda service neutron] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:40.745911 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593779ce-f91f-4b36-84a0-8768bdca1d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:40.746780 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593779ce-f91f-4b36-84a0-8768bdca1d24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:40.747066 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593779ce-f91f-4b36-84a0-8768bdca1d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:40.747342 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593779ce-f91f-4b36-84a0-8768bdca1d24 admin admin] PATH_INFO: `/v3/users/152ad5426b624670bc8800e62a5df889` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:40.748617 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593779ce-f91f-4b36-84a0-8768bdca1d24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=152ad5426b624670bc8800e62a5df889)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:40.750543 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593779ce-f91f-4b36-84a0-8768bdca1d24 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:40.945659 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-593779ce-f91f-4b36-84a0-8768bdca1d24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '152ad5426b624670bc8800e62a5df889'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:40.959276 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-593779ce-f91f-4b36-84a0-8768bdca1d24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '152ad5426b624670bc8800e62a5df889'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:40.960112 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-593779ce-f91f-4b36-84a0-8768bdca1d24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '152ad5426b624670bc8800e62a5df889'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:40.963549 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:40.968988 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-593779ce-f91f-4b36-84a0-8768bdca1d24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '152ad5426b624670bc8800e62a5df889'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:40.969805 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-593779ce-f91f-4b36-84a0-8768bdca1d24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '152ad5426b624670bc8800e62a5df889'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:41.056870 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1335/2661] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:32:40 2022] DELETE /identity/v3/users/152ad5426b624670bc8800e62a5df889 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:32:41.484198 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48917c86-25e0-4d43-8b4a-4ccddaf26bd1 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:41.485605 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-48917c86-25e0-4d43-8b4a-4ccddaf26bd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:41.499246 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48917c86-25e0-4d43-8b4a-4ccddaf26bd1 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:41.563936 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267775e6-51ca-4ccb-a233-9969393f1680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:41.564868 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267775e6-51ca-4ccb-a233-9969393f1680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:41.565147 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267775e6-51ca-4ccb-a233-9969393f1680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:41.565421 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267775e6-51ca-4ccb-a233-9969393f1680 admin admin] PATH_INFO: `/v3/projects/822139dba4f34fa8a0b054fde0e860c4` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:41.566703 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267775e6-51ca-4ccb-a233-9969393f1680 admin admin] RBAC: Authorizing `identity:delete_project(project_id=822139dba4f34fa8a0b054fde0e860c4)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:41.568764 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267775e6-51ca-4ccb-a233-9969393f1680 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:41.672123 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-267775e6-51ca-4ccb-a233-9969393f1680 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '822139dba4f34fa8a0b054fde0e860c4', 'request_id': 'req-267775e6-51ca-4ccb-a233-9969393f1680'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:41.733115 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-267775e6-51ca-4ccb-a233-9969393f1680 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '822139dba4f34fa8a0b054fde0e860c4', 'request_id': 'req-267775e6-51ca-4ccb-a233-9969393f1680'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:41.739340 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-267775e6-51ca-4ccb-a233-9969393f1680 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '822139dba4f34fa8a0b054fde0e860c4', 'request_id': 'req-267775e6-51ca-4ccb-a233-9969393f1680'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:41.746575 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:41.751171 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-267775e6-51ca-4ccb-a233-9969393f1680 admin admin] The token cache is being invalidate because project 822139dba4f34fa8a0b054fde0e860c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:32:41.751505 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-267775e6-51ca-4ccb-a233-9969393f1680 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:41.752180 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-267775e6-51ca-4ccb-a233-9969393f1680 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:41.753986 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1327/2662] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:32:41 2022] DELETE /identity/v3/projects/822139dba4f34fa8a0b054fde0e860c4 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:32:41.759460 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb108f94-afc7-48ad-8ac3-07909d241f2c None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:41.760242 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb108f94-afc7-48ad-8ac3-07909d241f2c None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:41.760242 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb108f94-afc7-48ad-8ac3-07909d241f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:41.778745 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-eb108f94-afc7-48ad-8ac3-07909d241f2c None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:32:41.779941 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-eb108f94-afc7-48ad-8ac3-07909d241f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:41.841435 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1336/2663] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:32:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:32:41.849213 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27993a-9fe1-4bc2-8dd8-69b5333dacce None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:41.849508 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27993a-9fe1-4bc2-8dd8-69b5333dacce None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:41.849788 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27993a-9fe1-4bc2-8dd8-69b5333dacce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:41.870780 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-1d27993a-9fe1-4bc2-8dd8-69b5333dacce None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:32:41.871979 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-1d27993a-9fe1-4bc2-8dd8-69b5333dacce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:41.880126 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1328/2664] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:32:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:32:41.885044 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb108f94-afc7-48ad-8ac3-07909d241f2c None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:41.894495 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb108f94-afc7-48ad-8ac3-07909d241f2c None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:41.898921 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b739ca4-d489-4cf0-b667-4bdb0c21cebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:41.899707 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b739ca4-d489-4cf0-b667-4bdb0c21cebb admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:41.899991 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b739ca4-d489-4cf0-b667-4bdb0c21cebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:41.900341 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b739ca4-d489-4cf0-b667-4bdb0c21cebb admin admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:41.901055 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b739ca4-d489-4cf0-b667-4bdb0c21cebb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:32:41.901355 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b739ca4-d489-4cf0-b667-4bdb0c21cebb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:41.902943 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b739ca4-d489-4cf0-b667-4bdb0c21cebb admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:41.914461 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1337/2665] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:32:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:32:41.918616 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27993a-9fe1-4bc2-8dd8-69b5333dacce None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:41.927667 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27993a-9fe1-4bc2-8dd8-69b5333dacce None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:41.932947 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7d02e-c863-4fe0-8186-7a9a239f4391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:41.933588 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7d02e-c863-4fe0-8186-7a9a239f4391 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:41.933869 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7d02e-c863-4fe0-8186-7a9a239f4391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:41.934139 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7d02e-c863-4fe0-8186-7a9a239f4391 admin admin] PATH_INFO: `/v3/projects` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:41.934822 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7d02e-c863-4fe0-8186-7a9a239f4391 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:41.936733 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7d02e-c863-4fe0-8186-7a9a239f4391 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:42.058307 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1329/2666] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:32:41 2022] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:32:42.062567 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b739ca4-d489-4cf0-b667-4bdb0c21cebb admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:42.073053 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b739ca4-d489-4cf0-b667-4bdb0c21cebb admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:42.128154 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df779a2-581f-4099-be8c-e4c3185bfe71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:42.129085 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df779a2-581f-4099-be8c-e4c3185bfe71 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:42.129365 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df779a2-581f-4099-be8c-e4c3185bfe71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:42.129644 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df779a2-581f-4099-be8c-e4c3185bfe71 admin admin] PATH_INFO: `/v3/users` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:42.130317 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df779a2-581f-4099-be8c-e4c3185bfe71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:42.132249 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df779a2-581f-4099-be8c-e4c3185bfe71 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:42.239008 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1338/2667] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:32:42 2022] POST /identity/v3/users => generated 287 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:32:42.243038 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7d02e-c863-4fe0-8186-7a9a239f4391 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:42.254815 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7d02e-c863-4fe0-8186-7a9a239f4391 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:42.260378 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b50c4-1b36-4a29-8d1d-fd4622c9c1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:42.261041 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b50c4-1b36-4a29-8d1d-fd4622c9c1bf admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:42.261321 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b50c4-1b36-4a29-8d1d-fd4622c9c1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:42.261594 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b50c4-1b36-4a29-8d1d-fd4622c9c1bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:42.262309 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b50c4-1b36-4a29-8d1d-fd4622c9c1bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:42.263944 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b50c4-1b36-4a29-8d1d-fd4622c9c1bf admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:42.274775 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1330/2668] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:32:42.278871 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df779a2-581f-4099-be8c-e4c3185bfe71 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:42.289041 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df779a2-581f-4099-be8c-e4c3185bfe71 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:42.294944 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a6388-e79a-4436-986f-c5996bf67be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:42.295601 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a6388-e79a-4436-986f-c5996bf67be1 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:42.295885 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a6388-e79a-4436-986f-c5996bf67be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:42.296164 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a6388-e79a-4436-986f-c5996bf67be1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:42.296895 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a6388-e79a-4436-986f-c5996bf67be1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:42.298493 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a6388-e79a-4436-986f-c5996bf67be1 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:42.309660 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1339/2669] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:32:42.313818 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b50c4-1b36-4a29-8d1d-fd4622c9c1bf admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:42.323739 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b50c4-1b36-4a29-8d1d-fd4622c9c1bf admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:42.328309 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2c739-4a5d-4191-b00b-ff4cd8312520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:42.329181 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2c739-4a5d-4191-b00b-ff4cd8312520 admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:42.329461 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2c739-4a5d-4191-b00b-ff4cd8312520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:42.329740 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2c739-4a5d-4191-b00b-ff4cd8312520 admin admin] PATH_INFO: `/v3/projects/2da8d0a5ee504646bd3cfb527856ff6e/users/bec198ad2e044eb3a681693c73828e81/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:42.345864 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2c739-4a5d-4191-b00b-ff4cd8312520 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2da8d0a5ee504646bd3cfb527856ff6e, user_id=bec198ad2e044eb3a681693c73828e81, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:42.348614 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2c739-4a5d-4191-b00b-ff4cd8312520 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:42.421482 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1331/2670] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:32:42 2022] PUT /identity/v3/projects/2da8d0a5ee504646bd3cfb527856ff6e/users/bec198ad2e044eb3a681693c73828e81/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:32:42.431721 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce0f6b-c272-4348-b73b-c7c8e928a971 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:42.432000 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce0f6b-c272-4348-b73b-c7c8e928a971 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:42.432307 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce0f6b-c272-4348-b73b-c7c8e928a971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:42.459042 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-77ce0f6b-c272-4348-b73b-c7c8e928a971 None None] MFA Rules not processed for user `bec198ad2e044eb3a681693c73828e81`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:32:42.460312 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-77ce0f6b-c272-4348-b73b-c7c8e928a971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:42.500549 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:42.525627 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1340/2671] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:32:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:32:42.536103 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2c739-4a5d-4191-b00b-ff4cd8312520 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:42.537815 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-53e2c739-4a5d-4191-b00b-ff4cd8312520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:42.594706 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2c739-4a5d-4191-b00b-ff4cd8312520 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:42.598328 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54407309-e048-4e2c-b85c-6d1ab7491a11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:42.598967 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54407309-e048-4e2c-b85c-6d1ab7491a11 service cinder] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:42.599253 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54407309-e048-4e2c-b85c-6d1ab7491a11 service cinder] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:42.599525 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54407309-e048-4e2c-b85c-6d1ab7491a11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:42.607894 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54407309-e048-4e2c-b85c-6d1ab7491a11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:42.609360 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54407309-e048-4e2c-b85c-6d1ab7491a11 service cinder] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:42.618050 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1332/2672] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:32:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:32:43.533589 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0508d-7a87-458d-8c3a-9110d8a8d9e2 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:43.534074 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0508d-7a87-458d-8c3a-9110d8a8d9e2 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:43.534203 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0508d-7a87-458d-8c3a-9110d8a8d9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:43.551451 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-4be0508d-7a87-458d-8c3a-9110d8a8d9e2 None None] MFA Rules not processed for user `77c56945d1d74a1eaa5e0c8f9e43f086`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:32:43.552788 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-4be0508d-7a87-458d-8c3a-9110d8a8d9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:43.614706 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1341/2673] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:32:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:32:44.201941 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54407309-e048-4e2c-b85c-6d1ab7491a11 service cinder] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:44.203368 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-54407309-e048-4e2c-b85c-6d1ab7491a11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:44.270095 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54407309-e048-4e2c-b85c-6d1ab7491a11 service cinder] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:44.275166 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aff53b-078e-4b39-a4e6-f3664e2b1234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:44.276213 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aff53b-078e-4b39-a4e6-f3664e2b1234 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:44.276497 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aff53b-078e-4b39-a4e6-f3664e2b1234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:44.276773 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aff53b-078e-4b39-a4e6-f3664e2b1234 admin admin] PATH_INFO: `/v3/users/d6a6374c35ab4f71adc161b4663ce76b` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:44.277940 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aff53b-078e-4b39-a4e6-f3664e2b1234 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6a6374c35ab4f71adc161b4663ce76b)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:44.279819 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aff53b-078e-4b39-a4e6-f3664e2b1234 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:44.453104 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:44.459019 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-75aff53b-078e-4b39-a4e6-f3664e2b1234 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6a6374c35ab4f71adc161b4663ce76b'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:44.474313 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-75aff53b-078e-4b39-a4e6-f3664e2b1234 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6a6374c35ab4f71adc161b4663ce76b'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:44.475023 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-75aff53b-078e-4b39-a4e6-f3664e2b1234 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6a6374c35ab4f71adc161b4663ce76b'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:44.482161 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-75aff53b-078e-4b39-a4e6-f3664e2b1234 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6a6374c35ab4f71adc161b4663ce76b'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:44.482797 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-75aff53b-078e-4b39-a4e6-f3664e2b1234 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6a6374c35ab4f71adc161b4663ce76b'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:44.575447 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1333/2674] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:32:44 2022] DELETE /identity/v3/users/d6a6374c35ab4f71adc161b4663ce76b => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:32:44.580055 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9cafeb-d9ba-47c7-8d4c-bb26926639e2 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:44.580570 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9cafeb-d9ba-47c7-8d4c-bb26926639e2 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:44.580693 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9cafeb-d9ba-47c7-8d4c-bb26926639e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:44.599988 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-4b9cafeb-d9ba-47c7-8d4c-bb26926639e2 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:32:44.601668 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-4b9cafeb-d9ba-47c7-8d4c-bb26926639e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:44.685880 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1342/2675] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:32:44.706432 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aff53b-078e-4b39-a4e6-f3664e2b1234 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:44.708447 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-75aff53b-078e-4b39-a4e6-f3664e2b1234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:44.785522 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aff53b-078e-4b39-a4e6-f3664e2b1234 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:44.794817 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb345354-9a47-4a6a-8d00-43180a858adb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:44.794817 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb345354-9a47-4a6a-8d00-43180a858adb service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:44.794817 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb345354-9a47-4a6a-8d00-43180a858adb service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:44.794817 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb345354-9a47-4a6a-8d00-43180a858adb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:44.810762 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb345354-9a47-4a6a-8d00-43180a858adb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:44.812387 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb345354-9a47-4a6a-8d00-43180a858adb service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:44.824889 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1334/2676] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:32:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:32:45.301566 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9cafeb-d9ba-47c7-8d4c-bb26926639e2 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:45.301566 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-4b9cafeb-d9ba-47c7-8d4c-bb26926639e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:45.313299 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9cafeb-d9ba-47c7-8d4c-bb26926639e2 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:45.317892 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b376594-7953-4be6-a5a2-d6cc27adb2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:45.319755 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b376594-7953-4be6-a5a2-d6cc27adb2c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:45.320038 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b376594-7953-4be6-a5a2-d6cc27adb2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:45.320333 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b376594-7953-4be6-a5a2-d6cc27adb2c4 admin admin] PATH_INFO: `/v3/projects/67dff552e0d04af196dd44201a24f273` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:45.322624 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b376594-7953-4be6-a5a2-d6cc27adb2c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67dff552e0d04af196dd44201a24f273)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:45.324663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b376594-7953-4be6-a5a2-d6cc27adb2c4 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:45.462735 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-3b376594-7953-4be6-a5a2-d6cc27adb2c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67dff552e0d04af196dd44201a24f273', 'request_id': 'req-3b376594-7953-4be6-a5a2-d6cc27adb2c4'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:45.469101 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-3b376594-7953-4be6-a5a2-d6cc27adb2c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67dff552e0d04af196dd44201a24f273', 'request_id': 'req-3b376594-7953-4be6-a5a2-d6cc27adb2c4'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:45.474554 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-3b376594-7953-4be6-a5a2-d6cc27adb2c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67dff552e0d04af196dd44201a24f273', 'request_id': 'req-3b376594-7953-4be6-a5a2-d6cc27adb2c4'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:45.592292 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-3b376594-7953-4be6-a5a2-d6cc27adb2c4 admin admin] The token cache is being invalidate because project 67dff552e0d04af196dd44201a24f273 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:32:45.592930 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-3b376594-7953-4be6-a5a2-d6cc27adb2c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:45.593196 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-3b376594-7953-4be6-a5a2-d6cc27adb2c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:45.594839 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1343/2677] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:32:45 2022] DELETE /identity/v3/projects/67dff552e0d04af196dd44201a24f273 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:32:45.598894 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb345354-9a47-4a6a-8d00-43180a858adb service neutron] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:45.608397 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb345354-9a47-4a6a-8d00-43180a858adb service neutron] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:45.663734 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94974092-0660-4dfa-9db6-4458840e8944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:45.664699 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94974092-0660-4dfa-9db6-4458840e8944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:45.665197 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94974092-0660-4dfa-9db6-4458840e8944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:45.665339 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94974092-0660-4dfa-9db6-4458840e8944 admin admin] PATH_INFO: `/v3/users/3621dae203774f378714ebef096f3682` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:45.666439 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94974092-0660-4dfa-9db6-4458840e8944 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3621dae203774f378714ebef096f3682)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:45.668383 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94974092-0660-4dfa-9db6-4458840e8944 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:45.894342 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-94974092-0660-4dfa-9db6-4458840e8944 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3621dae203774f378714ebef096f3682'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:45.911233 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:45.914124 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-94974092-0660-4dfa-9db6-4458840e8944 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3621dae203774f378714ebef096f3682'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:45.916614 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-94974092-0660-4dfa-9db6-4458840e8944 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3621dae203774f378714ebef096f3682'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:45.927156 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-94974092-0660-4dfa-9db6-4458840e8944 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3621dae203774f378714ebef096f3682'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:45.927990 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-94974092-0660-4dfa-9db6-4458840e8944 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3621dae203774f378714ebef096f3682'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:46.044846 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1335/2678] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:32:45 2022] DELETE /identity/v3/users/3621dae203774f378714ebef096f3682 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:32:46.506664 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b376594-7953-4be6-a5a2-d6cc27adb2c4 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:46.508533 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-3b376594-7953-4be6-a5a2-d6cc27adb2c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:46.523763 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b376594-7953-4be6-a5a2-d6cc27adb2c4 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:46.529424 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:46.585260 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf5c049-1792-4a6e-aa32-306bba0bb5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:46.586323 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5c049-1792-4a6e-aa32-306bba0bb5bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:46.586604 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5c049-1792-4a6e-aa32-306bba0bb5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:46.586892 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5c049-1792-4a6e-aa32-306bba0bb5bf admin admin] PATH_INFO: `/v3/projects/807f74a7350142b0ab3d3530463e0e53` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:46.588522 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf5c049-1792-4a6e-aa32-306bba0bb5bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=807f74a7350142b0ab3d3530463e0e53)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:46.590515 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf5c049-1792-4a6e-aa32-306bba0bb5bf admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:46.728869 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-cbf5c049-1792-4a6e-aa32-306bba0bb5bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '807f74a7350142b0ab3d3530463e0e53', 'request_id': 'req-cbf5c049-1792-4a6e-aa32-306bba0bb5bf'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:46.735253 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-cbf5c049-1792-4a6e-aa32-306bba0bb5bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '807f74a7350142b0ab3d3530463e0e53', 'request_id': 'req-cbf5c049-1792-4a6e-aa32-306bba0bb5bf'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:46.740756 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-cbf5c049-1792-4a6e-aa32-306bba0bb5bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '807f74a7350142b0ab3d3530463e0e53', 'request_id': 'req-cbf5c049-1792-4a6e-aa32-306bba0bb5bf'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:46.804960 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-cbf5c049-1792-4a6e-aa32-306bba0bb5bf admin admin] The token cache is being invalidate because project 807f74a7350142b0ab3d3530463e0e53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:32:46.805376 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-cbf5c049-1792-4a6e-aa32-306bba0bb5bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:46.806557 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-cbf5c049-1792-4a6e-aa32-306bba0bb5bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:46.808106 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1344/2679] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:32:46 2022] DELETE /identity/v3/projects/807f74a7350142b0ab3d3530463e0e53 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:32:46.812968 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd37c58-7b87-45ab-bdfb-ce2b719ea0ae None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:46.813495 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd37c58-7b87-45ab-bdfb-ce2b719ea0ae None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:46.813596 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd37c58-7b87-45ab-bdfb-ce2b719ea0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:46.831249 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-6cd37c58-7b87-45ab-bdfb-ce2b719ea0ae None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:32:46.832540 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-6cd37c58-7b87-45ab-bdfb-ce2b719ea0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:46.895201 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1336/2680] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:32:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:32:46.903433 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea9799-d56e-4b26-8fbe-583c4f8699bd None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:46.903755 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea9799-d56e-4b26-8fbe-583c4f8699bd None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:46.904010 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea9799-d56e-4b26-8fbe-583c4f8699bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:46.925853 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-72ea9799-d56e-4b26-8fbe-583c4f8699bd None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:32:46.927089 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-72ea9799-d56e-4b26-8fbe-583c4f8699bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:46.940001 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1345/2681] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:32:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:32:46.945698 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd37c58-7b87-45ab-bdfb-ce2b719ea0ae None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:46.952128 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd37c58-7b87-45ab-bdfb-ce2b719ea0ae None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:46.957499 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43443991-40fd-4920-8b71-17051d2938a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:46.958733 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43443991-40fd-4920-8b71-17051d2938a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:46.958733 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43443991-40fd-4920-8b71-17051d2938a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:46.958988 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43443991-40fd-4920-8b71-17051d2938a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:46.959726 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43443991-40fd-4920-8b71-17051d2938a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:32:46.960031 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43443991-40fd-4920-8b71-17051d2938a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:46.962428 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43443991-40fd-4920-8b71-17051d2938a6 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:46.975294 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1337/2682] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:32:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:32:46.980680 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea9799-d56e-4b26-8fbe-583c4f8699bd None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:46.991835 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea9799-d56e-4b26-8fbe-583c4f8699bd None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:47.005386 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257d6c5-82c5-4f45-8183-ece4307a26c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:47.006215 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257d6c5-82c5-4f45-8183-ece4307a26c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:47.010424 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257d6c5-82c5-4f45-8183-ece4307a26c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:47.010424 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257d6c5-82c5-4f45-8183-ece4307a26c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:47.010424 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5257d6c5-82c5-4f45-8183-ece4307a26c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:47.010804 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5257d6c5-82c5-4f45-8183-ece4307a26c4 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:47.110597 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1346/2683] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:32:46 2022] POST /identity/v3/projects => generated 379 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:32:47.115169 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43443991-40fd-4920-8b71-17051d2938a6 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:47.125686 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43443991-40fd-4920-8b71-17051d2938a6 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:47.191432 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47207854-e3f5-4691-b9fc-ca7e7bc31a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:47.191812 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47207854-e3f5-4691-b9fc-ca7e7bc31a41 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:47.192102 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47207854-e3f5-4691-b9fc-ca7e7bc31a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:47.192407 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47207854-e3f5-4691-b9fc-ca7e7bc31a41 admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:47.193099 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47207854-e3f5-4691-b9fc-ca7e7bc31a41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:47.195043 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47207854-e3f5-4691-b9fc-ca7e7bc31a41 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:47.276119 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1338/2684] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:32:47 2022] POST /identity/v3/users => generated 290 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:32:47.276861 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257d6c5-82c5-4f45-8183-ece4307a26c4 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:47.288977 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257d6c5-82c5-4f45-8183-ece4307a26c4 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:47.294449 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f1fe43-e8aa-4e7e-a5a6-6eb133182754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:47.295214 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f1fe43-e8aa-4e7e-a5a6-6eb133182754 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:47.295514 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f1fe43-e8aa-4e7e-a5a6-6eb133182754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:47.295790 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f1fe43-e8aa-4e7e-a5a6-6eb133182754 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:47.296718 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f1fe43-e8aa-4e7e-a5a6-6eb133182754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:47.298360 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f1fe43-e8aa-4e7e-a5a6-6eb133182754 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:47.312634 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1347/2685] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:32:47.317370 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47207854-e3f5-4691-b9fc-ca7e7bc31a41 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:47.328554 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47207854-e3f5-4691-b9fc-ca7e7bc31a41 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:47.333551 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa80a3-555d-403e-a935-1b6515dae01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:47.334805 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa80a3-555d-403e-a935-1b6515dae01f admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:47.335158 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa80a3-555d-403e-a935-1b6515dae01f admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:47.335444 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa80a3-555d-403e-a935-1b6515dae01f admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:47.336195 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa80a3-555d-403e-a935-1b6515dae01f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:47.338119 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa80a3-555d-403e-a935-1b6515dae01f admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:47.348778 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1339/2686] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:32:47.353110 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f1fe43-e8aa-4e7e-a5a6-6eb133182754 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:47.363476 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f1fe43-e8aa-4e7e-a5a6-6eb133182754 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:47.369142 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c273b3-7eb0-4f3e-9a4a-777b1de2091d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:47.370061 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c273b3-7eb0-4f3e-9a4a-777b1de2091d admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:47.370319 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c273b3-7eb0-4f3e-9a4a-777b1de2091d admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:47.372254 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c273b3-7eb0-4f3e-9a4a-777b1de2091d admin admin] PATH_INFO: `/v3/projects/ec974d85e325403687653475b20f22e1/users/6da61555127e4741add8c7cc770e5edc/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:47.386833 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c273b3-7eb0-4f3e-9a4a-777b1de2091d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec974d85e325403687653475b20f22e1, user_id=6da61555127e4741add8c7cc770e5edc, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:47.389624 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c273b3-7eb0-4f3e-9a4a-777b1de2091d admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:47.454797 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1348/2687] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:32:47 2022] PUT /identity/v3/projects/ec974d85e325403687653475b20f22e1/users/6da61555127e4741add8c7cc770e5edc/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:32:47.467364 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804208d2-bee0-4fc8-af55-799f3db6729c None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:47.467661 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804208d2-bee0-4fc8-af55-799f3db6729c None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:47.467997 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804208d2-bee0-4fc8-af55-799f3db6729c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:47.499529 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-804208d2-bee0-4fc8-af55-799f3db6729c None None] MFA Rules not processed for user `6da61555127e4741add8c7cc770e5edc`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:32:47.500796 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-804208d2-bee0-4fc8-af55-799f3db6729c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:47.537114 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:47.572833 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1340/2688] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:32:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:32:47.577240 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c273b3-7eb0-4f3e-9a4a-777b1de2091d admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:47.625629 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:47.649019 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c273b3-7eb0-4f3e-9a4a-777b1de2091d admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:47.654064 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7486fa1f-11e4-43b6-bd90-9c2b3d85ac3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:47.654844 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486fa1f-11e4-43b6-bd90-9c2b3d85ac3f admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:47.655131 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486fa1f-11e4-43b6-bd90-9c2b3d85ac3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:47.655405 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486fa1f-11e4-43b6-bd90-9c2b3d85ac3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:47.656128 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7486fa1f-11e4-43b6-bd90-9c2b3d85ac3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:47.658085 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7486fa1f-11e4-43b6-bd90-9c2b3d85ac3f admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:47.789867 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1349/2689] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:32:47 2022] POST /identity/v3/projects => generated 381 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:32:47.794195 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804208d2-bee0-4fc8-af55-799f3db6729c None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:47.804640 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804208d2-bee0-4fc8-af55-799f3db6729c None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:47.864306 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8898311-726e-431b-abdc-99fc303d8472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:47.864991 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8898311-726e-431b-abdc-99fc303d8472 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:47.865309 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8898311-726e-431b-abdc-99fc303d8472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:47.865747 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8898311-726e-431b-abdc-99fc303d8472 admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:47.866635 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8898311-726e-431b-abdc-99fc303d8472 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:47.869178 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8898311-726e-431b-abdc-99fc303d8472 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:47.996123 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1341/2690] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:32:47 2022] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:32:48.000089 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7486fa1f-11e4-43b6-bd90-9c2b3d85ac3f admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:48.017749 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7486fa1f-11e4-43b6-bd90-9c2b3d85ac3f admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:48.027577 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b94d1a-165c-4e8b-af67-be4e611f2b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:48.028641 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b94d1a-165c-4e8b-af67-be4e611f2b2c admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:48.029312 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b94d1a-165c-4e8b-af67-be4e611f2b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:48.029449 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b94d1a-165c-4e8b-af67-be4e611f2b2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:48.030562 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b94d1a-165c-4e8b-af67-be4e611f2b2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:48.032464 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b94d1a-165c-4e8b-af67-be4e611f2b2c admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:48.047918 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1350/2691] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:32:48.052902 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8898311-726e-431b-abdc-99fc303d8472 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:48.068029 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8898311-726e-431b-abdc-99fc303d8472 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:48.079491 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857a9f8-4121-47fb-8fb5-f211458b399d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:48.080920 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857a9f8-4121-47fb-8fb5-f211458b399d admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:48.081398 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857a9f8-4121-47fb-8fb5-f211458b399d admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:48.082424 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857a9f8-4121-47fb-8fb5-f211458b399d admin admin] PATH_INFO: `/v3/projects/f610b17a68d2471590a8047b44531d3d/users/91a440300e7f4688828cf2b2e2fce407/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:48.104582 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0857a9f8-4121-47fb-8fb5-f211458b399d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f610b17a68d2471590a8047b44531d3d, user_id=91a440300e7f4688828cf2b2e2fce407, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:48.107293 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0857a9f8-4121-47fb-8fb5-f211458b399d admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:48.361675 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1342/2692] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:32:48 2022] PUT /identity/v3/projects/f610b17a68d2471590a8047b44531d3d/users/91a440300e7f4688828cf2b2e2fce407/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:32:48.365472 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b94d1a-165c-4e8b-af67-be4e611f2b2c admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:48.380897 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b94d1a-165c-4e8b-af67-be4e611f2b2c admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:48.463585 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c9d95-17ff-4ea1-ba55-3bdf99ea4f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:48.464405 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c9d95-17ff-4ea1-ba55-3bdf99ea4f94 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:48.464754 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c9d95-17ff-4ea1-ba55-3bdf99ea4f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:48.465118 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c9d95-17ff-4ea1-ba55-3bdf99ea4f94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:48.466122 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249c9d95-17ff-4ea1-ba55-3bdf99ea4f94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:48.468581 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249c9d95-17ff-4ea1-ba55-3bdf99ea4f94 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:48.480060 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1351/2693] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:32:48.484472 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857a9f8-4121-47fb-8fb5-f211458b399d admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:48.495163 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857a9f8-4121-47fb-8fb5-f211458b399d admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:48.500204 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a65f91-7e3e-4a72-9a16-46b9dcb6e7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:48.501132 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a65f91-7e3e-4a72-9a16-46b9dcb6e7d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:48.501416 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a65f91-7e3e-4a72-9a16-46b9dcb6e7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:48.501693 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a65f91-7e3e-4a72-9a16-46b9dcb6e7d3 admin admin] PATH_INFO: `/v3/projects/f610b17a68d2471590a8047b44531d3d/users/91a440300e7f4688828cf2b2e2fce407/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:48.503651 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a65f91-7e3e-4a72-9a16-46b9dcb6e7d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f610b17a68d2471590a8047b44531d3d, user_id=91a440300e7f4688828cf2b2e2fce407, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:48.507206 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a65f91-7e3e-4a72-9a16-46b9dcb6e7d3 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:48.519171 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1343/2694] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:32:48 2022] PUT /identity/v3/projects/f610b17a68d2471590a8047b44531d3d/users/91a440300e7f4688828cf2b2e2fce407/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:32:48.529735 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f786a-4ddd-461f-8b31-891c1d302ba8 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:48.530206 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f786a-4ddd-461f-8b31-891c1d302ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:48.530580 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f786a-4ddd-461f-8b31-891c1d302ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:48.573069 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-ba5f786a-4ddd-461f-8b31-891c1d302ba8 None None] MFA Rules not processed for user `91a440300e7f4688828cf2b2e2fce407`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:32:48.574452 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-ba5f786a-4ddd-461f-8b31-891c1d302ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:48.661013 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1352/2695] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:32:48 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:32:48.673197 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a65f91-7e3e-4a72-9a16-46b9dcb6e7d3 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:48.675218 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-68a65f91-7e3e-4a72-9a16-46b9dcb6e7d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:48.747413 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a65f91-7e3e-4a72-9a16-46b9dcb6e7d3 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:48.751627 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd1d095-5cec-4fde-8641-049e54f0569e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:48.752862 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1d095-5cec-4fde-8641-049e54f0569e service cinder] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:48.752862 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1d095-5cec-4fde-8641-049e54f0569e service cinder] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:48.759046 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1d095-5cec-4fde-8641-049e54f0569e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:48.765645 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd1d095-5cec-4fde-8641-049e54f0569e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:48.767089 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd1d095-5cec-4fde-8641-049e54f0569e service cinder] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:48.780658 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1344/2696] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:32:48 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:32:49.332458 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f786a-4ddd-461f-8b31-891c1d302ba8 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:49.405245 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:49.447282 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f786a-4ddd-461f-8b31-891c1d302ba8 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:49.453816 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b54b2-c9ed-48d2-bc00-1afe082300fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:49.463916 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b54b2-c9ed-48d2-bc00-1afe082300fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:49.463916 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b54b2-c9ed-48d2-bc00-1afe082300fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:49.463916 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b54b2-c9ed-48d2-bc00-1afe082300fb admin admin] PATH_INFO: `/v3/users/6da61555127e4741add8c7cc770e5edc` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:49.463916 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b54b2-c9ed-48d2-bc00-1afe082300fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6da61555127e4741add8c7cc770e5edc)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:49.463916 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b54b2-c9ed-48d2-bc00-1afe082300fb admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:49.650274 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-cf8b54b2-c9ed-48d2-bc00-1afe082300fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6da61555127e4741add8c7cc770e5edc'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:49.662291 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-cf8b54b2-c9ed-48d2-bc00-1afe082300fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6da61555127e4741add8c7cc770e5edc'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:49.667064 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-cf8b54b2-c9ed-48d2-bc00-1afe082300fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6da61555127e4741add8c7cc770e5edc'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:49.670496 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-cf8b54b2-c9ed-48d2-bc00-1afe082300fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6da61555127e4741add8c7cc770e5edc'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:49.671185 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-cf8b54b2-c9ed-48d2-bc00-1afe082300fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6da61555127e4741add8c7cc770e5edc'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:49.742327 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1353/2697] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:32:49 2022] DELETE /identity/v3/users/6da61555127e4741add8c7cc770e5edc => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:32:49.746844 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b184461-1795-4ecd-8864-c5403501f306 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:49.747314 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b184461-1795-4ecd-8864-c5403501f306 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:49.747435 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b184461-1795-4ecd-8864-c5403501f306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:49.766839 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-0b184461-1795-4ecd-8864-c5403501f306 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:32:49.768028 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-0b184461-1795-4ecd-8864-c5403501f306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:49.793117 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:49.830905 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1345/2698] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:32:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:32:49.841086 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b54b2-c9ed-48d2-bc00-1afe082300fb admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:49.842508 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-cf8b54b2-c9ed-48d2-bc00-1afe082300fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:49.907355 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b54b2-c9ed-48d2-bc00-1afe082300fb admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:49.918591 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd54db5-43a2-49b3-9a0d-e8527d9e194b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:49.918591 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd54db5-43a2-49b3-9a0d-e8527d9e194b service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:49.918591 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd54db5-43a2-49b3-9a0d-e8527d9e194b service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:49.918591 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd54db5-43a2-49b3-9a0d-e8527d9e194b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:49.922088 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd54db5-43a2-49b3-9a0d-e8527d9e194b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:49.923545 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd54db5-43a2-49b3-9a0d-e8527d9e194b service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:49.933554 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1354/2699] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:32:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:32:50.515198 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b184461-1795-4ecd-8864-c5403501f306 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:50.517526 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-0b184461-1795-4ecd-8864-c5403501f306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:50.529895 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b184461-1795-4ecd-8864-c5403501f306 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:50.536173 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3619c-cbf4-4f3b-ba87-97c4b2f571ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:50.537663 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3619c-cbf4-4f3b-ba87-97c4b2f571ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:50.538176 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3619c-cbf4-4f3b-ba87-97c4b2f571ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:50.538676 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3619c-cbf4-4f3b-ba87-97c4b2f571ee admin admin] PATH_INFO: `/v3/projects/ec974d85e325403687653475b20f22e1` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:50.541667 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b3619c-cbf4-4f3b-ba87-97c4b2f571ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec974d85e325403687653475b20f22e1)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:50.543909 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b3619c-cbf4-4f3b-ba87-97c4b2f571ee admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:50.683147 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-b1b3619c-cbf4-4f3b-ba87-97c4b2f571ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec974d85e325403687653475b20f22e1', 'request_id': 'req-b1b3619c-cbf4-4f3b-ba87-97c4b2f571ee'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:50.783502 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-b1b3619c-cbf4-4f3b-ba87-97c4b2f571ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec974d85e325403687653475b20f22e1', 'request_id': 'req-b1b3619c-cbf4-4f3b-ba87-97c4b2f571ee'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:50.793640 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-b1b3619c-cbf4-4f3b-ba87-97c4b2f571ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec974d85e325403687653475b20f22e1', 'request_id': 'req-b1b3619c-cbf4-4f3b-ba87-97c4b2f571ee'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:50.810163 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-b1b3619c-cbf4-4f3b-ba87-97c4b2f571ee admin admin] The token cache is being invalidate because project ec974d85e325403687653475b20f22e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:32:50.810461 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-b1b3619c-cbf4-4f3b-ba87-97c4b2f571ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:50.811131 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-b1b3619c-cbf4-4f3b-ba87-97c4b2f571ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:50.813152 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1346/2700] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:32:50 2022] DELETE /identity/v3/projects/ec974d85e325403687653475b20f22e1 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:32:50.816935 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd54db5-43a2-49b3-9a0d-e8527d9e194b service neutron] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:50.828129 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd54db5-43a2-49b3-9a0d-e8527d9e194b service neutron] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:50.887034 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:50.900229 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1a879-fd23-4ae2-85f7-8833c501e97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:50.900229 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1a879-fd23-4ae2-85f7-8833c501e97b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:50.900229 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1a879-fd23-4ae2-85f7-8833c501e97b admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:50.900229 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1a879-fd23-4ae2-85f7-8833c501e97b admin admin] PATH_INFO: `/v3/users/91a440300e7f4688828cf2b2e2fce407` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:50.901147 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc1a879-fd23-4ae2-85f7-8833c501e97b admin admin] RBAC: Authorizing `identity:delete_user(user_id=91a440300e7f4688828cf2b2e2fce407)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:50.903242 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc1a879-fd23-4ae2-85f7-8833c501e97b admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:51.130481 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-0bc1a879-fd23-4ae2-85f7-8833c501e97b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91a440300e7f4688828cf2b2e2fce407'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:51.144561 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-0bc1a879-fd23-4ae2-85f7-8833c501e97b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91a440300e7f4688828cf2b2e2fce407'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:51.145407 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-0bc1a879-fd23-4ae2-85f7-8833c501e97b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91a440300e7f4688828cf2b2e2fce407'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:51.153112 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-0bc1a879-fd23-4ae2-85f7-8833c501e97b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91a440300e7f4688828cf2b2e2fce407'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:51.153787 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-0bc1a879-fd23-4ae2-85f7-8833c501e97b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91a440300e7f4688828cf2b2e2fce407'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:51.256939 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1355/2701] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:32:50 2022] DELETE /identity/v3/users/91a440300e7f4688828cf2b2e2fce407 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:32:51.683597 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3619c-cbf4-4f3b-ba87-97c4b2f571ee admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:51.685585 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-b1b3619c-cbf4-4f3b-ba87-97c4b2f571ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:51.713002 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3619c-cbf4-4f3b-ba87-97c4b2f571ee admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:51.777926 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4dbf39-c1a1-4444-9395-d0039ad2c358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:51.778798 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4dbf39-c1a1-4444-9395-d0039ad2c358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:51.779084 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4dbf39-c1a1-4444-9395-d0039ad2c358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:51.779364 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4dbf39-c1a1-4444-9395-d0039ad2c358 admin admin] PATH_INFO: `/v3/projects/f610b17a68d2471590a8047b44531d3d` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:51.780661 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4dbf39-c1a1-4444-9395-d0039ad2c358 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f610b17a68d2471590a8047b44531d3d)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:51.782502 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4dbf39-c1a1-4444-9395-d0039ad2c358 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:51.945554 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-ab4dbf39-c1a1-4444-9395-d0039ad2c358 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f610b17a68d2471590a8047b44531d3d', 'request_id': 'req-ab4dbf39-c1a1-4444-9395-d0039ad2c358'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:51.950997 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:52.056518 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-ab4dbf39-c1a1-4444-9395-d0039ad2c358 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f610b17a68d2471590a8047b44531d3d', 'request_id': 'req-ab4dbf39-c1a1-4444-9395-d0039ad2c358'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:52.068341 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-ab4dbf39-c1a1-4444-9395-d0039ad2c358 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f610b17a68d2471590a8047b44531d3d', 'request_id': 'req-ab4dbf39-c1a1-4444-9395-d0039ad2c358'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:52.081056 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-ab4dbf39-c1a1-4444-9395-d0039ad2c358 admin admin] The token cache is being invalidate because project f610b17a68d2471590a8047b44531d3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:32:52.081246 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-ab4dbf39-c1a1-4444-9395-d0039ad2c358 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:52.081913 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-ab4dbf39-c1a1-4444-9395-d0039ad2c358 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:52.083721 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1347/2702] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:32:51 2022] DELETE /identity/v3/projects/f610b17a68d2471590a8047b44531d3d => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:32:52.092048 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9cd9cf-bfcd-4a42-95e1-a882be9e2e57 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:52.092773 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9cd9cf-bfcd-4a42-95e1-a882be9e2e57 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:52.092773 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9cd9cf-bfcd-4a42-95e1-a882be9e2e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:52.113435 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-8b9cd9cf-bfcd-4a42-95e1-a882be9e2e57 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:32:52.114663 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-8b9cd9cf-bfcd-4a42-95e1-a882be9e2e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:52.189185 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1356/2703] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:32:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:32:52.197651 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51559f8-ff96-4d3c-8fe9-440e7ecdc560 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:52.198106 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51559f8-ff96-4d3c-8fe9-440e7ecdc560 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:52.198469 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51559f8-ff96-4d3c-8fe9-440e7ecdc560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:52.218392 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-f51559f8-ff96-4d3c-8fe9-440e7ecdc560 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:32:52.219718 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-f51559f8-ff96-4d3c-8fe9-440e7ecdc560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:52.229653 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1348/2704] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:32:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:32:52.236084 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9cd9cf-bfcd-4a42-95e1-a882be9e2e57 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:52.246198 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9cd9cf-bfcd-4a42-95e1-a882be9e2e57 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:52.250867 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa2732-c96d-4d4b-9ab7-ceb52b9d501a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:52.252716 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa2732-c96d-4d4b-9ab7-ceb52b9d501a admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:52.253010 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa2732-c96d-4d4b-9ab7-ceb52b9d501a admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:52.253293 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa2732-c96d-4d4b-9ab7-ceb52b9d501a admin admin] PATH_INFO: `/v3/domains` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:52.254286 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa2732-c96d-4d4b-9ab7-ceb52b9d501a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:32:52.254604 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa2732-c96d-4d4b-9ab7-ceb52b9d501a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:52.256231 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa2732-c96d-4d4b-9ab7-ceb52b9d501a admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:52.272679 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1357/2705] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:32:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:32:52.274039 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51559f8-ff96-4d3c-8fe9-440e7ecdc560 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:52.280267 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa2732-c96d-4d4b-9ab7-ceb52b9d501a admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:52.281972 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-6aaa2732-c96d-4d4b-9ab7-ceb52b9d501a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:52.284648 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51559f8-ff96-4d3c-8fe9-440e7ecdc560 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:52.291466 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391ea0c-64a3-4b91-870f-52dc6acb05ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:52.292357 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391ea0c-64a3-4b91-870f-52dc6acb05ae admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:52.292986 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391ea0c-64a3-4b91-870f-52dc6acb05ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:52.293435 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391ea0c-64a3-4b91-870f-52dc6acb05ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:52.294968 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5391ea0c-64a3-4b91-870f-52dc6acb05ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:52.297236 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5391ea0c-64a3-4b91-870f-52dc6acb05ae admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:52.347619 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa2732-c96d-4d4b-9ab7-ceb52b9d501a admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:52.351347 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0b4f7-3276-4ad8-97e9-2185ed8e3d71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:52.351994 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0b4f7-3276-4ad8-97e9-2185ed8e3d71 service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:52.352313 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0b4f7-3276-4ad8-97e9-2185ed8e3d71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:52.353316 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0b4f7-3276-4ad8-97e9-2185ed8e3d71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:52.355309 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-dcc0b4f7-3276-4ad8-97e9-2185ed8e3d71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:52.368176 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:52.396347 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1349/2706] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:32:52 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:32:52.400935 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391ea0c-64a3-4b91-870f-52dc6acb05ae admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:52.430084 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc0b4f7-3276-4ad8-97e9-2185ed8e3d71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:52.431940 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc0b4f7-3276-4ad8-97e9-2185ed8e3d71 service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:52.442308 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1358/2707] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:32:52 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:32:52.492695 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391ea0c-64a3-4b91-870f-52dc6acb05ae admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:52.501219 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb497f84-9b55-46c2-b4b1-a5e3dbb30a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:52.502121 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb497f84-9b55-46c2-b4b1-a5e3dbb30a1a admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:52.503098 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb497f84-9b55-46c2-b4b1-a5e3dbb30a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:52.503538 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb497f84-9b55-46c2-b4b1-a5e3dbb30a1a admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:52.504680 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb497f84-9b55-46c2-b4b1-a5e3dbb30a1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:52.513787 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb497f84-9b55-46c2-b4b1-a5e3dbb30a1a admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:52.597597 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1350/2708] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:32:52 2022] POST /identity/v3/users => generated 287 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:32:52.598951 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0b4f7-3276-4ad8-97e9-2185ed8e3d71 service neutron] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:52.610140 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0b4f7-3276-4ad8-97e9-2185ed8e3d71 service neutron] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:52.614755 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d7f68-54e0-4560-b3de-44fa33de9204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:52.615417 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d7f68-54e0-4560-b3de-44fa33de9204 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:52.615697 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d7f68-54e0-4560-b3de-44fa33de9204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:52.616053 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d7f68-54e0-4560-b3de-44fa33de9204 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:52.616848 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7d7f68-54e0-4560-b3de-44fa33de9204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:52.618626 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7d7f68-54e0-4560-b3de-44fa33de9204 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:52.629551 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1359/2709] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:32:52.633579 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb497f84-9b55-46c2-b4b1-a5e3dbb30a1a admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:52.644102 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb497f84-9b55-46c2-b4b1-a5e3dbb30a1a admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:52.650038 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3caba2e-f1a1-4246-bb59-89048e8a847b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:52.650310 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3caba2e-f1a1-4246-bb59-89048e8a847b admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:52.650479 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3caba2e-f1a1-4246-bb59-89048e8a847b admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:52.650744 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3caba2e-f1a1-4246-bb59-89048e8a847b admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:52.651474 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3caba2e-f1a1-4246-bb59-89048e8a847b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:52.653110 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3caba2e-f1a1-4246-bb59-89048e8a847b admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:52.669092 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1351/2710] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:32:52.677595 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d7f68-54e0-4560-b3de-44fa33de9204 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:52.687808 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d7f68-54e0-4560-b3de-44fa33de9204 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:52.694579 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1594da-4f55-4265-af64-a30a3fc3fcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:52.695349 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1594da-4f55-4265-af64-a30a3fc3fcaa admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:52.695638 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1594da-4f55-4265-af64-a30a3fc3fcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:52.695910 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1594da-4f55-4265-af64-a30a3fc3fcaa admin admin] PATH_INFO: `/v3/projects/c2b8b38665af4a6f980a17e1cf3896fa/users/db3b6fac1ebc421495b4055ad785a774/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:52.716818 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1594da-4f55-4265-af64-a30a3fc3fcaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2b8b38665af4a6f980a17e1cf3896fa, user_id=db3b6fac1ebc421495b4055ad785a774, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:52.719726 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1594da-4f55-4265-af64-a30a3fc3fcaa admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:52.828628 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1360/2711] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:32:52 2022] PUT /identity/v3/projects/c2b8b38665af4a6f980a17e1cf3896fa/users/db3b6fac1ebc421495b4055ad785a774/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:32:52.841210 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352afa99-8ba7-4af3-9f57-fb7191d992b9 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:52.841449 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352afa99-8ba7-4af3-9f57-fb7191d992b9 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:52.841725 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352afa99-8ba7-4af3-9f57-fb7191d992b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:52.869531 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-352afa99-8ba7-4af3-9f57-fb7191d992b9 None None] MFA Rules not processed for user `db3b6fac1ebc421495b4055ad785a774`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:32:52.872416 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-352afa99-8ba7-4af3-9f57-fb7191d992b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:52.940949 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1352/2712] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:32:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:32:52.953026 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1594da-4f55-4265-af64-a30a3fc3fcaa admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:52.954693 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-be1594da-4f55-4265-af64-a30a3fc3fcaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:53.016119 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1594da-4f55-4265-af64-a30a3fc3fcaa admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:53.019994 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7db65a-a494-4a2e-ba74-1b08b1a79eb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:53.020784 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7db65a-a494-4a2e-ba74-1b08b1a79eb4 service cinder] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:53.021070 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7db65a-a494-4a2e-ba74-1b08b1a79eb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:53.024974 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7db65a-a494-4a2e-ba74-1b08b1a79eb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:53.033016 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7db65a-a494-4a2e-ba74-1b08b1a79eb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:53.034641 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7db65a-a494-4a2e-ba74-1b08b1a79eb4 service cinder] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:53.045876 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1361/2713] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:32:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:32:53.066739 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352afa99-8ba7-4af3-9f57-fb7191d992b9 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:53.099279 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:53.146693 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352afa99-8ba7-4af3-9f57-fb7191d992b9 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:53.153580 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256e30a-301b-440c-a426-30362a4d6403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:53.154310 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256e30a-301b-440c-a426-30362a4d6403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:53.154596 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256e30a-301b-440c-a426-30362a4d6403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:53.154925 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256e30a-301b-440c-a426-30362a4d6403 admin admin] PATH_INFO: `/v3/users/db3b6fac1ebc421495b4055ad785a774` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:53.157070 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9256e30a-301b-440c-a426-30362a4d6403 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db3b6fac1ebc421495b4055ad785a774)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:53.159160 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9256e30a-301b-440c-a426-30362a4d6403 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:53.369230 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-9256e30a-301b-440c-a426-30362a4d6403 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db3b6fac1ebc421495b4055ad785a774'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:53.381360 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-9256e30a-301b-440c-a426-30362a4d6403 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db3b6fac1ebc421495b4055ad785a774'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:53.382097 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-9256e30a-301b-440c-a426-30362a4d6403 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db3b6fac1ebc421495b4055ad785a774'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:53.389768 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-9256e30a-301b-440c-a426-30362a4d6403 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db3b6fac1ebc421495b4055ad785a774'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:53.390653 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-9256e30a-301b-440c-a426-30362a4d6403 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db3b6fac1ebc421495b4055ad785a774'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:53.472828 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1353/2714] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:32:53 2022] DELETE /identity/v3/users/db3b6fac1ebc421495b4055ad785a774 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:32:53.477461 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bffba3-c84b-4ac4-9a84-1bf47369db21 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:53.477948 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bffba3-c84b-4ac4-9a84-1bf47369db21 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:53.481229 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bffba3-c84b-4ac4-9a84-1bf47369db21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:53.496838 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-c4bffba3-c84b-4ac4-9a84-1bf47369db21 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:32:53.498056 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-c4bffba3-c84b-4ac4-9a84-1bf47369db21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:53.556849 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1362/2715] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:32:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:32:53.566622 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256e30a-301b-440c-a426-30362a4d6403 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:53.568095 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-9256e30a-301b-440c-a426-30362a4d6403 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:53.628439 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256e30a-301b-440c-a426-30362a4d6403 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:53.634598 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130aabe6-9921-4b55-b628-bc4c567fc3f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:53.635468 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130aabe6-9921-4b55-b628-bc4c567fc3f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:53.635763 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130aabe6-9921-4b55-b628-bc4c567fc3f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:53.636039 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130aabe6-9921-4b55-b628-bc4c567fc3f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:53.645515 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130aabe6-9921-4b55-b628-bc4c567fc3f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:53.647259 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130aabe6-9921-4b55-b628-bc4c567fc3f0 service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:53.658376 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1354/2716] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:32:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:32:54.234605 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bffba3-c84b-4ac4-9a84-1bf47369db21 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:54.236167 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-c4bffba3-c84b-4ac4-9a84-1bf47369db21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:54.248192 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bffba3-c84b-4ac4-9a84-1bf47369db21 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:54.252973 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2534d7f-d1b7-42d9-a76a-c00021f97156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:54.254079 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2534d7f-d1b7-42d9-a76a-c00021f97156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:54.254366 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2534d7f-d1b7-42d9-a76a-c00021f97156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:54.254636 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2534d7f-d1b7-42d9-a76a-c00021f97156 admin admin] PATH_INFO: `/v3/projects/c2b8b38665af4a6f980a17e1cf3896fa` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:54.255810 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2534d7f-d1b7-42d9-a76a-c00021f97156 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2b8b38665af4a6f980a17e1cf3896fa)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:54.257756 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2534d7f-d1b7-42d9-a76a-c00021f97156 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:54.285164 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:54.381837 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-d2534d7f-d1b7-42d9-a76a-c00021f97156 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2b8b38665af4a6f980a17e1cf3896fa', 'request_id': 'req-d2534d7f-d1b7-42d9-a76a-c00021f97156'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:54.388620 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-d2534d7f-d1b7-42d9-a76a-c00021f97156 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2b8b38665af4a6f980a17e1cf3896fa', 'request_id': 'req-d2534d7f-d1b7-42d9-a76a-c00021f97156'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:54.394108 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-d2534d7f-d1b7-42d9-a76a-c00021f97156 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2b8b38665af4a6f980a17e1cf3896fa', 'request_id': 'req-d2534d7f-d1b7-42d9-a76a-c00021f97156'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:54.507014 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-d2534d7f-d1b7-42d9-a76a-c00021f97156 admin admin] The token cache is being invalidate because project c2b8b38665af4a6f980a17e1cf3896fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:32:54.507665 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-d2534d7f-d1b7-42d9-a76a-c00021f97156 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:54.507917 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-d2534d7f-d1b7-42d9-a76a-c00021f97156 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:54.510363 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1363/2717] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:32:54 2022] DELETE /identity/v3/projects/c2b8b38665af4a6f980a17e1cf3896fa => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:32:54.516754 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4f371-3c04-49d0-a484-f538d9620acc None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:54.517320 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4f371-3c04-49d0-a484-f538d9620acc None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:54.517611 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4f371-3c04-49d0-a484-f538d9620acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:54.535591 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-50b4f371-3c04-49d0-a484-f538d9620acc None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:32:54.536902 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-50b4f371-3c04-49d0-a484-f538d9620acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:54.582448 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:54.607479 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1355/2718] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:32:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:32:54.615472 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13860a3-7238-415a-8ead-2e20eb185c2c None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:54.615766 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13860a3-7238-415a-8ead-2e20eb185c2c None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:54.616046 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13860a3-7238-415a-8ead-2e20eb185c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:54.638283 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-e13860a3-7238-415a-8ead-2e20eb185c2c None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:32:54.639815 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-e13860a3-7238-415a-8ead-2e20eb185c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:54.653012 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1364/2719] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:32:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:32:54.654387 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4f371-3c04-49d0-a484-f538d9620acc None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:54.664362 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4f371-3c04-49d0-a484-f538d9620acc None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:54.669354 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56112d93-18a3-4ec8-ac8a-a097459e6da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:54.670016 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56112d93-18a3-4ec8-ac8a-a097459e6da9 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:54.670338 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56112d93-18a3-4ec8-ac8a-a097459e6da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:54.670603 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56112d93-18a3-4ec8-ac8a-a097459e6da9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:54.671560 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56112d93-18a3-4ec8-ac8a-a097459e6da9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:32:54.678531 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56112d93-18a3-4ec8-ac8a-a097459e6da9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:54.684297 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56112d93-18a3-4ec8-ac8a-a097459e6da9 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:54.694432 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1356/2720] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:32:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:32:54.699059 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13860a3-7238-415a-8ead-2e20eb185c2c None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:54.708981 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13860a3-7238-415a-8ead-2e20eb185c2c None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:54.714852 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90d453-a381-4509-80c6-fbd5ec21fde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:54.715517 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90d453-a381-4509-80c6-fbd5ec21fde3 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:54.715797 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90d453-a381-4509-80c6-fbd5ec21fde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:54.716067 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90d453-a381-4509-80c6-fbd5ec21fde3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:54.716891 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90d453-a381-4509-80c6-fbd5ec21fde3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:54.719248 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90d453-a381-4509-80c6-fbd5ec21fde3 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:54.855843 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1365/2721] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:32:54 2022] POST /identity/v3/projects => generated 371 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:32:54.860058 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56112d93-18a3-4ec8-ac8a-a097459e6da9 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:54.872372 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56112d93-18a3-4ec8-ac8a-a097459e6da9 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:54.934615 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53fd2a-466d-47a6-8f08-38683a5f07f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:54.935015 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53fd2a-466d-47a6-8f08-38683a5f07f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:54.937394 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53fd2a-466d-47a6-8f08-38683a5f07f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:54.937394 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53fd2a-466d-47a6-8f08-38683a5f07f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:54.937394 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53fd2a-466d-47a6-8f08-38683a5f07f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:54.938320 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53fd2a-466d-47a6-8f08-38683a5f07f3 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:55.019629 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1357/2722] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:32:54 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:32:55.024349 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90d453-a381-4509-80c6-fbd5ec21fde3 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:55.046242 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90d453-a381-4509-80c6-fbd5ec21fde3 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:55.066649 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81bd2ec-6d0f-4aeb-895d-53d18f1211e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:55.067837 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81bd2ec-6d0f-4aeb-895d-53d18f1211e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:55.068120 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81bd2ec-6d0f-4aeb-895d-53d18f1211e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:55.068560 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81bd2ec-6d0f-4aeb-895d-53d18f1211e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:55.070187 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81bd2ec-6d0f-4aeb-895d-53d18f1211e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:55.072606 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81bd2ec-6d0f-4aeb-895d-53d18f1211e4 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:55.087682 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1366/2723] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:32:55.091494 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53fd2a-466d-47a6-8f08-38683a5f07f3 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:55.101914 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53fd2a-466d-47a6-8f08-38683a5f07f3 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:55.109240 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f938dfc-0905-4536-9864-113ef312d2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:55.114826 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f938dfc-0905-4536-9864-113ef312d2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:55.114826 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f938dfc-0905-4536-9864-113ef312d2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:55.114826 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f938dfc-0905-4536-9864-113ef312d2e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:55.114826 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f938dfc-0905-4536-9864-113ef312d2e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:55.114826 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f938dfc-0905-4536-9864-113ef312d2e2 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:55.129548 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1358/2724] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:32:55.134353 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81bd2ec-6d0f-4aeb-895d-53d18f1211e4 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:55.143997 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81bd2ec-6d0f-4aeb-895d-53d18f1211e4 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:55.150430 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0614392-8cd4-4ee9-8789-ddd941620681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:55.152061 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0614392-8cd4-4ee9-8789-ddd941620681 admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:55.152376 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0614392-8cd4-4ee9-8789-ddd941620681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:55.152655 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0614392-8cd4-4ee9-8789-ddd941620681 admin admin] PATH_INFO: `/v3/projects/6f517e9dbca64d8fb639c832970aa90b/users/247cba05d1a5427f80d5b739f17457da/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:55.173239 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0614392-8cd4-4ee9-8789-ddd941620681 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f517e9dbca64d8fb639c832970aa90b, user_id=247cba05d1a5427f80d5b739f17457da, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:55.176059 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0614392-8cd4-4ee9-8789-ddd941620681 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:55.288217 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1367/2725] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:32:55 2022] PUT /identity/v3/projects/6f517e9dbca64d8fb639c832970aa90b/users/247cba05d1a5427f80d5b739f17457da/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:32:55.299264 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6236975-536b-4fa1-b969-417001c26099 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:55.299555 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6236975-536b-4fa1-b969-417001c26099 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:55.299839 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6236975-536b-4fa1-b969-417001c26099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:55.328222 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-b6236975-536b-4fa1-b969-417001c26099 None None] MFA Rules not processed for user `247cba05d1a5427f80d5b739f17457da`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:32:55.329450 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-b6236975-536b-4fa1-b969-417001c26099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:55.404302 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1359/2726] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:32:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:32:55.414238 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0614392-8cd4-4ee9-8789-ddd941620681 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:55.416892 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-e0614392-8cd4-4ee9-8789-ddd941620681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:55.484733 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0614392-8cd4-4ee9-8789-ddd941620681 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:55.489777 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5da64d-cb56-4b74-8ee9-8f66a9083914 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60eeb0b3e37a4604ab8f8b73c2b021f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:55.490469 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5da64d-cb56-4b74-8ee9-8f66a9083914 service glance] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:55.492733 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5da64d-cb56-4b74-8ee9-8f66a9083914 service glance] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:55.492733 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5da64d-cb56-4b74-8ee9-8f66a9083914 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:55.501339 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5da64d-cb56-4b74-8ee9-8f66a9083914 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:55.503049 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5da64d-cb56-4b74-8ee9-8f66a9083914 service glance] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:55.517387 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1368/2727] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:32:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:32:56.307153 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6236975-536b-4fa1-b969-417001c26099 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:56.311074 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-b6236975-536b-4fa1-b969-417001c26099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:56.355419 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:56.376560 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6236975-536b-4fa1-b969-417001c26099 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:56.381575 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b1854-fd54-44cd-bf41-6eda8a28fd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:56.382441 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b1854-fd54-44cd-bf41-6eda8a28fd21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:56.382749 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b1854-fd54-44cd-bf41-6eda8a28fd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:56.383024 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b1854-fd54-44cd-bf41-6eda8a28fd21 admin admin] PATH_INFO: `/v3/users/bec198ad2e044eb3a681693c73828e81` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:56.384259 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63b1854-fd54-44cd-bf41-6eda8a28fd21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bec198ad2e044eb3a681693c73828e81)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:56.386260 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63b1854-fd54-44cd-bf41-6eda8a28fd21 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:56.598195 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-b63b1854-fd54-44cd-bf41-6eda8a28fd21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bec198ad2e044eb3a681693c73828e81'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:56.609809 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-b63b1854-fd54-44cd-bf41-6eda8a28fd21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bec198ad2e044eb3a681693c73828e81'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:56.610464 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-b63b1854-fd54-44cd-bf41-6eda8a28fd21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bec198ad2e044eb3a681693c73828e81'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:56.617142 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-b63b1854-fd54-44cd-bf41-6eda8a28fd21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bec198ad2e044eb3a681693c73828e81'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:56.617759 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-b63b1854-fd54-44cd-bf41-6eda8a28fd21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bec198ad2e044eb3a681693c73828e81'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:56.693012 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1360/2728] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:32:56 2022] DELETE /identity/v3/users/bec198ad2e044eb3a681693c73828e81 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:32:56.698136 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4c9bd-6902-4201-b449-0f2bef062929 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:56.698630 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4c9bd-6902-4201-b449-0f2bef062929 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:56.699170 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4c9bd-6902-4201-b449-0f2bef062929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:56.719071 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-90b4c9bd-6902-4201-b449-0f2bef062929 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:32:56.720345 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-90b4c9bd-6902-4201-b449-0f2bef062929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:56.759288 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:32:56.791168 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1369/2729] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:32:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:32:56.806356 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b1854-fd54-44cd-bf41-6eda8a28fd21 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:56.807984 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-b63b1854-fd54-44cd-bf41-6eda8a28fd21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:56.875972 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b1854-fd54-44cd-bf41-6eda8a28fd21 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:56.879955 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2475b7f4-c43b-41d8-a9f6-d08e9e93a470 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:56.880667 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475b7f4-c43b-41d8-a9f6-d08e9e93a470 service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:56.880974 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475b7f4-c43b-41d8-a9f6-d08e9e93a470 service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:56.881254 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475b7f4-c43b-41d8-a9f6-d08e9e93a470 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:56.891516 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2475b7f4-c43b-41d8-a9f6-d08e9e93a470 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:56.896326 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2475b7f4-c43b-41d8-a9f6-d08e9e93a470 service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:56.903049 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1361/2730] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:32:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:32:57.334228 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4c9bd-6902-4201-b449-0f2bef062929 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:32:57.334228 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-90b4c9bd-6902-4201-b449-0f2bef062929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:32:57.345557 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4c9bd-6902-4201-b449-0f2bef062929 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:32:57.350241 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31100dd-82f8-4475-b57d-7bbc1a2f82cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:32:57.351175 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31100dd-82f8-4475-b57d-7bbc1a2f82cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:32:57.351631 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31100dd-82f8-4475-b57d-7bbc1a2f82cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:32:57.352042 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31100dd-82f8-4475-b57d-7bbc1a2f82cd admin admin] PATH_INFO: `/v3/projects/2da8d0a5ee504646bd3cfb527856ff6e` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:32:57.354190 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31100dd-82f8-4475-b57d-7bbc1a2f82cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2da8d0a5ee504646bd3cfb527856ff6e)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:32:57.356478 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31100dd-82f8-4475-b57d-7bbc1a2f82cd admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:32:57.480348 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-e31100dd-82f8-4475-b57d-7bbc1a2f82cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2da8d0a5ee504646bd3cfb527856ff6e', 'request_id': 'req-e31100dd-82f8-4475-b57d-7bbc1a2f82cd'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:57.486680 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-e31100dd-82f8-4475-b57d-7bbc1a2f82cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2da8d0a5ee504646bd3cfb527856ff6e', 'request_id': 'req-e31100dd-82f8-4475-b57d-7bbc1a2f82cd'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:57.493813 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-e31100dd-82f8-4475-b57d-7bbc1a2f82cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2da8d0a5ee504646bd3cfb527856ff6e', 'request_id': 'req-e31100dd-82f8-4475-b57d-7bbc1a2f82cd'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:57.604529 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-e31100dd-82f8-4475-b57d-7bbc1a2f82cd admin admin] The token cache is being invalidate because project 2da8d0a5ee504646bd3cfb527856ff6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:32:57.604842 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-e31100dd-82f8-4475-b57d-7bbc1a2f82cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:57.605468 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-e31100dd-82f8-4475-b57d-7bbc1a2f82cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:32:57.607250 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1370/2731] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:32:57 2022] DELETE /identity/v3/projects/2da8d0a5ee504646bd3cfb527856ff6e => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:33:03.674932 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2475b7f4-c43b-41d8-a9f6-d08e9e93a470 service neutron] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:33:03.676507 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-2475b7f4-c43b-41d8-a9f6-d08e9e93a470 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:33:03.744447 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2475b7f4-c43b-41d8-a9f6-d08e9e93a470 service neutron] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:33:03.759646 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:33:03.799084 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa9988-bc03-4113-a9ca-6966ce26e634 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:33:03.799740 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa9988-bc03-4113-a9ca-6966ce26e634 service cinder] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:33:03.800024 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa9988-bc03-4113-a9ca-6966ce26e634 service cinder] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:33:03.800339 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa9988-bc03-4113-a9ca-6966ce26e634 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:33:03.802180 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-a8fa9988-bc03-4113-a9ca-6966ce26e634 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:33:03.893359 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa9988-bc03-4113-a9ca-6966ce26e634 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:33:03.894793 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa9988-bc03-4113-a9ca-6966ce26e634 service cinder] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:33:03.915582 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1362/2732] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:33:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:33:06.671900 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31100dd-82f8-4475-b57d-7bbc1a2f82cd admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:33:06.673539 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-e31100dd-82f8-4475-b57d-7bbc1a2f82cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:33:06.732670 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31100dd-82f8-4475-b57d-7bbc1a2f82cd admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:33:06.736353 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76734afb-af4a-4f74-9862-2130c0e32a9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:33:06.737046 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76734afb-af4a-4f74-9862-2130c0e32a9a service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:33:06.737325 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76734afb-af4a-4f74-9862-2130c0e32a9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:33:06.737597 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76734afb-af4a-4f74-9862-2130c0e32a9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:33:06.739463 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-76734afb-af4a-4f74-9862-2130c0e32a9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:33:06.803006 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76734afb-af4a-4f74-9862-2130c0e32a9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:33:06.804543 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76734afb-af4a-4f74-9862-2130c0e32a9a service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:33:06.815810 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1371/2733] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:33:06 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:33:13.912416 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=53 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:33:16.014499 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa9988-bc03-4113-a9ca-6966ce26e634 service cinder] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:33:16.015955 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-a8fa9988-bc03-4113-a9ca-6966ce26e634 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:33:16.100850 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa9988-bc03-4113-a9ca-6966ce26e634 service cinder] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:33:16.107052 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9981d-b6ae-4e1e-9056-f501b3744136 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066aaba3e9af4f85ab0cba89a3d32e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:33:16.107812 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9981d-b6ae-4e1e-9056-f501b3744136 service nova] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:33:16.108195 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9981d-b6ae-4e1e-9056-f501b3744136 service nova] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:33:16.108540 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9981d-b6ae-4e1e-9056-f501b3744136 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:33:16.113660 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-d3e9981d-b6ae-4e1e-9056-f501b3744136 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:33:16.139609 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9981d-b6ae-4e1e-9056-f501b3744136 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:33:16.141435 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9981d-b6ae-4e1e-9056-f501b3744136 service nova] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:33:16.156331 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1363/2734] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:33:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:33:16.810595 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:33:22.075688 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76734afb-af4a-4f74-9862-2130c0e32a9a service neutron] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:33:22.077103 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-76734afb-af4a-4f74-9862-2130c0e32a9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:33:22.088900 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76734afb-af4a-4f74-9862-2130c0e32a9a service neutron] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:33:22.092578 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d05a5-38bd-4716-a214-b9224db136ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:33:22.093217 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d05a5-38bd-4716-a214-b9224db136ac service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:33:22.093500 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d05a5-38bd-4716-a214-b9224db136ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:33:22.093775 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d05a5-38bd-4716-a214-b9224db136ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:33:22.095901 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-ff9d05a5-38bd-4716-a214-b9224db136ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:33:22.159979 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9d05a5-38bd-4716-a214-b9224db136ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:33:22.161454 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9d05a5-38bd-4716-a214-b9224db136ac service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:33:22.171381 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1372/2735] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:33:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:33:25.944050 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9981d-b6ae-4e1e-9056-f501b3744136 service nova] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:33:25.945630 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-d3e9981d-b6ae-4e1e-9056-f501b3744136 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:33:25.964408 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9981d-b6ae-4e1e-9056-f501b3744136 service nova] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:33:25.969009 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba384a1e-c59b-4ac4-9304-60fc6893c11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:33:25.969903 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba384a1e-c59b-4ac4-9304-60fc6893c11b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:33:25.975021 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba384a1e-c59b-4ac4-9304-60fc6893c11b admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:33:25.975021 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba384a1e-c59b-4ac4-9304-60fc6893c11b admin admin] PATH_INFO: `/v3/users/267a2b59a70245dfb7ec1b779f7fdd51` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:33:25.975021 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba384a1e-c59b-4ac4-9304-60fc6893c11b admin admin] RBAC: Authorizing `identity:delete_user(user_id=267a2b59a70245dfb7ec1b779f7fdd51)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:33:25.975021 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba384a1e-c59b-4ac4-9304-60fc6893c11b admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:33:26.166130 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-ba384a1e-c59b-4ac4-9304-60fc6893c11b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '267a2b59a70245dfb7ec1b779f7fdd51'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:33:26.177787 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-ba384a1e-c59b-4ac4-9304-60fc6893c11b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '267a2b59a70245dfb7ec1b779f7fdd51'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:33:26.178458 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-ba384a1e-c59b-4ac4-9304-60fc6893c11b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '267a2b59a70245dfb7ec1b779f7fdd51'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:33:26.185889 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-ba384a1e-c59b-4ac4-9304-60fc6893c11b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '267a2b59a70245dfb7ec1b779f7fdd51'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:33:26.186529 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-ba384a1e-c59b-4ac4-9304-60fc6893c11b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '267a2b59a70245dfb7ec1b779f7fdd51'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:33:26.261037 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1364/2736] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:33:25 2022] DELETE /identity/v3/users/267a2b59a70245dfb7ec1b779f7fdd51 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:33:26.493829 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d05a5-38bd-4716-a214-b9224db136ac service neutron] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:33:26.504172 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d05a5-38bd-4716-a214-b9224db136ac service neutron] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:33:26.564541 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0550f0f3-4d2b-4430-98e0-5253dcf4f03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:33:26.565391 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550f0f3-4d2b-4430-98e0-5253dcf4f03b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:33:26.565674 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550f0f3-4d2b-4430-98e0-5253dcf4f03b admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:33:26.565962 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550f0f3-4d2b-4430-98e0-5253dcf4f03b admin admin] PATH_INFO: `/v3/projects/8468b823dd4e408c98dc1eb01f3019c7` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:33:26.567136 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0550f0f3-4d2b-4430-98e0-5253dcf4f03b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8468b823dd4e408c98dc1eb01f3019c7)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:33:26.569072 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0550f0f3-4d2b-4430-98e0-5253dcf4f03b admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:33:26.678368 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-0550f0f3-4d2b-4430-98e0-5253dcf4f03b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8468b823dd4e408c98dc1eb01f3019c7', 'request_id': 'req-0550f0f3-4d2b-4430-98e0-5253dcf4f03b'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:33:26.685220 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-0550f0f3-4d2b-4430-98e0-5253dcf4f03b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8468b823dd4e408c98dc1eb01f3019c7', 'request_id': 'req-0550f0f3-4d2b-4430-98e0-5253dcf4f03b'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:33:26.690740 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-0550f0f3-4d2b-4430-98e0-5253dcf4f03b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8468b823dd4e408c98dc1eb01f3019c7', 'request_id': 'req-0550f0f3-4d2b-4430-98e0-5253dcf4f03b'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:33:26.762867 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-0550f0f3-4d2b-4430-98e0-5253dcf4f03b admin admin] The token cache is being invalidate because project 8468b823dd4e408c98dc1eb01f3019c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:33:26.763148 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-0550f0f3-4d2b-4430-98e0-5253dcf4f03b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:33:26.763760 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-0550f0f3-4d2b-4430-98e0-5253dcf4f03b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:33:26.765383 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1373/2737] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:33:26 2022] DELETE /identity/v3/projects/8468b823dd4e408c98dc1eb01f3019c7 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:33:26.770471 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0b129-1490-48af-ab41-60de53e0ff8a None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:33:26.770760 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0b129-1490-48af-ab41-60de53e0ff8a None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:33:26.771037 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0b129-1490-48af-ab41-60de53e0ff8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:33:26.789214 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-9cf0b129-1490-48af-ab41-60de53e0ff8a None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:33:26.790490 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-9cf0b129-1490-48af-ab41-60de53e0ff8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:33:26.840863 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:33:26.850051 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1365/2738] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:33:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:33:26.859557 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0091bf-ff6a-4aef-a608-9aa9e13a5a4d None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:33:26.859841 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0091bf-ff6a-4aef-a608-9aa9e13a5a4d None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:33:26.860121 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0091bf-ff6a-4aef-a608-9aa9e13a5a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:33:26.878941 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-0e0091bf-ff6a-4aef-a608-9aa9e13a5a4d None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:33:26.880465 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-0e0091bf-ff6a-4aef-a608-9aa9e13a5a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:33:26.888585 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1374/2739] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:33:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:33:26.892718 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0b129-1490-48af-ab41-60de53e0ff8a None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:33:26.903744 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0b129-1490-48af-ab41-60de53e0ff8a None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:33:26.908431 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979b110-7a01-496a-bbf2-1b7f865a4db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:33:26.910506 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979b110-7a01-496a-bbf2-1b7f865a4db5 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:33:26.910506 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979b110-7a01-496a-bbf2-1b7f865a4db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:33:26.910506 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979b110-7a01-496a-bbf2-1b7f865a4db5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:33:26.910506 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7979b110-7a01-496a-bbf2-1b7f865a4db5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:33:26.910927 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7979b110-7a01-496a-bbf2-1b7f865a4db5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:33:26.912201 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7979b110-7a01-496a-bbf2-1b7f865a4db5 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:33:26.924316 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1366/2740] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:33:26.928612 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0091bf-ff6a-4aef-a608-9aa9e13a5a4d None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:33:26.938222 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0091bf-ff6a-4aef-a608-9aa9e13a5a4d None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:33:26.942951 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa742b4-9e17-4526-aa08-dea0f67ef876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:33:26.943585 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa742b4-9e17-4526-aa08-dea0f67ef876 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:33:26.943866 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa742b4-9e17-4526-aa08-dea0f67ef876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:33:26.944157 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa742b4-9e17-4526-aa08-dea0f67ef876 admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:33:26.944849 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa742b4-9e17-4526-aa08-dea0f67ef876 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:33:26.946761 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa742b4-9e17-4526-aa08-dea0f67ef876 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:33:26.961106 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:33:27.083591 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1375/2741] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:33:26 2022] POST /identity/v3/projects => generated 373 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:33:27.086988 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979b110-7a01-496a-bbf2-1b7f865a4db5 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:33:27.097511 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979b110-7a01-496a-bbf2-1b7f865a4db5 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:33:27.154341 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871487b0-b8ca-440e-8f07-50dd0816be32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:33:27.155016 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871487b0-b8ca-440e-8f07-50dd0816be32 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:33:27.155299 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871487b0-b8ca-440e-8f07-50dd0816be32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:33:27.155573 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871487b0-b8ca-440e-8f07-50dd0816be32 admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:33:27.156275 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871487b0-b8ca-440e-8f07-50dd0816be32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:33:27.158168 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871487b0-b8ca-440e-8f07-50dd0816be32 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:33:27.223253 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1367/2742] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:33:27 2022] POST /identity/v3/users => generated 287 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:33:27.227415 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa742b4-9e17-4526-aa08-dea0f67ef876 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:33:27.237738 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa742b4-9e17-4526-aa08-dea0f67ef876 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:33:27.242533 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1540eba0-cf91-4040-9bae-7d7655b1699e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:33:27.243177 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540eba0-cf91-4040-9bae-7d7655b1699e admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:33:27.243457 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540eba0-cf91-4040-9bae-7d7655b1699e admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:33:27.243774 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540eba0-cf91-4040-9bae-7d7655b1699e admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:33:27.244517 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1540eba0-cf91-4040-9bae-7d7655b1699e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:33:27.246190 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1540eba0-cf91-4040-9bae-7d7655b1699e admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:33:27.256816 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1376/2743] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:33:27.261319 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871487b0-b8ca-440e-8f07-50dd0816be32 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:33:27.271691 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871487b0-b8ca-440e-8f07-50dd0816be32 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:33:27.277089 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f368279-fe86-44ba-9c28-48b3a56ae2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:33:27.277741 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f368279-fe86-44ba-9c28-48b3a56ae2ce admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:33:27.278039 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f368279-fe86-44ba-9c28-48b3a56ae2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:33:27.278306 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f368279-fe86-44ba-9c28-48b3a56ae2ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:33:27.279042 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f368279-fe86-44ba-9c28-48b3a56ae2ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:33:27.280667 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f368279-fe86-44ba-9c28-48b3a56ae2ce admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:33:27.290658 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1368/2744] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:33:27.294648 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1540eba0-cf91-4040-9bae-7d7655b1699e admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:33:27.304701 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1540eba0-cf91-4040-9bae-7d7655b1699e admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:33:27.309522 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ae3e5-6229-48e9-ba26-79f90827a1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:33:27.310392 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ae3e5-6229-48e9-ba26-79f90827a1e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:33:27.310674 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ae3e5-6229-48e9-ba26-79f90827a1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:33:27.310954 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ae3e5-6229-48e9-ba26-79f90827a1e1 admin admin] PATH_INFO: `/v3/projects/7958187f70b945dbbd10f67a283f6a20/users/6136b2fd24954200b60e4371178f2040/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:33:27.325913 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614ae3e5-6229-48e9-ba26-79f90827a1e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7958187f70b945dbbd10f67a283f6a20, user_id=6136b2fd24954200b60e4371178f2040, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:33:27.328605 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614ae3e5-6229-48e9-ba26-79f90827a1e1 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:33:27.423498 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1377/2745] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:33:27 2022] PUT /identity/v3/projects/7958187f70b945dbbd10f67a283f6a20/users/6136b2fd24954200b60e4371178f2040/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:33:27.433484 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a8478-d3ac-4199-954b-ac6e2d78f27c None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:33:27.433775 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a8478-d3ac-4199-954b-ac6e2d78f27c None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:33:27.434070 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a8478-d3ac-4199-954b-ac6e2d78f27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:33:27.461254 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-d58a8478-d3ac-4199-954b-ac6e2d78f27c None None] MFA Rules not processed for user `6136b2fd24954200b60e4371178f2040`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:33:27.462636 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-d58a8478-d3ac-4199-954b-ac6e2d78f27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:33:27.529566 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1369/2746] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:33:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:33:27.534039 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ae3e5-6229-48e9-ba26-79f90827a1e1 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:33:27.596533 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ae3e5-6229-48e9-ba26-79f90827a1e1 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:33:27.601398 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbdbccd-142a-4474-a084-7e2d61e07b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:33:27.602058 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdbccd-142a-4474-a084-7e2d61e07b76 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:33:27.602345 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdbccd-142a-4474-a084-7e2d61e07b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:33:27.602624 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdbccd-142a-4474-a084-7e2d61e07b76 admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:33:27.603371 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbdbccd-142a-4474-a084-7e2d61e07b76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:33:27.605474 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbdbccd-142a-4474-a084-7e2d61e07b76 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:33:27.732568 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1378/2747] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:33:27 2022] POST /identity/v3/projects => generated 375 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:33:27.736594 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58a8478-d3ac-4199-954b-ac6e2d78f27c None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:33:27.747503 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58a8478-d3ac-4199-954b-ac6e2d78f27c None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:33:27.794815 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:33:27.803163 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ae933-824e-4f9d-828c-879f5bbc8205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:33:27.803834 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ae933-824e-4f9d-828c-879f5bbc8205 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:33:27.804112 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ae933-824e-4f9d-828c-879f5bbc8205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:33:27.804413 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ae933-824e-4f9d-828c-879f5bbc8205 admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:33:27.805086 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ae933-824e-4f9d-828c-879f5bbc8205 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:33:27.807123 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ae933-824e-4f9d-828c-879f5bbc8205 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:33:27.896322 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1370/2748] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:33:27 2022] POST /identity/v3/users => generated 294 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:33:27.900331 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbdbccd-142a-4474-a084-7e2d61e07b76 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:33:27.911525 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbdbccd-142a-4474-a084-7e2d61e07b76 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:33:27.916382 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5e8e8-240c-478f-b3c1-4ec0e0fe31ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:33:27.917174 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5e8e8-240c-478f-b3c1-4ec0e0fe31ac admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:33:27.917359 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5e8e8-240c-478f-b3c1-4ec0e0fe31ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:33:27.917609 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5e8e8-240c-478f-b3c1-4ec0e0fe31ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:33:27.918312 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b5e8e8-240c-478f-b3c1-4ec0e0fe31ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:33:27.919903 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b5e8e8-240c-478f-b3c1-4ec0e0fe31ac admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:33:27.930347 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1379/2749] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:33:27.934793 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ae933-824e-4f9d-828c-879f5bbc8205 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:33:27.944616 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ae933-824e-4f9d-828c-879f5bbc8205 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:33:27.950127 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31bcfb-37dd-4247-8c7f-08fcdac6bcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:33:27.951012 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31bcfb-37dd-4247-8c7f-08fcdac6bcf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:33:27.951297 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31bcfb-37dd-4247-8c7f-08fcdac6bcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:33:27.951598 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31bcfb-37dd-4247-8c7f-08fcdac6bcf8 admin admin] PATH_INFO: `/v3/projects/3c89666a6db043868eeb973c52808dd3/users/e6ac0f7716bf416694568331016ce566/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:33:27.967263 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a31bcfb-37dd-4247-8c7f-08fcdac6bcf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c89666a6db043868eeb973c52808dd3, user_id=e6ac0f7716bf416694568331016ce566, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:33:27.969983 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a31bcfb-37dd-4247-8c7f-08fcdac6bcf8 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:33:28.073732 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1371/2750] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:33:27 2022] PUT /identity/v3/projects/3c89666a6db043868eeb973c52808dd3/users/e6ac0f7716bf416694568331016ce566/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:33:28.077682 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5e8e8-240c-478f-b3c1-4ec0e0fe31ac admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:33:28.088301 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5e8e8-240c-478f-b3c1-4ec0e0fe31ac admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:33:28.145434 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582f170-8c1f-4a17-8ff6-9f25432133e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:33:28.146145 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582f170-8c1f-4a17-8ff6-9f25432133e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:33:28.146429 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582f170-8c1f-4a17-8ff6-9f25432133e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:33:28.146708 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582f170-8c1f-4a17-8ff6-9f25432133e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:33:28.147434 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1582f170-8c1f-4a17-8ff6-9f25432133e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:33:28.149068 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1582f170-8c1f-4a17-8ff6-9f25432133e6 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:33:28.159463 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1380/2751] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:33:28 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:33:28.163660 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31bcfb-37dd-4247-8c7f-08fcdac6bcf8 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:33:28.174564 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31bcfb-37dd-4247-8c7f-08fcdac6bcf8 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:33:28.179203 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7d7fb-543c-4d39-a1e9-4fe0ad723c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:33:28.180093 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7d7fb-543c-4d39-a1e9-4fe0ad723c1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:33:28.180399 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7d7fb-543c-4d39-a1e9-4fe0ad723c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:33:28.180676 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7d7fb-543c-4d39-a1e9-4fe0ad723c1e admin admin] PATH_INFO: `/v3/projects/3c89666a6db043868eeb973c52808dd3/users/e6ac0f7716bf416694568331016ce566/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:33:28.182695 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa7d7fb-543c-4d39-a1e9-4fe0ad723c1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c89666a6db043868eeb973c52808dd3, user_id=e6ac0f7716bf416694568331016ce566, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:33:28.185355 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa7d7fb-543c-4d39-a1e9-4fe0ad723c1e admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:33:28.195806 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1372/2752] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:33:28 2022] PUT /identity/v3/projects/3c89666a6db043868eeb973c52808dd3/users/e6ac0f7716bf416694568331016ce566/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:33:28.206516 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59808b-2400-4e13-b0e2-6e707d7fbd9f None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:33:28.206809 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59808b-2400-4e13-b0e2-6e707d7fbd9f None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:33:28.207090 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59808b-2400-4e13-b0e2-6e707d7fbd9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:33:28.233430 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-fb59808b-2400-4e13-b0e2-6e707d7fbd9f None None] MFA Rules not processed for user `e6ac0f7716bf416694568331016ce566`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:33:28.234629 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-fb59808b-2400-4e13-b0e2-6e707d7fbd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:33:28.252878 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:33:28.304566 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1381/2753] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:33:28 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:33:28.316167 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7d7fb-543c-4d39-a1e9-4fe0ad723c1e admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:33:28.317838 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-ffa7d7fb-543c-4d39-a1e9-4fe0ad723c1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:33:28.376605 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7d7fb-543c-4d39-a1e9-4fe0ad723c1e admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:33:28.380414 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091d7a5-d455-4af6-bb50-883034215540 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:33:28.381044 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091d7a5-d455-4af6-bb50-883034215540 service cinder] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:33:28.381322 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091d7a5-d455-4af6-bb50-883034215540 service cinder] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:33:28.381591 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091d7a5-d455-4af6-bb50-883034215540 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:33:28.436839 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e091d7a5-d455-4af6-bb50-883034215540 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:33:28.438265 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e091d7a5-d455-4af6-bb50-883034215540 service cinder] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:33:28.447622 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1373/2754] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:33:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:33:36.764528 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59808b-2400-4e13-b0e2-6e707d7fbd9f None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:33:36.774094 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59808b-2400-4e13-b0e2-6e707d7fbd9f None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:33:36.778309 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e356aa-5179-4af2-9bad-d8fcb95a38ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:33:36.778943 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e356aa-5179-4af2-9bad-d8fcb95a38ca service cinder] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:33:36.779226 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e356aa-5179-4af2-9bad-d8fcb95a38ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:33:36.779498 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e356aa-5179-4af2-9bad-d8fcb95a38ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:33:36.788315 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e356aa-5179-4af2-9bad-d8fcb95a38ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:33:36.789732 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e356aa-5179-4af2-9bad-d8fcb95a38ca service cinder] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:33:36.799729 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1382/2755] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:33:36 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:33:38.442933 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=68,keystone:INSERT=5 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:33:38.452286 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091d7a5-d455-4af6-bb50-883034215540 service cinder] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:33:38.453737 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-e091d7a5-d455-4af6-bb50-883034215540 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:33:38.523121 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091d7a5-d455-4af6-bb50-883034215540 service cinder] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:33:38.527728 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22343be-b86a-444a-ab67-e6e430bc9a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:33:38.528615 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22343be-b86a-444a-ab67-e6e430bc9a9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:33:38.528902 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22343be-b86a-444a-ab67-e6e430bc9a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:33:38.529179 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22343be-b86a-444a-ab67-e6e430bc9a9f admin admin] PATH_INFO: `/v3/users/247cba05d1a5427f80d5b739f17457da` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:33:38.530362 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22343be-b86a-444a-ab67-e6e430bc9a9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=247cba05d1a5427f80d5b739f17457da)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:33:38.532300 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22343be-b86a-444a-ab67-e6e430bc9a9f admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:33:38.714089 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-b22343be-b86a-444a-ab67-e6e430bc9a9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '247cba05d1a5427f80d5b739f17457da'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:33:38.726124 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-b22343be-b86a-444a-ab67-e6e430bc9a9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '247cba05d1a5427f80d5b739f17457da'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:33:38.726798 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-b22343be-b86a-444a-ab67-e6e430bc9a9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '247cba05d1a5427f80d5b739f17457da'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:33:38.734007 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-b22343be-b86a-444a-ab67-e6e430bc9a9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '247cba05d1a5427f80d5b739f17457da'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:33:38.734623 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-b22343be-b86a-444a-ab67-e6e430bc9a9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '247cba05d1a5427f80d5b739f17457da'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:33:38.814788 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1374/2756] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:33:38 2022] DELETE /identity/v3/users/247cba05d1a5427f80d5b739f17457da => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:33:38.819288 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faeae8b-2337-40dc-a033-2ded7ac00a35 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:33:38.819962 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faeae8b-2337-40dc-a033-2ded7ac00a35 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:33:38.819962 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faeae8b-2337-40dc-a033-2ded7ac00a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:33:38.838298 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-1faeae8b-2337-40dc-a033-2ded7ac00a35 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:33:38.839537 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-1faeae8b-2337-40dc-a033-2ded7ac00a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:33:38.900357 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1383/2757] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:33:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:33:38.909818 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22343be-b86a-444a-ab67-e6e430bc9a9f admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:33:38.911217 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-b22343be-b86a-444a-ab67-e6e430bc9a9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:33:38.968237 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22343be-b86a-444a-ab67-e6e430bc9a9f admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:33:38.971729 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266997c-23b3-496b-ab47-ecd596e17a35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:33:38.972390 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266997c-23b3-496b-ab47-ecd596e17a35 service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:33:38.972673 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266997c-23b3-496b-ab47-ecd596e17a35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:33:38.972946 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266997c-23b3-496b-ab47-ecd596e17a35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:33:38.982576 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5266997c-23b3-496b-ab47-ecd596e17a35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:33:38.983993 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5266997c-23b3-496b-ab47-ecd596e17a35 service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:33:38.993789 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1375/2758] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:33:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:33:39.385653 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faeae8b-2337-40dc-a033-2ded7ac00a35 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:33:39.387079 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-1faeae8b-2337-40dc-a033-2ded7ac00a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:33:39.399512 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faeae8b-2337-40dc-a033-2ded7ac00a35 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:33:39.404335 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333dab7c-c532-4288-a325-40dd621de627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:33:39.405437 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333dab7c-c532-4288-a325-40dd621de627 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:33:39.405437 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333dab7c-c532-4288-a325-40dd621de627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:33:39.405749 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333dab7c-c532-4288-a325-40dd621de627 admin admin] PATH_INFO: `/v3/projects/6f517e9dbca64d8fb639c832970aa90b` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:33:39.406985 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333dab7c-c532-4288-a325-40dd621de627 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f517e9dbca64d8fb639c832970aa90b)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:33:39.408989 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333dab7c-c532-4288-a325-40dd621de627 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:33:39.524558 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-333dab7c-c532-4288-a325-40dd621de627 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f517e9dbca64d8fb639c832970aa90b', 'request_id': 'req-333dab7c-c532-4288-a325-40dd621de627'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:33:39.531429 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-333dab7c-c532-4288-a325-40dd621de627 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f517e9dbca64d8fb639c832970aa90b', 'request_id': 'req-333dab7c-c532-4288-a325-40dd621de627'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:33:39.537079 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-333dab7c-c532-4288-a325-40dd621de627 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f517e9dbca64d8fb639c832970aa90b', 'request_id': 'req-333dab7c-c532-4288-a325-40dd621de627'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:33:39.604383 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-333dab7c-c532-4288-a325-40dd621de627 admin admin] The token cache is being invalidate because project 6f517e9dbca64d8fb639c832970aa90b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:33:39.604677 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-333dab7c-c532-4288-a325-40dd621de627 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:33:39.605323 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-333dab7c-c532-4288-a325-40dd621de627 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:33:39.606888 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1384/2759] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:33:39 2022] DELETE /identity/v3/projects/6f517e9dbca64d8fb639c832970aa90b => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:33:48.989255 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:33:49.600445 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=80,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:34:10.856052 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266997c-23b3-496b-ab47-ecd596e17a35 service neutron] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:10.857470 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-5266997c-23b3-496b-ab47-ecd596e17a35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:34:10.932122 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266997c-23b3-496b-ab47-ecd596e17a35 service neutron] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:10.986481 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfffb1ab-1b46-41d9-8b7b-d562a66d0b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:10.987358 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffb1ab-1b46-41d9-8b7b-d562a66d0b5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:10.987654 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffb1ab-1b46-41d9-8b7b-d562a66d0b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:10.987911 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffb1ab-1b46-41d9-8b7b-d562a66d0b5a admin admin] PATH_INFO: `/v3/users/6136b2fd24954200b60e4371178f2040` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:10.989163 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffb1ab-1b46-41d9-8b7b-d562a66d0b5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6136b2fd24954200b60e4371178f2040)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:10.991079 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffb1ab-1b46-41d9-8b7b-d562a66d0b5a admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:11.202478 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-dfffb1ab-1b46-41d9-8b7b-d562a66d0b5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6136b2fd24954200b60e4371178f2040'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:11.214836 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-dfffb1ab-1b46-41d9-8b7b-d562a66d0b5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6136b2fd24954200b60e4371178f2040'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:11.215507 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-dfffb1ab-1b46-41d9-8b7b-d562a66d0b5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6136b2fd24954200b60e4371178f2040'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:11.222245 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-dfffb1ab-1b46-41d9-8b7b-d562a66d0b5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6136b2fd24954200b60e4371178f2040'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:11.222872 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-dfffb1ab-1b46-41d9-8b7b-d562a66d0b5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6136b2fd24954200b60e4371178f2040'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:11.313918 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1376/2760] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:34:10 2022] DELETE /identity/v3/users/6136b2fd24954200b60e4371178f2040 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:34:11.318420 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19f89d-8101-4774-b79b-9ac49222fb51 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:11.318905 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19f89d-8101-4774-b79b-9ac49222fb51 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:11.319033 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19f89d-8101-4774-b79b-9ac49222fb51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:11.345584 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-9f19f89d-8101-4774-b79b-9ac49222fb51 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:34:11.347724 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-9f19f89d-8101-4774-b79b-9ac49222fb51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:34:11.406122 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1385/2761] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:34:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:34:11.415925 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfffb1ab-1b46-41d9-8b7b-d562a66d0b5a admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:11.417340 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-dfffb1ab-1b46-41d9-8b7b-d562a66d0b5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:34:11.439394 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:34:11.513113 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfffb1ab-1b46-41d9-8b7b-d562a66d0b5a admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:11.516735 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b2f0c8-a31c-441c-9b63-3be058bce53e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:11.517370 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2f0c8-a31c-441c-9b63-3be058bce53e service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:11.517651 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2f0c8-a31c-441c-9b63-3be058bce53e service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:11.517987 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2f0c8-a31c-441c-9b63-3be058bce53e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:11.527821 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b2f0c8-a31c-441c-9b63-3be058bce53e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:11.529382 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b2f0c8-a31c-441c-9b63-3be058bce53e service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:11.539108 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1377/2762] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:34:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:34:11.942531 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f19f89d-8101-4774-b79b-9ac49222fb51 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:11.943987 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-9f19f89d-8101-4774-b79b-9ac49222fb51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:34:11.957736 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f19f89d-8101-4774-b79b-9ac49222fb51 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:11.962665 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e951e-3f5d-402e-b673-9a576faef071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:11.963533 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e951e-3f5d-402e-b673-9a576faef071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:11.963818 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e951e-3f5d-402e-b673-9a576faef071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:11.964097 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e951e-3f5d-402e-b673-9a576faef071 admin admin] PATH_INFO: `/v3/projects/7958187f70b945dbbd10f67a283f6a20` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:11.965378 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e951e-3f5d-402e-b673-9a576faef071 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7958187f70b945dbbd10f67a283f6a20)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:11.967302 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e951e-3f5d-402e-b673-9a576faef071 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:12.075707 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-154e951e-3f5d-402e-b673-9a576faef071 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7958187f70b945dbbd10f67a283f6a20', 'request_id': 'req-154e951e-3f5d-402e-b673-9a576faef071'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:12.081805 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-154e951e-3f5d-402e-b673-9a576faef071 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7958187f70b945dbbd10f67a283f6a20', 'request_id': 'req-154e951e-3f5d-402e-b673-9a576faef071'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:12.087376 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-154e951e-3f5d-402e-b673-9a576faef071 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7958187f70b945dbbd10f67a283f6a20', 'request_id': 'req-154e951e-3f5d-402e-b673-9a576faef071'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:12.164425 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-154e951e-3f5d-402e-b673-9a576faef071 admin admin] The token cache is being invalidate because project 7958187f70b945dbbd10f67a283f6a20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:34:12.165266 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-154e951e-3f5d-402e-b673-9a576faef071 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:12.165927 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-154e951e-3f5d-402e-b673-9a576faef071 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:12.167486 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1386/2763] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:34:11 2022] DELETE /identity/v3/projects/7958187f70b945dbbd10f67a283f6a20 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:34:12.171609 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b2f0c8-a31c-441c-9b63-3be058bce53e service neutron] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:12.181891 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b2f0c8-a31c-441c-9b63-3be058bce53e service neutron] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:12.236504 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444a947-6615-44c6-967b-cbcb97155f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:12.237370 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444a947-6615-44c6-967b-cbcb97155f86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:12.237654 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444a947-6615-44c6-967b-cbcb97155f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:12.237930 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444a947-6615-44c6-967b-cbcb97155f86 admin admin] PATH_INFO: `/v3/users/e6ac0f7716bf416694568331016ce566` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:12.239093 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444a947-6615-44c6-967b-cbcb97155f86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6ac0f7716bf416694568331016ce566)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:12.241034 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444a947-6615-44c6-967b-cbcb97155f86 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:12.417415 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-4444a947-6615-44c6-967b-cbcb97155f86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6ac0f7716bf416694568331016ce566'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:12.429030 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-4444a947-6615-44c6-967b-cbcb97155f86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6ac0f7716bf416694568331016ce566'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:12.429692 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-4444a947-6615-44c6-967b-cbcb97155f86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6ac0f7716bf416694568331016ce566'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:12.437335 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-4444a947-6615-44c6-967b-cbcb97155f86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6ac0f7716bf416694568331016ce566'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:12.437965 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-4444a947-6615-44c6-967b-cbcb97155f86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6ac0f7716bf416694568331016ce566'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:12.523268 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1378/2764] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:34:12 2022] DELETE /identity/v3/users/e6ac0f7716bf416694568331016ce566 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:34:12.945083 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e951e-3f5d-402e-b673-9a576faef071 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:12.945626 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-154e951e-3f5d-402e-b673-9a576faef071 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:34:12.960513 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e951e-3f5d-402e-b673-9a576faef071 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:13.020537 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b3f3d-cb34-4da4-930a-b74f40b93237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:13.021455 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b3f3d-cb34-4da4-930a-b74f40b93237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:13.021740 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b3f3d-cb34-4da4-930a-b74f40b93237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:13.022018 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b3f3d-cb34-4da4-930a-b74f40b93237 admin admin] PATH_INFO: `/v3/projects/3c89666a6db043868eeb973c52808dd3` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:13.023195 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b3f3d-cb34-4da4-930a-b74f40b93237 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c89666a6db043868eeb973c52808dd3)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:13.025867 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b3f3d-cb34-4da4-930a-b74f40b93237 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:13.047305 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:34:13.159613 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-a00b3f3d-cb34-4da4-930a-b74f40b93237 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c89666a6db043868eeb973c52808dd3', 'request_id': 'req-a00b3f3d-cb34-4da4-930a-b74f40b93237'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:13.165869 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-a00b3f3d-cb34-4da4-930a-b74f40b93237 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c89666a6db043868eeb973c52808dd3', 'request_id': 'req-a00b3f3d-cb34-4da4-930a-b74f40b93237'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:13.171199 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-a00b3f3d-cb34-4da4-930a-b74f40b93237 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c89666a6db043868eeb973c52808dd3', 'request_id': 'req-a00b3f3d-cb34-4da4-930a-b74f40b93237'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:13.262899 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-a00b3f3d-cb34-4da4-930a-b74f40b93237 admin admin] The token cache is being invalidate because project 3c89666a6db043868eeb973c52808dd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:34:13.263186 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-a00b3f3d-cb34-4da4-930a-b74f40b93237 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:13.263798 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-a00b3f3d-cb34-4da4-930a-b74f40b93237 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:13.265412 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1387/2765] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:34:12 2022] DELETE /identity/v3/projects/3c89666a6db043868eeb973c52808dd3 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:34:13.270474 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d1da5-780e-4d8a-96b9-1fd6d1552a21 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:13.271039 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d1da5-780e-4d8a-96b9-1fd6d1552a21 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:13.271039 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d1da5-780e-4d8a-96b9-1fd6d1552a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:13.276343 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:34:13.317783 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-018d1da5-780e-4d8a-96b9-1fd6d1552a21 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:34:13.318976 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-018d1da5-780e-4d8a-96b9-1fd6d1552a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:34:13.377065 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1379/2766] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:34:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:34:13.385955 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a0f1b-1143-469b-8283-175a33b52f74 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:13.386504 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a0f1b-1143-469b-8283-175a33b52f74 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:13.387058 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a0f1b-1143-469b-8283-175a33b52f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:13.406188 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-b73a0f1b-1143-469b-8283-175a33b52f74 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:34:13.407374 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-b73a0f1b-1143-469b-8283-175a33b52f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:34:13.416010 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1388/2767] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:34:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:34:13.420223 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d1da5-780e-4d8a-96b9-1fd6d1552a21 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:13.429574 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d1da5-780e-4d8a-96b9-1fd6d1552a21 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:13.434578 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336df57d-0d66-4680-866a-eecde01324b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:13.435220 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336df57d-0d66-4680-866a-eecde01324b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:13.435501 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336df57d-0d66-4680-866a-eecde01324b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:13.435771 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336df57d-0d66-4680-866a-eecde01324b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:13.436510 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336df57d-0d66-4680-866a-eecde01324b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:34:13.436816 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336df57d-0d66-4680-866a-eecde01324b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:13.438394 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336df57d-0d66-4680-866a-eecde01324b1 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:13.450555 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1380/2768] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:34:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:34:13.454800 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a0f1b-1143-469b-8283-175a33b52f74 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:13.464042 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a0f1b-1143-469b-8283-175a33b52f74 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:13.468750 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99c73a-d263-4d45-9f7f-55222635e74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:13.469391 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99c73a-d263-4d45-9f7f-55222635e74f admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:13.469667 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99c73a-d263-4d45-9f7f-55222635e74f admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:13.469938 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99c73a-d263-4d45-9f7f-55222635e74f admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:13.470610 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a99c73a-d263-4d45-9f7f-55222635e74f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:13.472536 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a99c73a-d263-4d45-9f7f-55222635e74f admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:13.571967 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1389/2769] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:34:13 2022] POST /identity/v3/projects => generated 369 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:34:13.576477 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336df57d-0d66-4680-866a-eecde01324b1 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:13.586409 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336df57d-0d66-4680-866a-eecde01324b1 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:13.641846 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a572ec3-0493-4f32-afe2-e2aaee73ebb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:13.642513 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a572ec3-0493-4f32-afe2-e2aaee73ebb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:13.642795 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a572ec3-0493-4f32-afe2-e2aaee73ebb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:13.643069 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a572ec3-0493-4f32-afe2-e2aaee73ebb5 admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:13.643755 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a572ec3-0493-4f32-afe2-e2aaee73ebb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:13.645717 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a572ec3-0493-4f32-afe2-e2aaee73ebb5 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:13.748895 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1381/2770] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:34:13 2022] POST /identity/v3/users => generated 285 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:34:13.753106 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99c73a-d263-4d45-9f7f-55222635e74f admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:13.764583 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99c73a-d263-4d45-9f7f-55222635e74f admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:13.769177 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afae90-87e8-4e0b-8ed6-b80baac4ac1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:13.769829 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afae90-87e8-4e0b-8ed6-b80baac4ac1e admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:13.770112 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afae90-87e8-4e0b-8ed6-b80baac4ac1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:13.770389 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afae90-87e8-4e0b-8ed6-b80baac4ac1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:13.771105 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2afae90-87e8-4e0b-8ed6-b80baac4ac1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:13.772735 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2afae90-87e8-4e0b-8ed6-b80baac4ac1e admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:13.783782 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1390/2771] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:34:13.787821 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a572ec3-0493-4f32-afe2-e2aaee73ebb5 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:13.797974 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a572ec3-0493-4f32-afe2-e2aaee73ebb5 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:13.802887 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60abf78d-6803-41fa-b96f-22860168ce4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:13.803546 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60abf78d-6803-41fa-b96f-22860168ce4d admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:13.803843 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60abf78d-6803-41fa-b96f-22860168ce4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:13.804115 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60abf78d-6803-41fa-b96f-22860168ce4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:13.804893 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60abf78d-6803-41fa-b96f-22860168ce4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:13.806532 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60abf78d-6803-41fa-b96f-22860168ce4d admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:13.816468 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1382/2772] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:34:13.820609 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afae90-87e8-4e0b-8ed6-b80baac4ac1e admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:13.831098 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afae90-87e8-4e0b-8ed6-b80baac4ac1e admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:13.835799 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e2701-ab70-491e-9388-37714c62324c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:13.839318 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e2701-ab70-491e-9388-37714c62324c admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:13.839613 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e2701-ab70-491e-9388-37714c62324c admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:13.839888 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e2701-ab70-491e-9388-37714c62324c admin admin] PATH_INFO: `/v3/projects/2e40205b426e4cd6abb3e503cf395f42/users/2056708e0dce48e48423bf526080f8c4/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:13.854726 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9e2701-ab70-491e-9388-37714c62324c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e40205b426e4cd6abb3e503cf395f42, user_id=2056708e0dce48e48423bf526080f8c4, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:13.857420 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9e2701-ab70-491e-9388-37714c62324c admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:13.918005 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1391/2773] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:34:13 2022] PUT /identity/v3/projects/2e40205b426e4cd6abb3e503cf395f42/users/2056708e0dce48e48423bf526080f8c4/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:34:13.928210 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0078dc-77b0-455b-939d-990e53a435ca None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:13.928508 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0078dc-77b0-455b-939d-990e53a435ca None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:13.928787 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0078dc-77b0-455b-939d-990e53a435ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:13.955338 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-0c0078dc-77b0-455b-939d-990e53a435ca None None] MFA Rules not processed for user `2056708e0dce48e48423bf526080f8c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:34:13.956577 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-0c0078dc-77b0-455b-939d-990e53a435ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:34:13.989393 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:34:14.021228 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1383/2774] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:34:13 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:34:14.025902 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e2701-ab70-491e-9388-37714c62324c admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:14.088369 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e2701-ab70-491e-9388-37714c62324c admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:14.092898 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36efde87-d53a-4b05-9606-cc046266e690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:14.093546 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efde87-d53a-4b05-9606-cc046266e690 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:14.093843 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efde87-d53a-4b05-9606-cc046266e690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:14.094100 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efde87-d53a-4b05-9606-cc046266e690 admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:14.094778 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36efde87-d53a-4b05-9606-cc046266e690 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:14.096716 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36efde87-d53a-4b05-9606-cc046266e690 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:14.177852 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1392/2775] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:34:14 2022] POST /identity/v3/projects => generated 367 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:34:14.182488 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0078dc-77b0-455b-939d-990e53a435ca None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:14.192867 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0078dc-77b0-455b-939d-990e53a435ca None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:14.248745 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a1bdc-870c-41e5-b2c4-97c33e9b710e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:14.249404 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a1bdc-870c-41e5-b2c4-97c33e9b710e admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:14.249685 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a1bdc-870c-41e5-b2c4-97c33e9b710e admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:14.249959 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a1bdc-870c-41e5-b2c4-97c33e9b710e admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:14.250639 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a1bdc-870c-41e5-b2c4-97c33e9b710e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:14.252561 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a1bdc-870c-41e5-b2c4-97c33e9b710e admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:14.348444 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1384/2776] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:34:14 2022] POST /identity/v3/users => generated 290 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:34:14.353022 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36efde87-d53a-4b05-9606-cc046266e690 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:14.363629 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36efde87-d53a-4b05-9606-cc046266e690 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:14.368504 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804ff63-6fe2-46df-a056-0dedab0cb191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:14.372125 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804ff63-6fe2-46df-a056-0dedab0cb191 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:14.372125 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804ff63-6fe2-46df-a056-0dedab0cb191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:14.372125 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804ff63-6fe2-46df-a056-0dedab0cb191 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:14.372125 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804ff63-6fe2-46df-a056-0dedab0cb191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:14.372125 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804ff63-6fe2-46df-a056-0dedab0cb191 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:14.382970 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1393/2777] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:34:14.387642 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a1bdc-870c-41e5-b2c4-97c33e9b710e admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:14.397457 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a1bdc-870c-41e5-b2c4-97c33e9b710e admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:14.402746 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf6f9b-8203-4b38-9ac8-e9b0dc5f4ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:14.403611 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf6f9b-8203-4b38-9ac8-e9b0dc5f4ae9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:14.403890 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf6f9b-8203-4b38-9ac8-e9b0dc5f4ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:14.404186 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf6f9b-8203-4b38-9ac8-e9b0dc5f4ae9 admin admin] PATH_INFO: `/v3/projects/6d11d85f891a43159396b5a82d0934d6/users/94f54b54b6724c6ea920869e024afbce/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:14.418560 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf6f9b-8203-4b38-9ac8-e9b0dc5f4ae9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d11d85f891a43159396b5a82d0934d6, user_id=94f54b54b6724c6ea920869e024afbce, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:14.421212 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf6f9b-8203-4b38-9ac8-e9b0dc5f4ae9 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:14.485178 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1385/2778] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:34:14 2022] PUT /identity/v3/projects/6d11d85f891a43159396b5a82d0934d6/users/94f54b54b6724c6ea920869e024afbce/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:34:14.489191 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804ff63-6fe2-46df-a056-0dedab0cb191 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:14.499158 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804ff63-6fe2-46df-a056-0dedab0cb191 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:14.512000 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:34:14.554520 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e6326-0f1c-4eb2-b11c-567f2e8d2bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:14.555176 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e6326-0f1c-4eb2-b11c-567f2e8d2bdf admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:14.555489 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e6326-0f1c-4eb2-b11c-567f2e8d2bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:14.555763 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e6326-0f1c-4eb2-b11c-567f2e8d2bdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:14.556537 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881e6326-0f1c-4eb2-b11c-567f2e8d2bdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:14.558141 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881e6326-0f1c-4eb2-b11c-567f2e8d2bdf admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:14.567823 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1394/2779] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:34:14.572728 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf6f9b-8203-4b38-9ac8-e9b0dc5f4ae9 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:14.583032 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf6f9b-8203-4b38-9ac8-e9b0dc5f4ae9 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:14.588069 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c223fd1-18f9-4e58-abe2-f265300f8b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:14.589506 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c223fd1-18f9-4e58-abe2-f265300f8b57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:14.589789 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c223fd1-18f9-4e58-abe2-f265300f8b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:14.590073 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c223fd1-18f9-4e58-abe2-f265300f8b57 admin admin] PATH_INFO: `/v3/projects/6d11d85f891a43159396b5a82d0934d6/users/94f54b54b6724c6ea920869e024afbce/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:14.592036 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c223fd1-18f9-4e58-abe2-f265300f8b57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d11d85f891a43159396b5a82d0934d6, user_id=94f54b54b6724c6ea920869e024afbce, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:14.594760 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c223fd1-18f9-4e58-abe2-f265300f8b57 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:14.605235 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1386/2780] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:34:14 2022] PUT /identity/v3/projects/6d11d85f891a43159396b5a82d0934d6/users/94f54b54b6724c6ea920869e024afbce/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:34:14.616083 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2533f05-756b-4212-b587-5e1b9872a860 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:14.616889 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2533f05-756b-4212-b587-5e1b9872a860 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:14.616889 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2533f05-756b-4212-b587-5e1b9872a860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:14.643955 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-b2533f05-756b-4212-b587-5e1b9872a860 None None] MFA Rules not processed for user `94f54b54b6724c6ea920869e024afbce`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:34:14.645195 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-b2533f05-756b-4212-b587-5e1b9872a860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:34:14.712205 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1395/2781] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:34:14 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:34:14.723300 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c223fd1-18f9-4e58-abe2-f265300f8b57 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:14.724997 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-1c223fd1-18f9-4e58-abe2-f265300f8b57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:34:14.782207 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c223fd1-18f9-4e58-abe2-f265300f8b57 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:14.785988 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9bf43a-5d05-4287-b8bd-88f73a809d03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:14.786621 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bf43a-5d05-4287-b8bd-88f73a809d03 service cinder] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:14.791866 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bf43a-5d05-4287-b8bd-88f73a809d03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:14.791866 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bf43a-5d05-4287-b8bd-88f73a809d03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:14.796205 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9bf43a-5d05-4287-b8bd-88f73a809d03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:14.797623 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9bf43a-5d05-4287-b8bd-88f73a809d03 service cinder] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:14.807936 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1387/2782] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:34:14 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:34:14.968889 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2533f05-756b-4212-b587-5e1b9872a860 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:14.970310 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-b2533f05-756b-4212-b587-5e1b9872a860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:34:14.982327 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2533f05-756b-4212-b587-5e1b9872a860 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:14.986058 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0d904-15ee-4207-bc02-7f712233f7e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:14.986751 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0d904-15ee-4207-bc02-7f712233f7e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:14.987036 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0d904-15ee-4207-bc02-7f712233f7e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:14.987364 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0d904-15ee-4207-bc02-7f712233f7e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:15.047747 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b0d904-15ee-4207-bc02-7f712233f7e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:15.049230 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b0d904-15ee-4207-bc02-7f712233f7e1 service cinder] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:15.058582 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1396/2783] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:34:14 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:34:19.611666 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9bf43a-5d05-4287-b8bd-88f73a809d03 service cinder] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:19.645990 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:34:19.674714 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9bf43a-5d05-4287-b8bd-88f73a809d03 service cinder] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:19.679224 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ae8c7-fc68-47c3-8298-0cfddd3702af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:19.680091 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ae8c7-fc68-47c3-8298-0cfddd3702af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:19.680463 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ae8c7-fc68-47c3-8298-0cfddd3702af admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:19.680732 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ae8c7-fc68-47c3-8298-0cfddd3702af admin admin] PATH_INFO: `/v3/users/2056708e0dce48e48423bf526080f8c4` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:19.681916 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ae8c7-fc68-47c3-8298-0cfddd3702af admin admin] RBAC: Authorizing `identity:delete_user(user_id=2056708e0dce48e48423bf526080f8c4)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:19.683834 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ae8c7-fc68-47c3-8298-0cfddd3702af admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:19.891832 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-b41ae8c7-fc68-47c3-8298-0cfddd3702af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2056708e0dce48e48423bf526080f8c4'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:19.904233 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-b41ae8c7-fc68-47c3-8298-0cfddd3702af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2056708e0dce48e48423bf526080f8c4'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:19.904905 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-b41ae8c7-fc68-47c3-8298-0cfddd3702af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2056708e0dce48e48423bf526080f8c4'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:19.912061 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-b41ae8c7-fc68-47c3-8298-0cfddd3702af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2056708e0dce48e48423bf526080f8c4'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:19.912731 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-b41ae8c7-fc68-47c3-8298-0cfddd3702af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2056708e0dce48e48423bf526080f8c4'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:19.999709 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1388/2784] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:34:19 2022] DELETE /identity/v3/users/2056708e0dce48e48423bf526080f8c4 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:34:20.004399 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67002a-2b0d-4437-929d-5446acd6de61 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:20.004844 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67002a-2b0d-4437-929d-5446acd6de61 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:20.004973 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67002a-2b0d-4437-929d-5446acd6de61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:20.023765 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-0b67002a-2b0d-4437-929d-5446acd6de61 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:34:20.025582 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-0b67002a-2b0d-4437-929d-5446acd6de61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:34:20.057952 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:34:20.084520 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1397/2785] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:34:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:34:20.094219 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ae8c7-fc68-47c3-8298-0cfddd3702af admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:20.095615 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-b41ae8c7-fc68-47c3-8298-0cfddd3702af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:34:20.154248 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ae8c7-fc68-47c3-8298-0cfddd3702af admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:20.157904 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46bf214-1bc6-4193-9dab-758679eec117 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:20.158549 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46bf214-1bc6-4193-9dab-758679eec117 service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:20.158829 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46bf214-1bc6-4193-9dab-758679eec117 service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:20.159100 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46bf214-1bc6-4193-9dab-758679eec117 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:20.169497 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46bf214-1bc6-4193-9dab-758679eec117 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:20.171032 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46bf214-1bc6-4193-9dab-758679eec117 service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:20.182140 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1389/2786] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:34:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:34:20.607622 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b67002a-2b0d-4437-929d-5446acd6de61 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:20.609116 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-0b67002a-2b0d-4437-929d-5446acd6de61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:34:20.621695 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b67002a-2b0d-4437-929d-5446acd6de61 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:20.626465 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b846d1f7-24b9-40ec-b7e6-839ef38fab19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:20.627325 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846d1f7-24b9-40ec-b7e6-839ef38fab19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:20.627714 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846d1f7-24b9-40ec-b7e6-839ef38fab19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:20.628255 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846d1f7-24b9-40ec-b7e6-839ef38fab19 admin admin] PATH_INFO: `/v3/projects/2e40205b426e4cd6abb3e503cf395f42` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:20.629691 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b846d1f7-24b9-40ec-b7e6-839ef38fab19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e40205b426e4cd6abb3e503cf395f42)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:20.631488 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b846d1f7-24b9-40ec-b7e6-839ef38fab19 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:20.771856 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-b846d1f7-24b9-40ec-b7e6-839ef38fab19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e40205b426e4cd6abb3e503cf395f42', 'request_id': 'req-b846d1f7-24b9-40ec-b7e6-839ef38fab19'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:20.779010 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-b846d1f7-24b9-40ec-b7e6-839ef38fab19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e40205b426e4cd6abb3e503cf395f42', 'request_id': 'req-b846d1f7-24b9-40ec-b7e6-839ef38fab19'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:20.784631 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-b846d1f7-24b9-40ec-b7e6-839ef38fab19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e40205b426e4cd6abb3e503cf395f42', 'request_id': 'req-b846d1f7-24b9-40ec-b7e6-839ef38fab19'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:20.878796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-b846d1f7-24b9-40ec-b7e6-839ef38fab19 admin admin] The token cache is being invalidate because project 2e40205b426e4cd6abb3e503cf395f42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:34:20.879079 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-b846d1f7-24b9-40ec-b7e6-839ef38fab19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:20.879711 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-b846d1f7-24b9-40ec-b7e6-839ef38fab19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:20.881556 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1398/2787] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:34:20 2022] DELETE /identity/v3/projects/2e40205b426e4cd6abb3e503cf395f42 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:34:20.886130 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46bf214-1bc6-4193-9dab-758679eec117 service neutron] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:20.895762 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46bf214-1bc6-4193-9dab-758679eec117 service neutron] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:20.943995 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:34:20.953652 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9442945-baf2-41da-af4e-6a4aa8876ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:20.954542 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9442945-baf2-41da-af4e-6a4aa8876ff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:20.954828 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9442945-baf2-41da-af4e-6a4aa8876ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:20.955104 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9442945-baf2-41da-af4e-6a4aa8876ff3 admin admin] PATH_INFO: `/v3/users/94f54b54b6724c6ea920869e024afbce` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:20.956323 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9442945-baf2-41da-af4e-6a4aa8876ff3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94f54b54b6724c6ea920869e024afbce)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:20.958318 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9442945-baf2-41da-af4e-6a4aa8876ff3 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:21.093084 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-f9442945-baf2-41da-af4e-6a4aa8876ff3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94f54b54b6724c6ea920869e024afbce'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:21.104692 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-f9442945-baf2-41da-af4e-6a4aa8876ff3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94f54b54b6724c6ea920869e024afbce'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:21.105346 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-f9442945-baf2-41da-af4e-6a4aa8876ff3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94f54b54b6724c6ea920869e024afbce'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:21.112018 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-f9442945-baf2-41da-af4e-6a4aa8876ff3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94f54b54b6724c6ea920869e024afbce'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:21.112665 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-f9442945-baf2-41da-af4e-6a4aa8876ff3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94f54b54b6724c6ea920869e024afbce'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:21.186410 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1390/2788] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:34:20 2022] DELETE /identity/v3/users/94f54b54b6724c6ea920869e024afbce => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:34:21.591274 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b846d1f7-24b9-40ec-b7e6-839ef38fab19 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:21.591885 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-b846d1f7-24b9-40ec-b7e6-839ef38fab19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:34:21.604824 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b846d1f7-24b9-40ec-b7e6-839ef38fab19 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:21.663431 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8daf3-928b-4081-8598-bad0f71cde2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:21.664271 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8daf3-928b-4081-8598-bad0f71cde2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:21.664559 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8daf3-928b-4081-8598-bad0f71cde2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:21.664835 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8daf3-928b-4081-8598-bad0f71cde2c admin admin] PATH_INFO: `/v3/projects/6d11d85f891a43159396b5a82d0934d6` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:21.666006 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac8daf3-928b-4081-8598-bad0f71cde2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d11d85f891a43159396b5a82d0934d6)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:21.667916 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac8daf3-928b-4081-8598-bad0f71cde2c admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:21.795205 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-bac8daf3-928b-4081-8598-bad0f71cde2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d11d85f891a43159396b5a82d0934d6', 'request_id': 'req-bac8daf3-928b-4081-8598-bad0f71cde2c'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:21.801323 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-bac8daf3-928b-4081-8598-bad0f71cde2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d11d85f891a43159396b5a82d0934d6', 'request_id': 'req-bac8daf3-928b-4081-8598-bad0f71cde2c'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:21.806799 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-bac8daf3-928b-4081-8598-bad0f71cde2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d11d85f891a43159396b5a82d0934d6', 'request_id': 'req-bac8daf3-928b-4081-8598-bad0f71cde2c'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:21.808430 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:34:21.919338 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-bac8daf3-928b-4081-8598-bad0f71cde2c admin admin] The token cache is being invalidate because project 6d11d85f891a43159396b5a82d0934d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:34:21.919539 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-bac8daf3-928b-4081-8598-bad0f71cde2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:21.920206 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-bac8daf3-928b-4081-8598-bad0f71cde2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:21.921776 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1399/2789] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:34:21 2022] DELETE /identity/v3/projects/6d11d85f891a43159396b5a82d0934d6 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:34:21.926890 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c8f85-4e4b-4e1a-beef-4ac2c3bf4b98 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:21.927375 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c8f85-4e4b-4e1a-beef-4ac2c3bf4b98 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:21.927488 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c8f85-4e4b-4e1a-beef-4ac2c3bf4b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:21.944971 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-eb9c8f85-4e4b-4e1a-beef-4ac2c3bf4b98 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:34:21.946973 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-eb9c8f85-4e4b-4e1a-beef-4ac2c3bf4b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:34:22.005946 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1391/2790] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:34:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:34:22.014463 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc6dcf-22f7-4a61-b5ac-0688c185a740 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:22.014753 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc6dcf-22f7-4a61-b5ac-0688c185a740 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:22.015061 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc6dcf-22f7-4a61-b5ac-0688c185a740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:22.033549 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-26cc6dcf-22f7-4a61-b5ac-0688c185a740 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:34:22.034746 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-26cc6dcf-22f7-4a61-b5ac-0688c185a740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:34:22.042814 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1400/2791] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:34:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:34:22.046950 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c8f85-4e4b-4e1a-beef-4ac2c3bf4b98 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:22.056408 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c8f85-4e4b-4e1a-beef-4ac2c3bf4b98 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:22.061024 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4f9d8-3f08-45a8-a636-d51f441b76e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:22.061678 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4f9d8-3f08-45a8-a636-d51f441b76e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:22.061967 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4f9d8-3f08-45a8-a636-d51f441b76e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:22.062239 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4f9d8-3f08-45a8-a636-d51f441b76e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:22.062955 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4f9d8-3f08-45a8-a636-d51f441b76e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:34:22.063261 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4f9d8-3f08-45a8-a636-d51f441b76e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:22.064954 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4f9d8-3f08-45a8-a636-d51f441b76e8 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:22.077502 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1392/2792] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:34:22.081583 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc6dcf-22f7-4a61-b5ac-0688c185a740 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:22.091266 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc6dcf-22f7-4a61-b5ac-0688c185a740 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:22.095874 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34699d20-6607-4833-9ae4-e9918a6e3238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:22.096547 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34699d20-6607-4833-9ae4-e9918a6e3238 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:22.096829 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34699d20-6607-4833-9ae4-e9918a6e3238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:22.097105 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34699d20-6607-4833-9ae4-e9918a6e3238 admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:22.097787 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34699d20-6607-4833-9ae4-e9918a6e3238 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:22.099679 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34699d20-6607-4833-9ae4-e9918a6e3238 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:22.172420 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1401/2793] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:34:22 2022] POST /identity/v3/projects => generated 365 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:34:22.176426 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4f9d8-3f08-45a8-a636-d51f441b76e8 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:22.186757 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4f9d8-3f08-45a8-a636-d51f441b76e8 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:22.243379 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00d875-5da2-4d4a-a45b-404b1846a670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:22.244043 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00d875-5da2-4d4a-a45b-404b1846a670 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:22.244365 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00d875-5da2-4d4a-a45b-404b1846a670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:22.244646 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00d875-5da2-4d4a-a45b-404b1846a670 admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:22.245324 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb00d875-5da2-4d4a-a45b-404b1846a670 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:22.247223 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb00d875-5da2-4d4a-a45b-404b1846a670 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:22.253786 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:34:22.341395 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1393/2794] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:34:22 2022] POST /identity/v3/users => generated 283 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:34:22.345529 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34699d20-6607-4833-9ae4-e9918a6e3238 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:22.355881 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34699d20-6607-4833-9ae4-e9918a6e3238 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:22.360481 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c0b16-f226-4746-802b-426c86ab0595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:22.368314 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c0b16-f226-4746-802b-426c86ab0595 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:22.368314 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c0b16-f226-4746-802b-426c86ab0595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:22.368314 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c0b16-f226-4746-802b-426c86ab0595 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:22.368314 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754c0b16-f226-4746-802b-426c86ab0595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:22.368314 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754c0b16-f226-4746-802b-426c86ab0595 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:22.375985 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1402/2795] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:34:22.380058 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00d875-5da2-4d4a-a45b-404b1846a670 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:22.390981 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00d875-5da2-4d4a-a45b-404b1846a670 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:22.395608 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd1a583-9028-4de5-a89e-5ec19bf2dca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:22.396291 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1a583-9028-4de5-a89e-5ec19bf2dca7 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:22.396579 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1a583-9028-4de5-a89e-5ec19bf2dca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:22.396853 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1a583-9028-4de5-a89e-5ec19bf2dca7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:22.397568 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd1a583-9028-4de5-a89e-5ec19bf2dca7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:22.399655 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd1a583-9028-4de5-a89e-5ec19bf2dca7 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:22.410232 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1394/2796] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:34:22.414248 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c0b16-f226-4746-802b-426c86ab0595 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:22.424832 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c0b16-f226-4746-802b-426c86ab0595 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:22.429283 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec15bb-91cf-4dfd-8106-6e6e85c38245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:22.430143 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec15bb-91cf-4dfd-8106-6e6e85c38245 admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:22.430421 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec15bb-91cf-4dfd-8106-6e6e85c38245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:22.430691 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec15bb-91cf-4dfd-8106-6e6e85c38245 admin admin] PATH_INFO: `/v3/projects/982ad6962f6d48388ad9871222e7e12b/users/cc329652662a4055ad5a990813cc00ef/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:22.444681 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec15bb-91cf-4dfd-8106-6e6e85c38245 admin admin] RBAC: Authorizing `identity:create_grant(project_id=982ad6962f6d48388ad9871222e7e12b, user_id=cc329652662a4055ad5a990813cc00ef, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:22.447460 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec15bb-91cf-4dfd-8106-6e6e85c38245 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:22.508433 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1403/2797] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:34:22 2022] PUT /identity/v3/projects/982ad6962f6d48388ad9871222e7e12b/users/cc329652662a4055ad5a990813cc00ef/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:34:22.518827 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4d6cf-bdd8-4005-a46e-2f3fb4e83bf5 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:22.519124 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4d6cf-bdd8-4005-a46e-2f3fb4e83bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:22.519381 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4d6cf-bdd8-4005-a46e-2f3fb4e83bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:22.547122 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-cfe4d6cf-bdd8-4005-a46e-2f3fb4e83bf5 None None] MFA Rules not processed for user `cc329652662a4055ad5a990813cc00ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:34:22.548361 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-cfe4d6cf-bdd8-4005-a46e-2f3fb4e83bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:34:22.611840 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1395/2798] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:34:22 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:34:22.616526 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec15bb-91cf-4dfd-8106-6e6e85c38245 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:22.677416 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec15bb-91cf-4dfd-8106-6e6e85c38245 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:22.682105 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfdd55c-2bfa-455c-b577-28b706d206e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:22.682756 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdd55c-2bfa-455c-b577-28b706d206e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:22.683040 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdd55c-2bfa-455c-b577-28b706d206e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:22.683318 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdd55c-2bfa-455c-b577-28b706d206e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:22.683987 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfdd55c-2bfa-455c-b577-28b706d206e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:22.685919 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfdd55c-2bfa-455c-b577-28b706d206e8 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:22.799341 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1404/2799] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:34:22 2022] POST /identity/v3/projects => generated 367 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:34:22.803556 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe4d6cf-bdd8-4005-a46e-2f3fb4e83bf5 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:22.814270 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe4d6cf-bdd8-4005-a46e-2f3fb4e83bf5 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:22.870389 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0633ea86-4cf0-4c2f-9fe9-f1bafd3781e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:22.871049 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633ea86-4cf0-4c2f-9fe9-f1bafd3781e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:22.871449 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633ea86-4cf0-4c2f-9fe9-f1bafd3781e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:22.871733 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633ea86-4cf0-4c2f-9fe9-f1bafd3781e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:22.872488 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0633ea86-4cf0-4c2f-9fe9-f1bafd3781e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:22.874391 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0633ea86-4cf0-4c2f-9fe9-f1bafd3781e8 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:22.924921 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1396/2800] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:34:22 2022] POST /identity/v3/users => generated 290 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:34:22.928939 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfdd55c-2bfa-455c-b577-28b706d206e8 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:22.939243 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfdd55c-2bfa-455c-b577-28b706d206e8 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:22.943731 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb2af9-dc18-40d6-a041-07d4491b42ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:22.944429 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb2af9-dc18-40d6-a041-07d4491b42ad admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:22.944715 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb2af9-dc18-40d6-a041-07d4491b42ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:22.944989 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb2af9-dc18-40d6-a041-07d4491b42ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:22.945698 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb2af9-dc18-40d6-a041-07d4491b42ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:22.947775 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb2af9-dc18-40d6-a041-07d4491b42ad admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:22.958131 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1405/2801] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:34:22.962964 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0633ea86-4cf0-4c2f-9fe9-f1bafd3781e8 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:22.972977 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0633ea86-4cf0-4c2f-9fe9-f1bafd3781e8 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:22.977806 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b6476-f6c6-4f3c-a6b0-f689148b9d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:22.978683 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b6476-f6c6-4f3c-a6b0-f689148b9d68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:22.978970 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b6476-f6c6-4f3c-a6b0-f689148b9d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:22.979245 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b6476-f6c6-4f3c-a6b0-f689148b9d68 admin admin] PATH_INFO: `/v3/projects/200ce15cabce4009930ddd4df637451b/users/06adbbe329324fbcb6354178fa2a7cc6/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:22.994232 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2b6476-f6c6-4f3c-a6b0-f689148b9d68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=200ce15cabce4009930ddd4df637451b, user_id=06adbbe329324fbcb6354178fa2a7cc6, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:22.997027 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2b6476-f6c6-4f3c-a6b0-f689148b9d68 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:23.073382 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1397/2802] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:34:22 2022] PUT /identity/v3/projects/200ce15cabce4009930ddd4df637451b/users/06adbbe329324fbcb6354178fa2a7cc6/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:34:23.077352 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb2af9-dc18-40d6-a041-07d4491b42ad admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:23.087660 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb2af9-dc18-40d6-a041-07d4491b42ad admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:23.144333 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c37be6-afa7-4613-8c94-480ad03335f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:23.144994 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c37be6-afa7-4613-8c94-480ad03335f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:23.145308 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c37be6-afa7-4613-8c94-480ad03335f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:23.145589 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c37be6-afa7-4613-8c94-480ad03335f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:23.146305 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c37be6-afa7-4613-8c94-480ad03335f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:23.147905 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c37be6-afa7-4613-8c94-480ad03335f8 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:23.150277 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:34:23.157944 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1406/2803] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:34:23.162196 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b6476-f6c6-4f3c-a6b0-f689148b9d68 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:23.172618 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b6476-f6c6-4f3c-a6b0-f689148b9d68 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:23.177175 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2a526-58fe-4668-9ec5-f76901770919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:23.178044 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2a526-58fe-4668-9ec5-f76901770919 admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:23.178323 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2a526-58fe-4668-9ec5-f76901770919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:23.178598 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2a526-58fe-4668-9ec5-f76901770919 admin admin] PATH_INFO: `/v3/projects/200ce15cabce4009930ddd4df637451b/users/06adbbe329324fbcb6354178fa2a7cc6/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:23.181372 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e2a526-58fe-4668-9ec5-f76901770919 admin admin] RBAC: Authorizing `identity:create_grant(project_id=200ce15cabce4009930ddd4df637451b, user_id=06adbbe329324fbcb6354178fa2a7cc6, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:23.183905 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e2a526-58fe-4668-9ec5-f76901770919 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:23.193964 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1398/2804] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:34:23 2022] PUT /identity/v3/projects/200ce15cabce4009930ddd4df637451b/users/06adbbe329324fbcb6354178fa2a7cc6/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:34:23.205826 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11db8b2-d409-41d3-9005-63655e9cec31 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:23.206121 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11db8b2-d409-41d3-9005-63655e9cec31 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:23.206404 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11db8b2-d409-41d3-9005-63655e9cec31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:23.234354 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-b11db8b2-d409-41d3-9005-63655e9cec31 None None] MFA Rules not processed for user `06adbbe329324fbcb6354178fa2a7cc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:34:23.235576 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-b11db8b2-d409-41d3-9005-63655e9cec31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:34:23.303331 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1407/2805] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:34:23 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:34:23.314833 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2a526-58fe-4668-9ec5-f76901770919 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:23.316608 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-56e2a526-58fe-4668-9ec5-f76901770919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:34:23.339190 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:34:23.374069 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2a526-58fe-4668-9ec5-f76901770919 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:23.377758 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d61b0ce-dd71-4c78-9ffd-39e8e54e25f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:23.378398 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61b0ce-dd71-4c78-9ffd-39e8e54e25f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:23.378733 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61b0ce-dd71-4c78-9ffd-39e8e54e25f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:23.378990 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61b0ce-dd71-4c78-9ffd-39e8e54e25f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:23.389731 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d61b0ce-dd71-4c78-9ffd-39e8e54e25f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:23.391204 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d61b0ce-dd71-4c78-9ffd-39e8e54e25f2 service cinder] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:23.401296 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1399/2806] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:34:23 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:34:23.595892 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11db8b2-d409-41d3-9005-63655e9cec31 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:23.606207 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11db8b2-d409-41d3-9005-63655e9cec31 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:23.609840 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b09ede-e2a1-4e61-a777-7473cc44b5d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:23.610477 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b09ede-e2a1-4e61-a777-7473cc44b5d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:23.610764 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b09ede-e2a1-4e61-a777-7473cc44b5d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:23.611040 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b09ede-e2a1-4e61-a777-7473cc44b5d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:23.667164 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b09ede-e2a1-4e61-a777-7473cc44b5d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:23.668665 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b09ede-e2a1-4e61-a777-7473cc44b5d0 service cinder] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:23.677565 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1408/2807] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:34:23 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:34:29.877239 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d61b0ce-dd71-4c78-9ffd-39e8e54e25f2 service cinder] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:29.937555 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d61b0ce-dd71-4c78-9ffd-39e8e54e25f2 service cinder] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:29.942050 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9db9d-facf-4c59-b2e5-c364429c6688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:29.942907 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9db9d-facf-4c59-b2e5-c364429c6688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:29.943187 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9db9d-facf-4c59-b2e5-c364429c6688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:29.943459 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9db9d-facf-4c59-b2e5-c364429c6688 admin admin] PATH_INFO: `/v3/users/cc329652662a4055ad5a990813cc00ef` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:29.944749 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e9db9d-facf-4c59-b2e5-c364429c6688 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc329652662a4055ad5a990813cc00ef)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:29.947394 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e9db9d-facf-4c59-b2e5-c364429c6688 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:30.148956 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-81e9db9d-facf-4c59-b2e5-c364429c6688 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc329652662a4055ad5a990813cc00ef'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:30.160675 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-81e9db9d-facf-4c59-b2e5-c364429c6688 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc329652662a4055ad5a990813cc00ef'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:30.161329 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-81e9db9d-facf-4c59-b2e5-c364429c6688 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc329652662a4055ad5a990813cc00ef'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:30.168992 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-81e9db9d-facf-4c59-b2e5-c364429c6688 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc329652662a4055ad5a990813cc00ef'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:30.169643 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-81e9db9d-facf-4c59-b2e5-c364429c6688 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc329652662a4055ad5a990813cc00ef'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:30.237605 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1400/2808] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:34:29 2022] DELETE /identity/v3/users/cc329652662a4055ad5a990813cc00ef => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:34:30.242112 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d2799-8a8f-4eab-915b-9a2889a58afc None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:30.242659 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d2799-8a8f-4eab-915b-9a2889a58afc None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:30.243441 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d2799-8a8f-4eab-915b-9a2889a58afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:30.261367 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-859d2799-8a8f-4eab-915b-9a2889a58afc None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:34:30.262555 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-859d2799-8a8f-4eab-915b-9a2889a58afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:34:30.320199 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1409/2809] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:34:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:34:30.329752 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9db9d-facf-4c59-b2e5-c364429c6688 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:30.331132 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-81e9db9d-facf-4c59-b2e5-c364429c6688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:34:30.376877 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:34:30.388657 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9db9d-facf-4c59-b2e5-c364429c6688 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:30.395241 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2340d1b-6e02-4f5f-9db3-a7d114c03a18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:30.395241 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2340d1b-6e02-4f5f-9db3-a7d114c03a18 service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:30.395241 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2340d1b-6e02-4f5f-9db3-a7d114c03a18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:30.395241 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2340d1b-6e02-4f5f-9db3-a7d114c03a18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:30.434050 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2340d1b-6e02-4f5f-9db3-a7d114c03a18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:30.434050 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2340d1b-6e02-4f5f-9db3-a7d114c03a18 service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:30.434050 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1401/2810] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:34:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:34:30.835224 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d2799-8a8f-4eab-915b-9a2889a58afc None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:30.837541 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-859d2799-8a8f-4eab-915b-9a2889a58afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:34:30.851691 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d2799-8a8f-4eab-915b-9a2889a58afc None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:30.858690 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32925cda-4902-4231-b581-92e0f1f1211c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:30.859570 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32925cda-4902-4231-b581-92e0f1f1211c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:30.859863 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32925cda-4902-4231-b581-92e0f1f1211c admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:30.860112 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32925cda-4902-4231-b581-92e0f1f1211c admin admin] PATH_INFO: `/v3/projects/982ad6962f6d48388ad9871222e7e12b` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:30.861375 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32925cda-4902-4231-b581-92e0f1f1211c admin admin] RBAC: Authorizing `identity:delete_project(project_id=982ad6962f6d48388ad9871222e7e12b)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:30.863436 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32925cda-4902-4231-b581-92e0f1f1211c admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:30.881195 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=100 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:34:31.005850 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-32925cda-4902-4231-b581-92e0f1f1211c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '982ad6962f6d48388ad9871222e7e12b', 'request_id': 'req-32925cda-4902-4231-b581-92e0f1f1211c'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:31.012614 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-32925cda-4902-4231-b581-92e0f1f1211c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '982ad6962f6d48388ad9871222e7e12b', 'request_id': 'req-32925cda-4902-4231-b581-92e0f1f1211c'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:31.018061 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-32925cda-4902-4231-b581-92e0f1f1211c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '982ad6962f6d48388ad9871222e7e12b', 'request_id': 'req-32925cda-4902-4231-b581-92e0f1f1211c'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:31.078476 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-32925cda-4902-4231-b581-92e0f1f1211c admin admin] The token cache is being invalidate because project 982ad6962f6d48388ad9871222e7e12b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:34:31.078764 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-32925cda-4902-4231-b581-92e0f1f1211c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:31.079408 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-32925cda-4902-4231-b581-92e0f1f1211c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:31.080983 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1410/2811] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:34:30 2022] DELETE /identity/v3/projects/982ad6962f6d48388ad9871222e7e12b => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:34:31.084986 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2340d1b-6e02-4f5f-9db3-a7d114c03a18 service neutron] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:31.095429 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2340d1b-6e02-4f5f-9db3-a7d114c03a18 service neutron] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:31.150685 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653fc930-b66a-40a5-a3fd-6928857ec0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:31.151637 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653fc930-b66a-40a5-a3fd-6928857ec0c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:31.151919 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653fc930-b66a-40a5-a3fd-6928857ec0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:31.152214 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653fc930-b66a-40a5-a3fd-6928857ec0c3 admin admin] PATH_INFO: `/v3/users/06adbbe329324fbcb6354178fa2a7cc6` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:31.153369 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653fc930-b66a-40a5-a3fd-6928857ec0c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06adbbe329324fbcb6354178fa2a7cc6)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:31.155251 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653fc930-b66a-40a5-a3fd-6928857ec0c3 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:31.337072 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-653fc930-b66a-40a5-a3fd-6928857ec0c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06adbbe329324fbcb6354178fa2a7cc6'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:31.348824 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-653fc930-b66a-40a5-a3fd-6928857ec0c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06adbbe329324fbcb6354178fa2a7cc6'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:31.349488 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-653fc930-b66a-40a5-a3fd-6928857ec0c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06adbbe329324fbcb6354178fa2a7cc6'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:31.356263 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-653fc930-b66a-40a5-a3fd-6928857ec0c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06adbbe329324fbcb6354178fa2a7cc6'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:31.356897 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-653fc930-b66a-40a5-a3fd-6928857ec0c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06adbbe329324fbcb6354178fa2a7cc6'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:31.453318 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1402/2812] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:34:31 2022] DELETE /identity/v3/users/06adbbe329324fbcb6354178fa2a7cc6 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:34:31.863939 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32925cda-4902-4231-b581-92e0f1f1211c admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:31.865486 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-32925cda-4902-4231-b581-92e0f1f1211c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:34:31.879616 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32925cda-4902-4231-b581-92e0f1f1211c admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:31.938097 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85278b26-6464-44a6-aa07-4e609959d235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:31.939063 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85278b26-6464-44a6-aa07-4e609959d235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:31.939332 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85278b26-6464-44a6-aa07-4e609959d235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:31.939605 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85278b26-6464-44a6-aa07-4e609959d235 admin admin] PATH_INFO: `/v3/projects/200ce15cabce4009930ddd4df637451b` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:31.940792 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85278b26-6464-44a6-aa07-4e609959d235 admin admin] RBAC: Authorizing `identity:delete_project(project_id=200ce15cabce4009930ddd4df637451b)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:31.942730 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85278b26-6464-44a6-aa07-4e609959d235 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:32.050815 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-85278b26-6464-44a6-aa07-4e609959d235 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '200ce15cabce4009930ddd4df637451b', 'request_id': 'req-85278b26-6464-44a6-aa07-4e609959d235'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:32.057143 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-85278b26-6464-44a6-aa07-4e609959d235 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '200ce15cabce4009930ddd4df637451b', 'request_id': 'req-85278b26-6464-44a6-aa07-4e609959d235'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:32.062547 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-85278b26-6464-44a6-aa07-4e609959d235 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '200ce15cabce4009930ddd4df637451b', 'request_id': 'req-85278b26-6464-44a6-aa07-4e609959d235'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:32.157222 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-85278b26-6464-44a6-aa07-4e609959d235 admin admin] The token cache is being invalidate because project 200ce15cabce4009930ddd4df637451b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:34:32.157447 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-85278b26-6464-44a6-aa07-4e609959d235 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:32.158118 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-85278b26-6464-44a6-aa07-4e609959d235 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:32.159684 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1411/2813] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:34:31 2022] DELETE /identity/v3/projects/200ce15cabce4009930ddd4df637451b => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:34:32.165361 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71a9bc-c39a-4aff-9da3-9598afd2a490 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:32.165845 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71a9bc-c39a-4aff-9da3-9598afd2a490 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:32.165982 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71a9bc-c39a-4aff-9da3-9598afd2a490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:32.184754 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-1a71a9bc-c39a-4aff-9da3-9598afd2a490 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:34:32.185948 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-1a71a9bc-c39a-4aff-9da3-9598afd2a490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:34:32.244499 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1403/2814] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:34:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:34:32.252383 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619eb17-44ed-4eae-bef5-854612544a7c None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:32.252669 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619eb17-44ed-4eae-bef5-854612544a7c None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:32.252945 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619eb17-44ed-4eae-bef5-854612544a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:32.271588 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-a619eb17-44ed-4eae-bef5-854612544a7c None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:34:32.272806 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-a619eb17-44ed-4eae-bef5-854612544a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:34:32.281304 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1412/2815] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:34:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:34:32.285442 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71a9bc-c39a-4aff-9da3-9598afd2a490 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:32.292400 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:34:32.296126 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71a9bc-c39a-4aff-9da3-9598afd2a490 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:32.300745 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f199e-ed9b-4da5-9ecd-b1a75570f2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:32.301406 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f199e-ed9b-4da5-9ecd-b1a75570f2dd admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:32.301693 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f199e-ed9b-4da5-9ecd-b1a75570f2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:32.305064 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f199e-ed9b-4da5-9ecd-b1a75570f2dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:32.305064 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58f199e-ed9b-4da5-9ecd-b1a75570f2dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:34:32.305064 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58f199e-ed9b-4da5-9ecd-b1a75570f2dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:32.305064 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58f199e-ed9b-4da5-9ecd-b1a75570f2dd admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:32.316694 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1404/2816] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:34:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:34:32.320698 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619eb17-44ed-4eae-bef5-854612544a7c None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:32.330115 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619eb17-44ed-4eae-bef5-854612544a7c None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:32.334963 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05841a33-17dc-4ee9-bcd6-928a3cbf142f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:32.335641 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05841a33-17dc-4ee9-bcd6-928a3cbf142f admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:32.335925 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05841a33-17dc-4ee9-bcd6-928a3cbf142f admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:32.336730 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05841a33-17dc-4ee9-bcd6-928a3cbf142f admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:32.337506 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05841a33-17dc-4ee9-bcd6-928a3cbf142f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:32.339438 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05841a33-17dc-4ee9-bcd6-928a3cbf142f admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:32.434094 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1413/2817] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:34:32 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:34:32.438082 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f199e-ed9b-4da5-9ecd-b1a75570f2dd admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:32.448608 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f199e-ed9b-4da5-9ecd-b1a75570f2dd admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:32.503382 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd399f-69d2-4e79-ba04-42b009ec3683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:32.504047 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd399f-69d2-4e79-ba04-42b009ec3683 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:32.504360 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd399f-69d2-4e79-ba04-42b009ec3683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:32.504639 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd399f-69d2-4e79-ba04-42b009ec3683 admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:32.505322 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd399f-69d2-4e79-ba04-42b009ec3683 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:32.507479 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd399f-69d2-4e79-ba04-42b009ec3683 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:32.611227 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1405/2818] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:34:32 2022] POST /identity/v3/users => generated 292 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:34:32.615433 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05841a33-17dc-4ee9-bcd6-928a3cbf142f admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:32.625805 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05841a33-17dc-4ee9-bcd6-928a3cbf142f admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:32.630450 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c337a4-5e79-46c7-b55a-b3f9f246a083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:32.631356 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c337a4-5e79-46c7-b55a-b3f9f246a083 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:32.631641 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c337a4-5e79-46c7-b55a-b3f9f246a083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:32.631922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c337a4-5e79-46c7-b55a-b3f9f246a083 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:32.632703 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c337a4-5e79-46c7-b55a-b3f9f246a083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:32.634883 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c337a4-5e79-46c7-b55a-b3f9f246a083 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:32.636129 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:34:32.645832 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1414/2819] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:34:32.650500 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd399f-69d2-4e79-ba04-42b009ec3683 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:32.660543 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd399f-69d2-4e79-ba04-42b009ec3683 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:32.665177 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda456d6-11c5-4371-a742-74f2726b0ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:32.665826 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda456d6-11c5-4371-a742-74f2726b0ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:32.666110 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda456d6-11c5-4371-a742-74f2726b0ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:32.666386 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda456d6-11c5-4371-a742-74f2726b0ee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:32.667100 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda456d6-11c5-4371-a742-74f2726b0ee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:32.668722 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda456d6-11c5-4371-a742-74f2726b0ee5 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:32.678562 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1406/2820] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:34:32.686205 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c337a4-5e79-46c7-b55a-b3f9f246a083 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:32.696588 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c337a4-5e79-46c7-b55a-b3f9f246a083 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:32.701226 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5690568-0bbf-4236-8629-ca2a77965e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:32.702348 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5690568-0bbf-4236-8629-ca2a77965e65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:32.702829 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5690568-0bbf-4236-8629-ca2a77965e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:32.703566 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5690568-0bbf-4236-8629-ca2a77965e65 admin admin] PATH_INFO: `/v3/projects/e362f7212ad446d6b6acd50a730c4e79/users/6e8dcb5b86b94f3cabaea3f0f1c0bf1f/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:32.719225 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5690568-0bbf-4236-8629-ca2a77965e65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e362f7212ad446d6b6acd50a730c4e79, user_id=6e8dcb5b86b94f3cabaea3f0f1c0bf1f, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:32.721942 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5690568-0bbf-4236-8629-ca2a77965e65 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:32.811251 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1415/2821] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:34:32 2022] PUT /identity/v3/projects/e362f7212ad446d6b6acd50a730c4e79/users/6e8dcb5b86b94f3cabaea3f0f1c0bf1f/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:34:32.823190 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6d322-8f64-40a2-8b03-3059798c33fa None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:32.823481 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6d322-8f64-40a2-8b03-3059798c33fa None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:32.823760 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6d322-8f64-40a2-8b03-3059798c33fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:32.849669 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-7ff6d322-8f64-40a2-8b03-3059798c33fa None None] MFA Rules not processed for user `6e8dcb5b86b94f3cabaea3f0f1c0bf1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:34:32.850856 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-7ff6d322-8f64-40a2-8b03-3059798c33fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:34:32.913621 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1407/2822] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:34:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:34:32.918423 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5690568-0bbf-4236-8629-ca2a77965e65 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:32.978773 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5690568-0bbf-4236-8629-ca2a77965e65 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:32.983344 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3fd26d-de6e-4b1d-a68c-071a567beb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:32.983987 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3fd26d-de6e-4b1d-a68c-071a567beb76 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:32.984301 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3fd26d-de6e-4b1d-a68c-071a567beb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:32.984574 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3fd26d-de6e-4b1d-a68c-071a567beb76 admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:32.985260 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3fd26d-de6e-4b1d-a68c-071a567beb76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:32.987171 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3fd26d-de6e-4b1d-a68c-071a567beb76 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:33.092379 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1416/2823] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:34:32 2022] POST /identity/v3/projects => generated 383 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:34:33.096452 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff6d322-8f64-40a2-8b03-3059798c33fa None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:33.107139 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff6d322-8f64-40a2-8b03-3059798c33fa None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:33.163212 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da0ebf-ab42-4234-8a18-2632762786c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:33.163906 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da0ebf-ab42-4234-8a18-2632762786c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:33.164248 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da0ebf-ab42-4234-8a18-2632762786c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:33.165062 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da0ebf-ab42-4234-8a18-2632762786c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:33.165804 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72da0ebf-ab42-4234-8a18-2632762786c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:33.167701 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72da0ebf-ab42-4234-8a18-2632762786c1 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:33.174258 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:34:33.234266 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1408/2824] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:34:33 2022] POST /identity/v3/users => generated 298 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:34:33.238358 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3fd26d-de6e-4b1d-a68c-071a567beb76 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:33.249662 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3fd26d-de6e-4b1d-a68c-071a567beb76 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:33.254572 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a9c7d-0c8a-4751-af04-c5b52c0bd3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:33.259763 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a9c7d-0c8a-4751-af04-c5b52c0bd3e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:33.259763 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a9c7d-0c8a-4751-af04-c5b52c0bd3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:33.259763 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a9c7d-0c8a-4751-af04-c5b52c0bd3e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:33.259763 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a9c7d-0c8a-4751-af04-c5b52c0bd3e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:33.259763 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a9c7d-0c8a-4751-af04-c5b52c0bd3e0 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:33.269273 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1417/2825] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:34:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:34:33.273263 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da0ebf-ab42-4234-8a18-2632762786c1 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:33.283197 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da0ebf-ab42-4234-8a18-2632762786c1 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:33.287952 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa360a-82f9-4ff0-a9cf-0b365cc7cafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:33.288861 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa360a-82f9-4ff0-a9cf-0b365cc7cafa admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:33.289148 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa360a-82f9-4ff0-a9cf-0b365cc7cafa admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:33.290127 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa360a-82f9-4ff0-a9cf-0b365cc7cafa admin admin] PATH_INFO: `/v3/projects/ab07c8af11024a85b38aeeba1d2b5b53/users/fb8ae0e1159c44168a3cb1e595791c55/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:33.304881 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caa360a-82f9-4ff0-a9cf-0b365cc7cafa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab07c8af11024a85b38aeeba1d2b5b53, user_id=fb8ae0e1159c44168a3cb1e595791c55, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:33.308277 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caa360a-82f9-4ff0-a9cf-0b365cc7cafa admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:33.421553 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1409/2826] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:34:33 2022] PUT /identity/v3/projects/ab07c8af11024a85b38aeeba1d2b5b53/users/fb8ae0e1159c44168a3cb1e595791c55/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:34:33.425445 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a9c7d-0c8a-4751-af04-c5b52c0bd3e0 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:33.436350 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a9c7d-0c8a-4751-af04-c5b52c0bd3e0 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:33.494511 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b46f8c-b971-4c7d-8138-941ff8bc9ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:33.495229 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b46f8c-b971-4c7d-8138-941ff8bc9ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:33.495615 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b46f8c-b971-4c7d-8138-941ff8bc9ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:33.496034 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b46f8c-b971-4c7d-8138-941ff8bc9ca7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:33.496894 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b46f8c-b971-4c7d-8138-941ff8bc9ca7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:33.498626 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b46f8c-b971-4c7d-8138-941ff8bc9ca7 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:33.508770 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1418/2827] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:34:33 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:34:33.513035 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa360a-82f9-4ff0-a9cf-0b365cc7cafa admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:33.523142 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa360a-82f9-4ff0-a9cf-0b365cc7cafa admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:33.528317 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a157a-6458-49de-9da0-fb7448e4706b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:33.529182 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a157a-6458-49de-9da0-fb7448e4706b admin admin] REQUEST_METHOD: `PUT` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:33.529465 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a157a-6458-49de-9da0-fb7448e4706b admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:33.529744 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a157a-6458-49de-9da0-fb7448e4706b admin admin] PATH_INFO: `/v3/projects/ab07c8af11024a85b38aeeba1d2b5b53/users/fb8ae0e1159c44168a3cb1e595791c55/roles/bbd5f3e0c18e4992886fcfb4a3feb426` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:33.531684 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8a157a-6458-49de-9da0-fb7448e4706b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab07c8af11024a85b38aeeba1d2b5b53, user_id=fb8ae0e1159c44168a3cb1e595791c55, role_id=bbd5f3e0c18e4992886fcfb4a3feb426)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:33.534327 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8a157a-6458-49de-9da0-fb7448e4706b admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:33.545405 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1410/2828] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:34:33 2022] PUT /identity/v3/projects/ab07c8af11024a85b38aeeba1d2b5b53/users/fb8ae0e1159c44168a3cb1e595791c55/roles/bbd5f3e0c18e4992886fcfb4a3feb426 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:34:33.555699 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4f131-0b0f-4c04-a105-dfa6e3b6e674 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:33.555991 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4f131-0b0f-4c04-a105-dfa6e3b6e674 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:33.556322 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4f131-0b0f-4c04-a105-dfa6e3b6e674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:33.581625 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-9ed4f131-0b0f-4c04-a105-dfa6e3b6e674 None None] MFA Rules not processed for user `fb8ae0e1159c44168a3cb1e595791c55`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:34:33.582809 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-9ed4f131-0b0f-4c04-a105-dfa6e3b6e674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:34:33.613245 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:34:33.650919 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1419/2829] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:34:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:34:33.662514 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a157a-6458-49de-9da0-fb7448e4706b admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:33.664224 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-3a8a157a-6458-49de-9da0-fb7448e4706b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:34:33.743344 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a157a-6458-49de-9da0-fb7448e4706b admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:33.747085 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a01e29-504f-41b1-9685-5babf909b9e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:33.747665 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a01e29-504f-41b1-9685-5babf909b9e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:33.747949 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a01e29-504f-41b1-9685-5babf909b9e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:33.748262 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a01e29-504f-41b1-9685-5babf909b9e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:33.757480 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a01e29-504f-41b1-9685-5babf909b9e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:33.759255 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a01e29-504f-41b1-9685-5babf909b9e3 service cinder] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:33.768775 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1411/2830] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:34:33 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:34:33.892388 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4f131-0b0f-4c04-a105-dfa6e3b6e674 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:33.902964 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4f131-0b0f-4c04-a105-dfa6e3b6e674 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:33.906479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d710ad52-d866-4f13-8a70-8c62425a09a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:33.907109 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d710ad52-d866-4f13-8a70-8c62425a09a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:33.907386 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d710ad52-d866-4f13-8a70-8c62425a09a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:33.907657 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d710ad52-d866-4f13-8a70-8c62425a09a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:33.962813 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d710ad52-d866-4f13-8a70-8c62425a09a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:33.964308 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d710ad52-d866-4f13-8a70-8c62425a09a8 service cinder] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:33.973043 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1420/2831] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:34:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:34:34.454114 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a01e29-504f-41b1-9685-5babf909b9e3 service cinder] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:34.516787 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a01e29-504f-41b1-9685-5babf909b9e3 service cinder] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:34.521182 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a122e-449f-4fad-a0ef-450d5a1aebfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:34.522034 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a122e-449f-4fad-a0ef-450d5a1aebfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:34.522312 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a122e-449f-4fad-a0ef-450d5a1aebfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:34.522580 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a122e-449f-4fad-a0ef-450d5a1aebfe admin admin] PATH_INFO: `/v3/users/6e8dcb5b86b94f3cabaea3f0f1c0bf1f` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:34.523814 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a122e-449f-4fad-a0ef-450d5a1aebfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e8dcb5b86b94f3cabaea3f0f1c0bf1f)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:34.525789 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a122e-449f-4fad-a0ef-450d5a1aebfe admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:34.689086 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:INSERT=5,keystone:SELECT=90,keystone:DELETE=5 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:34:34.697545 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-207a122e-449f-4fad-a0ef-450d5a1aebfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e8dcb5b86b94f3cabaea3f0f1c0bf1f'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:34.709089 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-207a122e-449f-4fad-a0ef-450d5a1aebfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e8dcb5b86b94f3cabaea3f0f1c0bf1f'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:34.709754 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-207a122e-449f-4fad-a0ef-450d5a1aebfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e8dcb5b86b94f3cabaea3f0f1c0bf1f'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:34.717501 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-207a122e-449f-4fad-a0ef-450d5a1aebfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e8dcb5b86b94f3cabaea3f0f1c0bf1f'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:34.721737 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-207a122e-449f-4fad-a0ef-450d5a1aebfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e8dcb5b86b94f3cabaea3f0f1c0bf1f'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:34.808939 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1412/2832] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:34:34 2022] DELETE /identity/v3/users/6e8dcb5b86b94f3cabaea3f0f1c0bf1f => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:34:34.813618 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53339f3-37f1-4c6e-b071-82fc158fed5e None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:34.813913 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53339f3-37f1-4c6e-b071-82fc158fed5e None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:34.814189 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53339f3-37f1-4c6e-b071-82fc158fed5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:34.832288 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-c53339f3-37f1-4c6e-b071-82fc158fed5e None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:34:34.836885 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-c53339f3-37f1-4c6e-b071-82fc158fed5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:34:34.891412 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1421/2833] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:34:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:34:34.902082 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a122e-449f-4fad-a0ef-450d5a1aebfe admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:34.903460 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-207a122e-449f-4fad-a0ef-450d5a1aebfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:34:34.959102 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a122e-449f-4fad-a0ef-450d5a1aebfe admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:34.963281 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20bce36-e298-45c3-82b8-5892eec3da47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:34.963948 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bce36-e298-45c3-82b8-5892eec3da47 service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:34.964288 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bce36-e298-45c3-82b8-5892eec3da47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:34.964565 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bce36-e298-45c3-82b8-5892eec3da47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:34.973390 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20bce36-e298-45c3-82b8-5892eec3da47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:34.974836 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20bce36-e298-45c3-82b8-5892eec3da47 service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:34.984305 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1413/2834] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:34:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:34:35.399209 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53339f3-37f1-4c6e-b071-82fc158fed5e None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:35.400812 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-c53339f3-37f1-4c6e-b071-82fc158fed5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:34:35.413810 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53339f3-37f1-4c6e-b071-82fc158fed5e None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:35.419372 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66910e-130c-4409-8494-1d42018370fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:35.420284 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66910e-130c-4409-8494-1d42018370fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:35.420564 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66910e-130c-4409-8494-1d42018370fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:35.420844 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66910e-130c-4409-8494-1d42018370fe admin admin] PATH_INFO: `/v3/projects/e362f7212ad446d6b6acd50a730c4e79` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:35.422089 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66910e-130c-4409-8494-1d42018370fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=e362f7212ad446d6b6acd50a730c4e79)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:35.424013 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66910e-130c-4409-8494-1d42018370fe admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:35.529120 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-fe66910e-130c-4409-8494-1d42018370fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e362f7212ad446d6b6acd50a730c4e79', 'request_id': 'req-fe66910e-130c-4409-8494-1d42018370fe'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:35.535406 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-fe66910e-130c-4409-8494-1d42018370fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e362f7212ad446d6b6acd50a730c4e79', 'request_id': 'req-fe66910e-130c-4409-8494-1d42018370fe'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:35.540721 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:34:35.541897 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-fe66910e-130c-4409-8494-1d42018370fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e362f7212ad446d6b6acd50a730c4e79', 'request_id': 'req-fe66910e-130c-4409-8494-1d42018370fe'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:35.626825 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-fe66910e-130c-4409-8494-1d42018370fe admin admin] The token cache is being invalidate because project e362f7212ad446d6b6acd50a730c4e79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:34:35.627108 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-fe66910e-130c-4409-8494-1d42018370fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:35.627725 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-fe66910e-130c-4409-8494-1d42018370fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:35.629331 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1422/2835] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:34:35 2022] DELETE /identity/v3/projects/e362f7212ad446d6b6acd50a730c4e79 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:34:35.633967 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20bce36-e298-45c3-82b8-5892eec3da47 service neutron] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:35.643861 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20bce36-e298-45c3-82b8-5892eec3da47 service neutron] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:35.699765 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb526c65-fd95-4b29-baff-0d73bea0a5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:35.700664 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb526c65-fd95-4b29-baff-0d73bea0a5af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:35.700946 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb526c65-fd95-4b29-baff-0d73bea0a5af admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:35.701219 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb526c65-fd95-4b29-baff-0d73bea0a5af admin admin] PATH_INFO: `/v3/users/fb8ae0e1159c44168a3cb1e595791c55` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:35.702393 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb526c65-fd95-4b29-baff-0d73bea0a5af admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb8ae0e1159c44168a3cb1e595791c55)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:35.704337 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb526c65-fd95-4b29-baff-0d73bea0a5af admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:35.865814 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-fb526c65-fd95-4b29-baff-0d73bea0a5af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb8ae0e1159c44168a3cb1e595791c55'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:35.873683 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:34:35.877943 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-fb526c65-fd95-4b29-baff-0d73bea0a5af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb8ae0e1159c44168a3cb1e595791c55'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:35.878609 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-fb526c65-fd95-4b29-baff-0d73bea0a5af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb8ae0e1159c44168a3cb1e595791c55'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:35.885864 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-fb526c65-fd95-4b29-baff-0d73bea0a5af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb8ae0e1159c44168a3cb1e595791c55'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:35.886669 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-fb526c65-fd95-4b29-baff-0d73bea0a5af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb8ae0e1159c44168a3cb1e595791c55'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:35.947538 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1414/2836] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:34:35 2022] DELETE /identity/v3/users/fb8ae0e1159c44168a3cb1e595791c55 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:34:36.315381 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66910e-130c-4409-8494-1d42018370fe admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:36.316839 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-fe66910e-130c-4409-8494-1d42018370fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:34:36.332199 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66910e-130c-4409-8494-1d42018370fe admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:36.391307 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15baee7-78f1-463a-94b8-698915003f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:36.392171 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15baee7-78f1-463a-94b8-698915003f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:36.392460 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15baee7-78f1-463a-94b8-698915003f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:36.392731 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15baee7-78f1-463a-94b8-698915003f2e admin admin] PATH_INFO: `/v3/projects/ab07c8af11024a85b38aeeba1d2b5b53` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:36.393909 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15baee7-78f1-463a-94b8-698915003f2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab07c8af11024a85b38aeeba1d2b5b53)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:36.395804 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15baee7-78f1-463a-94b8-698915003f2e admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:36.514026 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-d15baee7-78f1-463a-94b8-698915003f2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab07c8af11024a85b38aeeba1d2b5b53', 'request_id': 'req-d15baee7-78f1-463a-94b8-698915003f2e'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:36.520305 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-d15baee7-78f1-463a-94b8-698915003f2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab07c8af11024a85b38aeeba1d2b5b53', 'request_id': 'req-d15baee7-78f1-463a-94b8-698915003f2e'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:36.526166 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-d15baee7-78f1-463a-94b8-698915003f2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab07c8af11024a85b38aeeba1d2b5b53', 'request_id': 'req-d15baee7-78f1-463a-94b8-698915003f2e'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:36.604267 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-d15baee7-78f1-463a-94b8-698915003f2e admin admin] The token cache is being invalidate because project ab07c8af11024a85b38aeeba1d2b5b53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:34:36.604496 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-d15baee7-78f1-463a-94b8-698915003f2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:36.605087 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-d15baee7-78f1-463a-94b8-698915003f2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:34:36.606657 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1423/2837] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:34:36 2022] DELETE /identity/v3/projects/ab07c8af11024a85b38aeeba1d2b5b53 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:34:36.611704 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdfaf99-9a63-4510-8051-b21c5945a21e None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:36.612023 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdfaf99-9a63-4510-8051-b21c5945a21e None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:36.612340 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdfaf99-9a63-4510-8051-b21c5945a21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:36.629940 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-3cdfaf99-9a63-4510-8051-b21c5945a21e None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:34:36.631380 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-3cdfaf99-9a63-4510-8051-b21c5945a21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:34:36.689844 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1415/2838] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:34:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:34:36.697824 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdebc9-6b73-4c27-a41c-588113fafed1 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:36.698112 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdebc9-6b73-4c27-a41c-588113fafed1 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:36.698391 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdebc9-6b73-4c27-a41c-588113fafed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:36.716919 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-7bfdebc9-6b73-4c27-a41c-588113fafed1 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:34:36.718109 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-7bfdebc9-6b73-4c27-a41c-588113fafed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:34:36.725983 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1424/2839] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:34:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:34:36.730706 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdfaf99-9a63-4510-8051-b21c5945a21e None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:36.740435 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdfaf99-9a63-4510-8051-b21c5945a21e None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:36.745131 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542bd3a-dcfb-4992-a496-1b2e7b2518f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:36.745773 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542bd3a-dcfb-4992-a496-1b2e7b2518f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:36.746054 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542bd3a-dcfb-4992-a496-1b2e7b2518f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:36.746330 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542bd3a-dcfb-4992-a496-1b2e7b2518f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:36.747056 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d542bd3a-dcfb-4992-a496-1b2e7b2518f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:34:36.747339 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d542bd3a-dcfb-4992-a496-1b2e7b2518f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:36.748980 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d542bd3a-dcfb-4992-a496-1b2e7b2518f1 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:36.760764 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1416/2840] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:34:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:34:36.765130 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfdebc9-6b73-4c27-a41c-588113fafed1 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:36.774932 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfdebc9-6b73-4c27-a41c-588113fafed1 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:36.779557 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13166f15-719c-427b-a44c-4188758945a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:36.780233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13166f15-719c-427b-a44c-4188758945a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:36.780523 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13166f15-719c-427b-a44c-4188758945a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:36.780799 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13166f15-719c-427b-a44c-4188758945a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:36.781475 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13166f15-719c-427b-a44c-4188758945a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:36.783370 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13166f15-719c-427b-a44c-4188758945a8 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:36.878876 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1425/2841] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:34:36 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:34:36.883991 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542bd3a-dcfb-4992-a496-1b2e7b2518f1 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:36.893956 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542bd3a-dcfb-4992-a496-1b2e7b2518f1 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:36.950331 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62705dbd-abce-41cb-afd1-bc839789f0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:36.950998 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62705dbd-abce-41cb-afd1-bc839789f0a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:36.951281 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62705dbd-abce-41cb-afd1-bc839789f0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:36.951555 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62705dbd-abce-41cb-afd1-bc839789f0a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:36.952269 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62705dbd-abce-41cb-afd1-bc839789f0a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:36.954191 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62705dbd-abce-41cb-afd1-bc839789f0a0 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:37.012211 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1417/2842] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:34:36 2022] POST /identity/v3/users => generated 289 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:34:37.016035 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13166f15-719c-427b-a44c-4188758945a8 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:37.027215 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13166f15-719c-427b-a44c-4188758945a8 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:37.031816 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870bc5c-3e9f-4c94-9f28-d5d5f0a21ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:37.032509 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870bc5c-3e9f-4c94-9f28-d5d5f0a21ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:37.032822 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870bc5c-3e9f-4c94-9f28-d5d5f0a21ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:37.033100 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870bc5c-3e9f-4c94-9f28-d5d5f0a21ee0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:37.033820 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9870bc5c-3e9f-4c94-9f28-d5d5f0a21ee0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:37.035423 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9870bc5c-3e9f-4c94-9f28-d5d5f0a21ee0 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:37.046360 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1426/2843] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:34:37.050329 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62705dbd-abce-41cb-afd1-bc839789f0a0 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:37.060560 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62705dbd-abce-41cb-afd1-bc839789f0a0 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:37.065172 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813095e6-7c21-4bfb-8593-1a983b282c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:37.065850 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813095e6-7c21-4bfb-8593-1a983b282c83 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:37.066132 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813095e6-7c21-4bfb-8593-1a983b282c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:37.066428 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813095e6-7c21-4bfb-8593-1a983b282c83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:37.067154 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813095e6-7c21-4bfb-8593-1a983b282c83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:37.068771 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813095e6-7c21-4bfb-8593-1a983b282c83 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:37.079283 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1418/2844] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:34:37.083164 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870bc5c-3e9f-4c94-9f28-d5d5f0a21ee0 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:37.093712 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870bc5c-3e9f-4c94-9f28-d5d5f0a21ee0 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:37.098229 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e3dec-6776-400f-a923-e8e8a1a863a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:37.099092 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e3dec-6776-400f-a923-e8e8a1a863a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:37.099372 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e3dec-6776-400f-a923-e8e8a1a863a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:37.099644 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e3dec-6776-400f-a923-e8e8a1a863a4 admin admin] PATH_INFO: `/v3/projects/d6330d079240406d942ac9f784995a7b/users/ac0e14172f44485b9598eae9d0c29d76/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:37.114166 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e3dec-6776-400f-a923-e8e8a1a863a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6330d079240406d942ac9f784995a7b, user_id=ac0e14172f44485b9598eae9d0c29d76, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:37.116844 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e3dec-6776-400f-a923-e8e8a1a863a4 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:37.210649 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1427/2845] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:34:37 2022] PUT /identity/v3/projects/d6330d079240406d942ac9f784995a7b/users/ac0e14172f44485b9598eae9d0c29d76/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:34:37.275634 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21fc167-8218-4e77-af67-4dea220790cb None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:37.275924 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21fc167-8218-4e77-af67-4dea220790cb None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:37.276237 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21fc167-8218-4e77-af67-4dea220790cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:37.302128 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-d21fc167-8218-4e77-af67-4dea220790cb None None] MFA Rules not processed for user `ac0e14172f44485b9598eae9d0c29d76`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:34:37.303325 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-d21fc167-8218-4e77-af67-4dea220790cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:34:37.333750 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:34:37.366090 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1419/2846] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:34:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:34:37.378402 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e3dec-6776-400f-a923-e8e8a1a863a4 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:34:37.380081 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-169e3dec-6776-400f-a923-e8e8a1a863a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:34:37.399741 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:34:37.436914 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e3dec-6776-400f-a923-e8e8a1a863a4 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:34:37.440536 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019a06d-e1b7-424e-a5ae-43b22d2617b7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60eeb0b3e37a4604ab8f8b73c2b021f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:34:37.441214 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019a06d-e1b7-424e-a5ae-43b22d2617b7 service glance] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:34:37.441497 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019a06d-e1b7-424e-a5ae-43b22d2617b7 service glance] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:34:37.441774 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019a06d-e1b7-424e-a5ae-43b22d2617b7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:34:37.450417 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c019a06d-e1b7-424e-a5ae-43b22d2617b7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:34:37.451857 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c019a06d-e1b7-424e-a5ae-43b22d2617b7 service glance] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:34:37.460896 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1428/2847] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:34:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:34:47.427672 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=13 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:34:47.514582 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=19 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:35:03.033470 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21fc167-8218-4e77-af67-4dea220790cb None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:35:03.097645 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21fc167-8218-4e77-af67-4dea220790cb None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:35:03.102297 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945b986-d4a3-4f9f-8ef8-479a8f1a5fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:35:03.103903 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945b986-d4a3-4f9f-8ef8-479a8f1a5fea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:35:03.104265 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945b986-d4a3-4f9f-8ef8-479a8f1a5fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:35:03.104551 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945b986-d4a3-4f9f-8ef8-479a8f1a5fea admin admin] PATH_INFO: `/v3/users/ac0e14172f44485b9598eae9d0c29d76` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:35:03.105724 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d945b986-d4a3-4f9f-8ef8-479a8f1a5fea admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac0e14172f44485b9598eae9d0c29d76)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:35:03.107637 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d945b986-d4a3-4f9f-8ef8-479a8f1a5fea admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:35:03.268748 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-d945b986-d4a3-4f9f-8ef8-479a8f1a5fea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac0e14172f44485b9598eae9d0c29d76'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:35:03.281850 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-d945b986-d4a3-4f9f-8ef8-479a8f1a5fea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac0e14172f44485b9598eae9d0c29d76'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:35:03.282534 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-d945b986-d4a3-4f9f-8ef8-479a8f1a5fea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac0e14172f44485b9598eae9d0c29d76'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:35:03.289388 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-d945b986-d4a3-4f9f-8ef8-479a8f1a5fea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac0e14172f44485b9598eae9d0c29d76'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:35:03.290003 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-d945b986-d4a3-4f9f-8ef8-479a8f1a5fea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac0e14172f44485b9598eae9d0c29d76'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:35:03.363818 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1420/2848] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:35:03 2022] DELETE /identity/v3/users/ac0e14172f44485b9598eae9d0c29d76 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:35:03.368349 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35362d-e11c-4a3d-947a-204c9a29bfa9 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:35:03.368851 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35362d-e11c-4a3d-947a-204c9a29bfa9 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:35:03.368963 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35362d-e11c-4a3d-947a-204c9a29bfa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:35:03.387423 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-cf35362d-e11c-4a3d-947a-204c9a29bfa9 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:35:03.388648 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-cf35362d-e11c-4a3d-947a-204c9a29bfa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:35:03.445669 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1429/2849] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:35:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:35:03.455851 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945b986-d4a3-4f9f-8ef8-479a8f1a5fea admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:35:03.457287 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-d945b986-d4a3-4f9f-8ef8-479a8f1a5fea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:35:03.514284 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945b986-d4a3-4f9f-8ef8-479a8f1a5fea admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:35:03.517891 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65d482-4586-4562-80e2-6d7d2f9ee7e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:35:03.518529 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65d482-4586-4562-80e2-6d7d2f9ee7e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:35:03.518862 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65d482-4586-4562-80e2-6d7d2f9ee7e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:35:03.519082 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65d482-4586-4562-80e2-6d7d2f9ee7e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:35:03.527895 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac65d482-4586-4562-80e2-6d7d2f9ee7e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:35:03.529360 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac65d482-4586-4562-80e2-6d7d2f9ee7e1 service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:35:03.538644 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1421/2850] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:35:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:35:03.942022 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35362d-e11c-4a3d-947a-204c9a29bfa9 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:35:03.947163 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-cf35362d-e11c-4a3d-947a-204c9a29bfa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:35:03.955634 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35362d-e11c-4a3d-947a-204c9a29bfa9 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:35:03.961000 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7218ab4-7ec4-4844-9f2f-4db793ad77d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:35:03.961905 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7218ab4-7ec4-4844-9f2f-4db793ad77d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:35:03.962279 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7218ab4-7ec4-4844-9f2f-4db793ad77d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:35:03.962684 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7218ab4-7ec4-4844-9f2f-4db793ad77d4 admin admin] PATH_INFO: `/v3/projects/d6330d079240406d942ac9f784995a7b` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:35:03.965096 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7218ab4-7ec4-4844-9f2f-4db793ad77d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6330d079240406d942ac9f784995a7b)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:35:03.967022 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7218ab4-7ec4-4844-9f2f-4db793ad77d4 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:35:04.078612 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-c7218ab4-7ec4-4844-9f2f-4db793ad77d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6330d079240406d942ac9f784995a7b', 'request_id': 'req-c7218ab4-7ec4-4844-9f2f-4db793ad77d4'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:35:04.084825 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-c7218ab4-7ec4-4844-9f2f-4db793ad77d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6330d079240406d942ac9f784995a7b', 'request_id': 'req-c7218ab4-7ec4-4844-9f2f-4db793ad77d4'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:35:04.090852 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-c7218ab4-7ec4-4844-9f2f-4db793ad77d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6330d079240406d942ac9f784995a7b', 'request_id': 'req-c7218ab4-7ec4-4844-9f2f-4db793ad77d4'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:35:04.163717 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-c7218ab4-7ec4-4844-9f2f-4db793ad77d4 admin admin] The token cache is being invalidate because project d6330d079240406d942ac9f784995a7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:35:04.164001 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-c7218ab4-7ec4-4844-9f2f-4db793ad77d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:35:04.164645 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-c7218ab4-7ec4-4844-9f2f-4db793ad77d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:35:04.166726 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1430/2851] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:35:03 2022] DELETE /identity/v3/projects/d6330d079240406d942ac9f784995a7b => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:35:04.171613 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691fb60-2e16-4104-9326-7ff99e1afebc None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:35:04.172099 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691fb60-2e16-4104-9326-7ff99e1afebc None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:35:04.172224 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691fb60-2e16-4104-9326-7ff99e1afebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:35:04.190119 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-b691fb60-2e16-4104-9326-7ff99e1afebc None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:35:04.191365 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-b691fb60-2e16-4104-9326-7ff99e1afebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:35:04.208207 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:35:04.251967 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1422/2852] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:35:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:35:04.260415 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b019c52-ff32-41ed-9f60-74b10e2e7da8 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:35:04.260707 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b019c52-ff32-41ed-9f60-74b10e2e7da8 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:35:04.262254 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b019c52-ff32-41ed-9f60-74b10e2e7da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:35:04.279762 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-3b019c52-ff32-41ed-9f60-74b10e2e7da8 None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:35:04.281182 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-3b019c52-ff32-41ed-9f60-74b10e2e7da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:35:04.289338 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1431/2853] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:35:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:35:04.293701 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b691fb60-2e16-4104-9326-7ff99e1afebc None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:35:04.303300 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b691fb60-2e16-4104-9326-7ff99e1afebc None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:35:04.308602 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d6728-b7fe-40d1-93e2-f08998144cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:35:04.309249 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d6728-b7fe-40d1-93e2-f08998144cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:35:04.309531 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d6728-b7fe-40d1-93e2-f08998144cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:35:04.309808 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d6728-b7fe-40d1-93e2-f08998144cf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:35:04.310525 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d6728-b7fe-40d1-93e2-f08998144cf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:35:04.310830 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d6728-b7fe-40d1-93e2-f08998144cf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:35:04.312471 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d6728-b7fe-40d1-93e2-f08998144cf4 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:35:04.324578 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1423/2854] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:35:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 13:35:04.328827 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b019c52-ff32-41ed-9f60-74b10e2e7da8 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:35:04.338125 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b019c52-ff32-41ed-9f60-74b10e2e7da8 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:35:04.342700 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f1f84-1bfa-4d47-92b5-4684f84903ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:35:04.343346 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f1f84-1bfa-4d47-92b5-4684f84903ec admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:35:04.343627 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f1f84-1bfa-4d47-92b5-4684f84903ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:35:04.343903 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f1f84-1bfa-4d47-92b5-4684f84903ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:35:04.344655 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820f1f84-1bfa-4d47-92b5-4684f84903ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:35:04.346551 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820f1f84-1bfa-4d47-92b5-4684f84903ec admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:35:04.428875 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1432/2855] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:35:04 2022] POST /identity/v3/projects => generated 361 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:35:04.433605 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d6728-b7fe-40d1-93e2-f08998144cf4 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:35:04.443865 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d6728-b7fe-40d1-93e2-f08998144cf4 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:35:04.501620 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55606e-1843-4eed-a7cf-ff9bc96c78a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:35:04.502320 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55606e-1843-4eed-a7cf-ff9bc96c78a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:35:04.502607 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55606e-1843-4eed-a7cf-ff9bc96c78a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:35:04.502886 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55606e-1843-4eed-a7cf-ff9bc96c78a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:35:04.503611 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55606e-1843-4eed-a7cf-ff9bc96c78a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:35:04.505605 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55606e-1843-4eed-a7cf-ff9bc96c78a2 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:35:04.597671 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1424/2856] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:35:04 2022] POST /identity/v3/users => generated 281 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:35:04.601668 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f1f84-1bfa-4d47-92b5-4684f84903ec admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:35:04.612620 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f1f84-1bfa-4d47-92b5-4684f84903ec admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:35:04.617247 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6caa3-9996-41cf-83ed-1bb0943f6e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:35:04.617893 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6caa3-9996-41cf-83ed-1bb0943f6e04 admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:35:04.618174 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6caa3-9996-41cf-83ed-1bb0943f6e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:35:04.618482 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6caa3-9996-41cf-83ed-1bb0943f6e04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:35:04.619825 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c6caa3-9996-41cf-83ed-1bb0943f6e04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:35:04.621450 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c6caa3-9996-41cf-83ed-1bb0943f6e04 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:35:04.632018 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1433/2857] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 13:35:04.635968 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55606e-1843-4eed-a7cf-ff9bc96c78a2 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:35:04.646092 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55606e-1843-4eed-a7cf-ff9bc96c78a2 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:35:04.650792 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56d254-3aae-486b-a233-720d62a1c27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:35:04.651444 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56d254-3aae-486b-a233-720d62a1c27a admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:35:04.651728 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56d254-3aae-486b-a233-720d62a1c27a admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:35:04.652004 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56d254-3aae-486b-a233-720d62a1c27a admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:35:04.652759 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc56d254-3aae-486b-a233-720d62a1c27a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:35:04.654334 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc56d254-3aae-486b-a233-720d62a1c27a admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:35:04.664167 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1425/2858] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:35:04.668830 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6caa3-9996-41cf-83ed-1bb0943f6e04 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:35:04.679717 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6caa3-9996-41cf-83ed-1bb0943f6e04 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:35:04.685150 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4ef55-d597-40d7-8cea-32b142cbd4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:35:04.686025 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4ef55-d597-40d7-8cea-32b142cbd4eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:35:04.686316 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4ef55-d597-40d7-8cea-32b142cbd4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:35:04.686595 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4ef55-d597-40d7-8cea-32b142cbd4eb admin admin] PATH_INFO: `/v3/projects/64b9df92652c4dc591d895e0209917bd/users/ab1c96900a9a401bbdc748398fc4f715/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:35:04.701828 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4ef55-d597-40d7-8cea-32b142cbd4eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=64b9df92652c4dc591d895e0209917bd, user_id=ab1c96900a9a401bbdc748398fc4f715, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:35:04.704514 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4ef55-d597-40d7-8cea-32b142cbd4eb admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:35:04.764573 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1434/2859] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:35:04 2022] PUT /identity/v3/projects/64b9df92652c4dc591d895e0209917bd/users/ab1c96900a9a401bbdc748398fc4f715/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:35:04.776213 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf971e-d93e-4977-9db4-2803274edbfa None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:35:04.776510 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf971e-d93e-4977-9db4-2803274edbfa None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:35:04.776788 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf971e-d93e-4977-9db4-2803274edbfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:35:04.803740 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-4faf971e-d93e-4977-9db4-2803274edbfa None None] MFA Rules not processed for user `ab1c96900a9a401bbdc748398fc4f715`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:35:04.805000 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-4faf971e-d93e-4977-9db4-2803274edbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:35:04.868969 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1426/2860] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:35:04 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:35:04.900404 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4ef55-d597-40d7-8cea-32b142cbd4eb admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:35:04.902082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-b2f4ef55-d597-40d7-8cea-32b142cbd4eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:35:04.923967 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:35:04.960029 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4ef55-d597-40d7-8cea-32b142cbd4eb admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:35:04.963930 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef598ecb-02ed-47bd-ad3a-d25a3a43e53b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:35:04.964603 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef598ecb-02ed-47bd-ad3a-d25a3a43e53b service cinder] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:35:04.964885 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef598ecb-02ed-47bd-ad3a-d25a3a43e53b service cinder] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:35:04.965159 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef598ecb-02ed-47bd-ad3a-d25a3a43e53b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:35:04.973517 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef598ecb-02ed-47bd-ad3a-d25a3a43e53b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:35:04.975079 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef598ecb-02ed-47bd-ad3a-d25a3a43e53b service cinder] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:35:04.985282 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1435/2861] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:35:04 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:35:05.000868 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf971e-d93e-4977-9db4-2803274edbfa None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:35:05.020673 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:35:05.064793 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf971e-d93e-4977-9db4-2803274edbfa None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:35:05.069271 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61ddea-68a8-452b-a2b5-b066aad301f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:35:05.070138 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61ddea-68a8-452b-a2b5-b066aad301f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:35:05.070413 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61ddea-68a8-452b-a2b5-b066aad301f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:35:05.070684 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61ddea-68a8-452b-a2b5-b066aad301f5 admin admin] PATH_INFO: `/v3/users/ab1c96900a9a401bbdc748398fc4f715` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:35:05.071972 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c61ddea-68a8-452b-a2b5-b066aad301f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab1c96900a9a401bbdc748398fc4f715)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:35:05.073907 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c61ddea-68a8-452b-a2b5-b066aad301f5 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:35:05.223187 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-1c61ddea-68a8-452b-a2b5-b066aad301f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab1c96900a9a401bbdc748398fc4f715'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:35:05.235790 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-1c61ddea-68a8-452b-a2b5-b066aad301f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab1c96900a9a401bbdc748398fc4f715'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:35:05.236528 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-1c61ddea-68a8-452b-a2b5-b066aad301f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab1c96900a9a401bbdc748398fc4f715'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:35:05.243430 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-1c61ddea-68a8-452b-a2b5-b066aad301f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab1c96900a9a401bbdc748398fc4f715'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:35:05.244121 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-1c61ddea-68a8-452b-a2b5-b066aad301f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab1c96900a9a401bbdc748398fc4f715'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:35:05.340515 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1427/2862] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:35:04 2022] DELETE /identity/v3/users/ab1c96900a9a401bbdc748398fc4f715 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:35:05.345582 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd3a89-7cbe-4369-a351-95d40c3b290e None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:35:05.345871 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd3a89-7cbe-4369-a351-95d40c3b290e None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:35:05.346148 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd3a89-7cbe-4369-a351-95d40c3b290e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:35:05.364056 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-dcfd3a89-7cbe-4369-a351-95d40c3b290e None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:35:05.365271 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-dcfd3a89-7cbe-4369-a351-95d40c3b290e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:35:05.423735 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1436/2863] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:35:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:35:05.434090 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61ddea-68a8-452b-a2b5-b066aad301f5 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:35:05.435517 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-1c61ddea-68a8-452b-a2b5-b066aad301f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:35:05.492620 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61ddea-68a8-452b-a2b5-b066aad301f5 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:35:05.496805 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63ed12-2f17-4e9c-a372-fe0174e71658 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:35:05.497446 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63ed12-2f17-4e9c-a372-fe0174e71658 service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:35:05.497728 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63ed12-2f17-4e9c-a372-fe0174e71658 service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:35:05.498004 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63ed12-2f17-4e9c-a372-fe0174e71658 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:35:05.507243 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc63ed12-2f17-4e9c-a372-fe0174e71658 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:35:05.508734 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc63ed12-2f17-4e9c-a372-fe0174e71658 service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:35:05.518211 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1428/2864] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:35:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:35:05.904044 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd3a89-7cbe-4369-a351-95d40c3b290e None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:35:05.905489 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-dcfd3a89-7cbe-4369-a351-95d40c3b290e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:35:05.918444 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd3a89-7cbe-4369-a351-95d40c3b290e None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:35:05.923231 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f11c0-858e-4a91-92d1-911c219300dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:35:05.924093 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f11c0-858e-4a91-92d1-911c219300dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:35:05.924411 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f11c0-858e-4a91-92d1-911c219300dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:35:05.924691 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f11c0-858e-4a91-92d1-911c219300dd admin admin] PATH_INFO: `/v3/projects/64b9df92652c4dc591d895e0209917bd` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:35:05.925872 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552f11c0-858e-4a91-92d1-911c219300dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=64b9df92652c4dc591d895e0209917bd)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:35:05.927813 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552f11c0-858e-4a91-92d1-911c219300dd admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:35:06.055559 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-552f11c0-858e-4a91-92d1-911c219300dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64b9df92652c4dc591d895e0209917bd', 'request_id': 'req-552f11c0-858e-4a91-92d1-911c219300dd'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:35:06.061851 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-552f11c0-858e-4a91-92d1-911c219300dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64b9df92652c4dc591d895e0209917bd', 'request_id': 'req-552f11c0-858e-4a91-92d1-911c219300dd'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:35:06.067604 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-552f11c0-858e-4a91-92d1-911c219300dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64b9df92652c4dc591d895e0209917bd', 'request_id': 'req-552f11c0-858e-4a91-92d1-911c219300dd'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:35:06.141103 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-552f11c0-858e-4a91-92d1-911c219300dd admin admin] The token cache is being invalidate because project 64b9df92652c4dc591d895e0209917bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:35:06.141393 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-552f11c0-858e-4a91-92d1-911c219300dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:35:06.142151 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-552f11c0-858e-4a91-92d1-911c219300dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:35:06.143846 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1437/2865] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:35:05 2022] DELETE /identity/v3/projects/64b9df92652c4dc591d895e0209917bd => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:35:06.148585 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62afef16-f4f3-4a8b-9693-2266678eee9e None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:35:06.148868 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62afef16-f4f3-4a8b-9693-2266678eee9e None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:35:06.149164 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62afef16-f4f3-4a8b-9693-2266678eee9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:35:06.168737 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-62afef16-f4f3-4a8b-9693-2266678eee9e None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:35:06.170365 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-62afef16-f4f3-4a8b-9693-2266678eee9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:35:06.206470 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:35:06.232216 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1429/2866] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:35:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:35:06.239920 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85887243-3130-4024-8611-9cc28b0d118e None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:35:06.240236 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85887243-3130-4024-8611-9cc28b0d118e None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:35:06.240538 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85887243-3130-4024-8611-9cc28b0d118e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:35:06.259653 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-85887243-3130-4024-8611-9cc28b0d118e None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:35:06.260978 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-85887243-3130-4024-8611-9cc28b0d118e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:35:06.269087 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1438/2867] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:35:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:35:06.273398 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62afef16-f4f3-4a8b-9693-2266678eee9e None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:35:06.285019 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62afef16-f4f3-4a8b-9693-2266678eee9e None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:35:06.290192 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4550f-dc54-4431-91d2-21cae672eac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:35:06.290960 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4550f-dc54-4431-91d2-21cae672eac6 admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:35:06.291271 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4550f-dc54-4431-91d2-21cae672eac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:35:06.291550 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4550f-dc54-4431-91d2-21cae672eac6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:35:06.292310 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b4550f-dc54-4431-91d2-21cae672eac6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 13:35:06.292634 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b4550f-dc54-4431-91d2-21cae672eac6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:35:06.294524 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b4550f-dc54-4431-91d2-21cae672eac6 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:35:06.311013 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1430/2868] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jun 3 13:35:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 13:35:06.312065 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85887243-3130-4024-8611-9cc28b0d118e None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:35:06.321970 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85887243-3130-4024-8611-9cc28b0d118e None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:35:06.326743 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa491c9-9c0e-4e85-9215-9773bb24ca8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:35:06.327389 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa491c9-9c0e-4e85-9215-9773bb24ca8b admin admin] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:35:06.327669 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa491c9-9c0e-4e85-9215-9773bb24ca8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:35:06.327944 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa491c9-9c0e-4e85-9215-9773bb24ca8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:35:06.328705 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa491c9-9c0e-4e85-9215-9773bb24ca8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:35:06.330823 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa491c9-9c0e-4e85-9215-9773bb24ca8b admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:35:06.446333 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1439/2869] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jun 3 13:35:06 2022] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 13:35:06.450762 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4550f-dc54-4431-91d2-21cae672eac6 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:35:06.460700 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4550f-dc54-4431-91d2-21cae672eac6 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:35:06.516507 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de866c8-fb79-4f43-ac08-0bf8ad7be1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:35:06.517170 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de866c8-fb79-4f43-ac08-0bf8ad7be1e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:35:06.517452 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de866c8-fb79-4f43-ac08-0bf8ad7be1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:35:06.517730 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de866c8-fb79-4f43-ac08-0bf8ad7be1e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:35:06.518398 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de866c8-fb79-4f43-ac08-0bf8ad7be1e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:35:06.520316 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de866c8-fb79-4f43-ac08-0bf8ad7be1e9 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:35:06.615844 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1431/2870] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jun 3 13:35:06 2022] POST /identity/v3/users => generated 291 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 13:35:06.620005 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa491c9-9c0e-4e85-9215-9773bb24ca8b admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:35:06.630522 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa491c9-9c0e-4e85-9215-9773bb24ca8b admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:35:06.635515 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c673b-2a70-4ee4-a0a6-fd2021ada92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:35:06.636192 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c673b-2a70-4ee4-a0a6-fd2021ada92c admin admin] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:35:06.636479 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c673b-2a70-4ee4-a0a6-fd2021ada92c admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:35:06.636751 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c673b-2a70-4ee4-a0a6-fd2021ada92c admin admin] PATH_INFO: `/v3/roles` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:35:06.637486 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c673b-2a70-4ee4-a0a6-fd2021ada92c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:35:06.639081 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c673b-2a70-4ee4-a0a6-fd2021ada92c admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:35:06.649381 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1440/2871] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:35:06.653783 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de866c8-fb79-4f43-ac08-0bf8ad7be1e9 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:35:06.663569 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de866c8-fb79-4f43-ac08-0bf8ad7be1e9 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:35:06.669606 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf86c22a-26a6-467b-b427-e6315612033a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:35:06.670265 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86c22a-26a6-467b-b427-e6315612033a admin admin] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:35:06.670548 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86c22a-26a6-467b-b427-e6315612033a admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:35:06.670832 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86c22a-26a6-467b-b427-e6315612033a admin admin] PATH_INFO: `/v3/roles` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:35:06.671577 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf86c22a-26a6-467b-b427-e6315612033a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:35:06.673236 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf86c22a-26a6-467b-b427-e6315612033a admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:35:06.683685 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1432/2872] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jun 3 13:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 13:35:06.687812 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c673b-2a70-4ee4-a0a6-fd2021ada92c admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:35:06.698062 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c673b-2a70-4ee4-a0a6-fd2021ada92c admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:35:06.702532 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee55995-8e25-4679-8e58-447a69931047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:35:06.703398 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee55995-8e25-4679-8e58-447a69931047 admin admin] REQUEST_METHOD: `PUT` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:35:06.703679 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee55995-8e25-4679-8e58-447a69931047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:35:06.703949 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee55995-8e25-4679-8e58-447a69931047 admin admin] PATH_INFO: `/v3/projects/bd537e9d76aa492dab87422257286816/users/3b71f0a1eb994da09f9a3336f2fe6eeb/roles/d082d2b37fd1455ea61819353e8369ed` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:35:06.706293 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:35:06.719706 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee55995-8e25-4679-8e58-447a69931047 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd537e9d76aa492dab87422257286816, user_id=3b71f0a1eb994da09f9a3336f2fe6eeb, role_id=d082d2b37fd1455ea61819353e8369ed)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:35:06.722394 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee55995-8e25-4679-8e58-447a69931047 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:35:06.793738 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1441/2873] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jun 3 13:35:06 2022] PUT /identity/v3/projects/bd537e9d76aa492dab87422257286816/users/3b71f0a1eb994da09f9a3336f2fe6eeb/roles/d082d2b37fd1455ea61819353e8369ed => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:35:06.798755 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890fec35-4818-4472-9748-c5dc97ddd03f None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:35:06.799043 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890fec35-4818-4472-9748-c5dc97ddd03f None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:35:06.799350 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890fec35-4818-4472-9748-c5dc97ddd03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:35:06.816677 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-890fec35-4818-4472-9748-c5dc97ddd03f None None] MFA Rules not processed for user `31e8e6595d7242a98c3388e4c3784e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:35:06.817857 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-890fec35-4818-4472-9748-c5dc97ddd03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:35:06.875825 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1433/2874] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:35:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:35:06.886277 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee55995-8e25-4679-8e58-447a69931047 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:35:06.887967 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-eee55995-8e25-4679-8e58-447a69931047 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:35:06.944621 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee55995-8e25-4679-8e58-447a69931047 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:35:06.948826 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd5c12-7f14-448e-aa6e-0126fc6882a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:35:06.952439 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd5c12-7f14-448e-aa6e-0126fc6882a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:35:06.952439 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd5c12-7f14-448e-aa6e-0126fc6882a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:35:06.952439 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd5c12-7f14-448e-aa6e-0126fc6882a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:35:06.959647 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd5c12-7f14-448e-aa6e-0126fc6882a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:35:06.961762 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd5c12-7f14-448e-aa6e-0126fc6882a1 service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:35:06.972754 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1442/2875] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:35:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:35:08.193920 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b3ce8-4faf-476a-96d0-ee9ef8185543 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:35:08.194477 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b3ce8-4faf-476a-96d0-ee9ef8185543 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:35:08.194477 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b3ce8-4faf-476a-96d0-ee9ef8185543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:35:08.223944 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-7f9b3ce8-4faf-476a-96d0-ee9ef8185543 None None] MFA Rules not processed for user `3b71f0a1eb994da09f9a3336f2fe6eeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:35:08.225176 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-7f9b3ce8-4faf-476a-96d0-ee9ef8185543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:35:08.262992 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:35:08.293479 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1434/2876] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:35:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:35:08.304450 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd5c12-7f14-448e-aa6e-0126fc6882a1 service neutron] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:35:08.306411 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-8cdd5c12-7f14-448e-aa6e-0126fc6882a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:35:08.363748 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd5c12-7f14-448e-aa6e-0126fc6882a1 service neutron] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:35:08.367119 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e263c6-a2e2-48c9-9420-41171b865289 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303176c26fc74d4892b2f83c81f01b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:35:08.367756 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e263c6-a2e2-48c9-9420-41171b865289 service cinder] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:35:08.368034 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e263c6-a2e2-48c9-9420-41171b865289 service cinder] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:35:08.368932 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e263c6-a2e2-48c9-9420-41171b865289 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:35:08.377216 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e263c6-a2e2-48c9-9420-41171b865289 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:35:08.378737 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e263c6-a2e2-48c9-9420-41171b865289 service cinder] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:35:08.387758 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1443/2877] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:35:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:35:10.059917 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5803d30-8432-42a2-ac78-f48e6f763964 None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:35:10.060520 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5803d30-8432-42a2-ac78-f48e6f763964 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:35:10.060520 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5803d30-8432-42a2-ac78-f48e6f763964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:35:10.077944 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-f5803d30-8432-42a2-ac78-f48e6f763964 None None] MFA Rules not processed for user `3b71f0a1eb994da09f9a3336f2fe6eeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:35:10.079145 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-f5803d30-8432-42a2-ac78-f48e6f763964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:35:10.086028 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1435/2878] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:35:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:35:10.318013 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e263c6-a2e2-48c9-9420-41171b865289 service cinder] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:35:10.330477 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e263c6-a2e2-48c9-9420-41171b865289 service cinder] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:35:10.333980 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9baf64-afac-4119-b794-b284598936bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:35:10.334612 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9baf64-afac-4119-b794-b284598936bb service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:35:10.334892 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9baf64-afac-4119-b794-b284598936bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:35:10.335166 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9baf64-afac-4119-b794-b284598936bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:35:10.337023 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-3d9baf64-afac-4119-b794-b284598936bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:35:10.346579 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9baf64-afac-4119-b794-b284598936bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:35:10.348010 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9baf64-afac-4119-b794-b284598936bb service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:35:10.356189 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1444/2879] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:35:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:35:12.132476 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5803d30-8432-42a2-ac78-f48e6f763964 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:35:12.133973 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-f5803d30-8432-42a2-ac78-f48e6f763964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:35:12.223168 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5803d30-8432-42a2-ac78-f48e6f763964 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:35:12.228911 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5a40f-d773-411d-a7be-db35d369c3ea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5c4ad16c9454b74ae8445b115cf0af4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:35:12.229546 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5a40f-d773-411d-a7be-db35d369c3ea service placement] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:35:12.229829 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5a40f-d773-411d-a7be-db35d369c3ea service placement] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:35:12.230103 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5a40f-d773-411d-a7be-db35d369c3ea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:35:12.231875 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-9ed5a40f-d773-411d-a7be-db35d369c3ea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:35:12.243101 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed5a40f-d773-411d-a7be-db35d369c3ea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:35:12.245251 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed5a40f-d773-411d-a7be-db35d369c3ea service placement] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:35:12.255319 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1436/2880] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:35:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 13:35:20.353075 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=65,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:35:22.250911 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=55 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:35:22.712667 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9baf64-afac-4119-b794-b284598936bb service neutron] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:35:22.714384 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-3d9baf64-afac-4119-b794-b284598936bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:35:22.796966 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9baf64-afac-4119-b794-b284598936bb service neutron] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:35:22.802574 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f790d65-0d38-4538-8ea2-1a8db070832b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066aaba3e9af4f85ab0cba89a3d32e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:35:22.803266 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f790d65-0d38-4538-8ea2-1a8db070832b service nova] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:35:22.803669 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f790d65-0d38-4538-8ea2-1a8db070832b service nova] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:35:22.804076 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f790d65-0d38-4538-8ea2-1a8db070832b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:35:22.805953 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-4f790d65-0d38-4538-8ea2-1a8db070832b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:35:22.819643 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f790d65-0d38-4538-8ea2-1a8db070832b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:35:22.821839 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f790d65-0d38-4538-8ea2-1a8db070832b service nova] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:35:22.832880 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1445/2881] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:35:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:35:32.828128 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=37 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:35:50.346519 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5a40f-d773-411d-a7be-db35d369c3ea service placement] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:35:50.348448 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-9ed5a40f-d773-411d-a7be-db35d369c3ea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:35:50.364672 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5a40f-d773-411d-a7be-db35d369c3ea service placement] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:35:50.371896 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d150d58-5ab6-450d-b944-c719c7274957 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066aaba3e9af4f85ab0cba89a3d32e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:35:50.372612 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d150d58-5ab6-450d-b944-c719c7274957 service nova] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:35:50.372901 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d150d58-5ab6-450d-b944-c719c7274957 service nova] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:35:50.373180 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d150d58-5ab6-450d-b944-c719c7274957 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:35:50.375109 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-5d150d58-5ab6-450d-b944-c719c7274957 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:35:50.388338 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d150d58-5ab6-450d-b944-c719c7274957 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:35:50.389934 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d150d58-5ab6-450d-b944-c719c7274957 service nova] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:35:50.403372 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1437/2882] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:35:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:35:56.737005 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f790d65-0d38-4538-8ea2-1a8db070832b service nova] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:35:56.743941 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-4f790d65-0d38-4538-8ea2-1a8db070832b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:35:56.752749 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f790d65-0d38-4538-8ea2-1a8db070832b service nova] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:35:56.759082 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180d957-f388-4559-b9ca-7de46749ee0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:35:56.760266 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180d957-f388-4559-b9ca-7de46749ee0e service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:35:56.760801 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180d957-f388-4559-b9ca-7de46749ee0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:35:56.761362 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180d957-f388-4559-b9ca-7de46749ee0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:35:56.764363 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-4180d957-f388-4559-b9ca-7de46749ee0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:35:56.778499 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4180d957-f388-4559-b9ca-7de46749ee0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:35:56.779938 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4180d957-f388-4559-b9ca-7de46749ee0e service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:35:56.790922 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1446/2883] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:35:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:36:00.206153 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d150d58-5ab6-450d-b944-c719c7274957 service nova] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:36:00.207739 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-5d150d58-5ab6-450d-b944-c719c7274957 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:36:00.222504 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d150d58-5ab6-450d-b944-c719c7274957 service nova] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:36:00.227666 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7840d3-f88c-4c77-9754-8f623c41375f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5c4ad16c9454b74ae8445b115cf0af4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:36:00.228353 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7840d3-f88c-4c77-9754-8f623c41375f service placement] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:36:00.228640 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7840d3-f88c-4c77-9754-8f623c41375f service placement] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:36:00.228913 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7840d3-f88c-4c77-9754-8f623c41375f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:36:00.230806 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-bb7840d3-f88c-4c77-9754-8f623c41375f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:36:00.244066 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7840d3-f88c-4c77-9754-8f623c41375f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:36:00.245695 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7840d3-f88c-4c77-9754-8f623c41375f service placement] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:36:00.255792 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1438/2884] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:36:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:36:04.027067 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180d957-f388-4559-b9ca-7de46749ee0e service neutron] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:36:04.028618 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-4180d957-f388-4559-b9ca-7de46749ee0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:36:04.042265 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180d957-f388-4559-b9ca-7de46749ee0e service neutron] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:36:04.047144 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236dd4b-25da-4b6a-9c6a-9835f099a4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:36:04.048022 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236dd4b-25da-4b6a-9c6a-9835f099a4b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:36:04.048335 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236dd4b-25da-4b6a-9c6a-9835f099a4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:36:04.048612 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236dd4b-25da-4b6a-9c6a-9835f099a4b7 admin admin] PATH_INFO: `/v3/users/77c56945d1d74a1eaa5e0c8f9e43f086` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:36:04.063490 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0236dd4b-25da-4b6a-9c6a-9835f099a4b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77c56945d1d74a1eaa5e0c8f9e43f086)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:36:04.065468 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0236dd4b-25da-4b6a-9c6a-9835f099a4b7 admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:36:04.200524 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-0236dd4b-25da-4b6a-9c6a-9835f099a4b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77c56945d1d74a1eaa5e0c8f9e43f086'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:36:04.213224 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-0236dd4b-25da-4b6a-9c6a-9835f099a4b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77c56945d1d74a1eaa5e0c8f9e43f086'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:36:04.214057 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-0236dd4b-25da-4b6a-9c6a-9835f099a4b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77c56945d1d74a1eaa5e0c8f9e43f086'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:36:04.221199 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-0236dd4b-25da-4b6a-9c6a-9835f099a4b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77c56945d1d74a1eaa5e0c8f9e43f086'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:36:04.221851 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-0236dd4b-25da-4b6a-9c6a-9835f099a4b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77c56945d1d74a1eaa5e0c8f9e43f086'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:36:04.284018 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1447/2885] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:36:04 2022] DELETE /identity/v3/users/77c56945d1d74a1eaa5e0c8f9e43f086 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:36:04.504338 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7840d3-f88c-4c77-9754-8f623c41375f service placement] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:36:04.522576 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7840d3-f88c-4c77-9754-8f623c41375f service placement] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:36:04.584970 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20403d-2df3-4bba-84a0-36a0d86bad67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:36:04.585904 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20403d-2df3-4bba-84a0-36a0d86bad67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:36:04.586191 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20403d-2df3-4bba-84a0-36a0d86bad67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:36:04.586469 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20403d-2df3-4bba-84a0-36a0d86bad67 admin admin] PATH_INFO: `/v3/projects/c880a17cc9844081bee38006d5b92f86` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:36:04.598279 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20403d-2df3-4bba-84a0-36a0d86bad67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c880a17cc9844081bee38006d5b92f86)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:36:04.600242 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20403d-2df3-4bba-84a0-36a0d86bad67 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:36:04.718483 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-6e20403d-2df3-4bba-84a0-36a0d86bad67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c880a17cc9844081bee38006d5b92f86', 'request_id': 'req-6e20403d-2df3-4bba-84a0-36a0d86bad67'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:36:04.797867 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-6e20403d-2df3-4bba-84a0-36a0d86bad67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c880a17cc9844081bee38006d5b92f86', 'request_id': 'req-6e20403d-2df3-4bba-84a0-36a0d86bad67'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:36:04.803750 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-6e20403d-2df3-4bba-84a0-36a0d86bad67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c880a17cc9844081bee38006d5b92f86', 'request_id': 'req-6e20403d-2df3-4bba-84a0-36a0d86bad67'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:36:04.816083 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-6e20403d-2df3-4bba-84a0-36a0d86bad67 admin admin] The token cache is being invalidate because project c880a17cc9844081bee38006d5b92f86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:36:04.816410 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-6e20403d-2df3-4bba-84a0-36a0d86bad67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:36:04.817048 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-6e20403d-2df3-4bba-84a0-36a0d86bad67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:36:04.818581 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1439/2886] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:36:04 2022] DELETE /identity/v3/projects/c880a17cc9844081bee38006d5b92f86 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:36:04.823107 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236dd4b-25da-4b6a-9c6a-9835f099a4b7 admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:36:04.824512 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-0236dd4b-25da-4b6a-9c6a-9835f099a4b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:36:04.838315 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236dd4b-25da-4b6a-9c6a-9835f099a4b7 admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:36:04.895306 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a8b60-c0e9-4224-b72d-2316d60703fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:36:04.896287 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a8b60-c0e9-4224-b72d-2316d60703fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:36:04.896573 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a8b60-c0e9-4224-b72d-2316d60703fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:36:04.896847 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a8b60-c0e9-4224-b72d-2316d60703fb admin admin] PATH_INFO: `/v3/users/aba7a12472bd458b9c81e4a18bf2f96e` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:36:04.898020 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488a8b60-c0e9-4224-b72d-2316d60703fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=aba7a12472bd458b9c81e4a18bf2f96e)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:36:04.900676 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488a8b60-c0e9-4224-b72d-2316d60703fb admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:36:05.152667 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-488a8b60-c0e9-4224-b72d-2316d60703fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aba7a12472bd458b9c81e4a18bf2f96e'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:36:05.154532 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:36:05.164660 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-488a8b60-c0e9-4224-b72d-2316d60703fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aba7a12472bd458b9c81e4a18bf2f96e'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:36:05.165579 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-488a8b60-c0e9-4224-b72d-2316d60703fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aba7a12472bd458b9c81e4a18bf2f96e'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:36:05.172378 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-488a8b60-c0e9-4224-b72d-2316d60703fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aba7a12472bd458b9c81e4a18bf2f96e'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:36:05.173000 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-488a8b60-c0e9-4224-b72d-2316d60703fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aba7a12472bd458b9c81e4a18bf2f96e'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:36:05.243513 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1448/2887] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:36:04 2022] DELETE /identity/v3/users/aba7a12472bd458b9c81e4a18bf2f96e => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 13:36:05.508336 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20403d-2df3-4bba-84a0-36a0d86bad67 admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:36:05.510416 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-6e20403d-2df3-4bba-84a0-36a0d86bad67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:36:05.524119 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20403d-2df3-4bba-84a0-36a0d86bad67 admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:36:05.574121 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:36:05.580710 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c322514e-cebe-4f97-9113-4b99089751d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:36:05.581563 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322514e-cebe-4f97-9113-4b99089751d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:36:05.584832 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322514e-cebe-4f97-9113-4b99089751d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:36:05.584832 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322514e-cebe-4f97-9113-4b99089751d7 admin admin] PATH_INFO: `/v3/projects/6e5784114df74a6e953cc6d2cc01f508` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:36:05.584832 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c322514e-cebe-4f97-9113-4b99089751d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e5784114df74a6e953cc6d2cc01f508)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:36:05.585179 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c322514e-cebe-4f97-9113-4b99089751d7 admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:36:05.742241 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-c322514e-cebe-4f97-9113-4b99089751d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e5784114df74a6e953cc6d2cc01f508', 'request_id': 'req-c322514e-cebe-4f97-9113-4b99089751d7'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:36:05.814615 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-c322514e-cebe-4f97-9113-4b99089751d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e5784114df74a6e953cc6d2cc01f508', 'request_id': 'req-c322514e-cebe-4f97-9113-4b99089751d7'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:36:05.820774 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-c322514e-cebe-4f97-9113-4b99089751d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e5784114df74a6e953cc6d2cc01f508', 'request_id': 'req-c322514e-cebe-4f97-9113-4b99089751d7'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:36:05.832896 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-c322514e-cebe-4f97-9113-4b99089751d7 admin admin] The token cache is being invalidate because project 6e5784114df74a6e953cc6d2cc01f508 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:36:05.833214 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-c322514e-cebe-4f97-9113-4b99089751d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:36:05.833961 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-c322514e-cebe-4f97-9113-4b99089751d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:36:05.835575 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1440/2888] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:36:05 2022] DELETE /identity/v3/projects/6e5784114df74a6e953cc6d2cc01f508 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:36:15.295154 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=11,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:36:15.829713 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=26,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:36:16.813649 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7eb889-3e92-4acc-aeec-a68fdc8403e5 None None] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:36:16.814294 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7eb889-3e92-4acc-aeec-a68fdc8403e5 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:36:16.814446 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7eb889-3e92-4acc-aeec-a68fdc8403e5 None None] PATH_INFO: `/` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:36:16.816247 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1449/2889] 10.222.0.61 () {54 vars in 921 bytes} [Fri Jun 3 13:36:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:36:16.821942 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a527d-7393-41e3-8d7f-d1231f8c1b2e None None] REQUEST_METHOD: `POST` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:36:16.822303 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a527d-7393-41e3-8d7f-d1231f8c1b2e None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:36:16.822703 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a527d-7393-41e3-8d7f-d1231f8c1b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:36:16.871979 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.auth.core [None req-c88a527d-7393-41e3-8d7f-d1231f8c1b2e None None] MFA Rules not processed for user `bdb5b24bd01c405c93e32ab4b329bcf1`. Rule list: `[]` (Enabled: `True`). {{(pid=80571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:36:16.873227 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-c88a527d-7393-41e3-8d7f-d1231f8c1b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:36:16.924690 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1441/2890] 10.222.0.61 () {58 vars in 1018 bytes} [Fri Jun 3 13:36:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:36:16.937508 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7eb889-3e92-4acc-aeec-a68fdc8403e5 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:36:16.942683 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-7b7eb889-3e92-4acc-aeec-a68fdc8403e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:36:16.952803 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7eb889-3e92-4acc-aeec-a68fdc8403e5 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:36:16.956628 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30794f69-c746-4720-8432-8eb09d864846 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:36:16.957276 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30794f69-c746-4720-8432-8eb09d864846 service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:36:16.957565 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30794f69-c746-4720-8432-8eb09d864846 service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:36:16.957840 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30794f69-c746-4720-8432-8eb09d864846 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:36:16.966136 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30794f69-c746-4720-8432-8eb09d864846 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:36:16.967796 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30794f69-c746-4720-8432-8eb09d864846 service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:36:16.975766 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1450/2891] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:36:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:36:17.060208 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae6509-2fc1-4968-bf27-2145a7cdbf44 None None] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:36:17.060505 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae6509-2fc1-4968-bf27-2145a7cdbf44 None None] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:36:17.060792 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae6509-2fc1-4968-bf27-2145a7cdbf44 None None] PATH_INFO: `/` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:36:17.062179 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1442/2892] 10.222.0.61 () {54 vars in 921 bytes} [Fri Jun 3 13:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 13:36:17.067490 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13def8c0-e016-44b0-b461-3f0cda8f9538 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:36:17.067784 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13def8c0-e016-44b0-b461-3f0cda8f9538 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:36:17.068064 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13def8c0-e016-44b0-b461-3f0cda8f9538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:36:17.117921 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-13def8c0-e016-44b0-b461-3f0cda8f9538 None None] MFA Rules not processed for user `066aaba3e9af4f85ab0cba89a3d32e34`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:36:17.119130 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-13def8c0-e016-44b0-b461-3f0cda8f9538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:36:17.194747 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1451/2893] 10.222.0.61 () {58 vars in 1018 bytes} [Fri Jun 3 13:36:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 13:36:17.205079 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae6509-2fc1-4968-bf27-2145a7cdbf44 None None] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:36:17.216551 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae6509-2fc1-4968-bf27-2145a7cdbf44 None None] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:36:17.219973 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09787f12-c2b7-4ff3-96c8-c50e36fd340e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:36:17.220668 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09787f12-c2b7-4ff3-96c8-c50e36fd340e service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:36:17.220952 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09787f12-c2b7-4ff3-96c8-c50e36fd340e service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:36:17.221224 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09787f12-c2b7-4ff3-96c8-c50e36fd340e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:36:17.231880 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09787f12-c2b7-4ff3-96c8-c50e36fd340e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:36:17.233342 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09787f12-c2b7-4ff3-96c8-c50e36fd340e service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:36:17.243917 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1443/2894] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:36:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:36:27.191768 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=52 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:36:27.239307 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=39 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:36:34.054224 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec24b9-0139-4256-8cc6-763a4eb8b819 None None] REQUEST_METHOD: `POST` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:36:34.054768 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec24b9-0139-4256-8cc6-763a4eb8b819 None None] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:36:34.054768 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec24b9-0139-4256-8cc6-763a4eb8b819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:36:34.073443 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.auth.core [None req-1fec24b9-0139-4256-8cc6-763a4eb8b819 None None] MFA Rules not processed for user `3b71f0a1eb994da09f9a3336f2fe6eeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 13:36:34.075478 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-1fec24b9-0139-4256-8cc6-763a4eb8b819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:36:34.131830 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1452/2895] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jun 3 13:36:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 13:36:44.125133 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=25 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:37:43.163067 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09787f12-c2b7-4ff3-96c8-c50e36fd340e service neutron] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:37:43.164546 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-09787f12-c2b7-4ff3-96c8-c50e36fd340e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:37:43.228768 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09787f12-c2b7-4ff3-96c8-c50e36fd340e service neutron] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:37:43.233473 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5907e2b-89f2-4cd4-b6ca-023ccb76b65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:37:43.234373 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5907e2b-89f2-4cd4-b6ca-023ccb76b65e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:37:43.234658 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5907e2b-89f2-4cd4-b6ca-023ccb76b65e admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:37:43.234936 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5907e2b-89f2-4cd4-b6ca-023ccb76b65e admin admin] PATH_INFO: `/v3/users/3b71f0a1eb994da09f9a3336f2fe6eeb` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:37:43.236171 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5907e2b-89f2-4cd4-b6ca-023ccb76b65e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b71f0a1eb994da09f9a3336f2fe6eeb)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:37:43.238108 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5907e2b-89f2-4cd4-b6ca-023ccb76b65e admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:37:43.421819 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-d5907e2b-89f2-4cd4-b6ca-023ccb76b65e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b71f0a1eb994da09f9a3336f2fe6eeb'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:37:43.433972 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-d5907e2b-89f2-4cd4-b6ca-023ccb76b65e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b71f0a1eb994da09f9a3336f2fe6eeb'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:37:43.434667 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-d5907e2b-89f2-4cd4-b6ca-023ccb76b65e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b71f0a1eb994da09f9a3336f2fe6eeb'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:37:43.441474 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-d5907e2b-89f2-4cd4-b6ca-023ccb76b65e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b71f0a1eb994da09f9a3336f2fe6eeb'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:37:43.442098 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-d5907e2b-89f2-4cd4-b6ca-023ccb76b65e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b71f0a1eb994da09f9a3336f2fe6eeb'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:37:43.516167 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1444/2896] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:37:43 2022] DELETE /identity/v3/users/3b71f0a1eb994da09f9a3336f2fe6eeb => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:37:43.766454 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec24b9-0139-4256-8cc6-763a4eb8b819 None None] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:37:43.777988 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec24b9-0139-4256-8cc6-763a4eb8b819 None None] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:37:43.836007 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f42064-d8f1-4463-bff5-5ef3e73630bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:37:43.836954 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f42064-d8f1-4463-bff5-5ef3e73630bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:37:43.837235 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f42064-d8f1-4463-bff5-5ef3e73630bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:37:43.837509 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f42064-d8f1-4463-bff5-5ef3e73630bf admin admin] PATH_INFO: `/v3/projects/bd537e9d76aa492dab87422257286816` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:37:43.838802 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f42064-d8f1-4463-bff5-5ef3e73630bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd537e9d76aa492dab87422257286816)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:37:43.840888 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f42064-d8f1-4463-bff5-5ef3e73630bf admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:37:43.980288 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-b8f42064-d8f1-4463-bff5-5ef3e73630bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd537e9d76aa492dab87422257286816', 'request_id': 'req-b8f42064-d8f1-4463-bff5-5ef3e73630bf'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:37:43.986555 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-b8f42064-d8f1-4463-bff5-5ef3e73630bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd537e9d76aa492dab87422257286816', 'request_id': 'req-b8f42064-d8f1-4463-bff5-5ef3e73630bf'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:37:43.993015 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-b8f42064-d8f1-4463-bff5-5ef3e73630bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd537e9d76aa492dab87422257286816', 'request_id': 'req-b8f42064-d8f1-4463-bff5-5ef3e73630bf'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:37:44.076119 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-b8f42064-d8f1-4463-bff5-5ef3e73630bf admin admin] The token cache is being invalidate because project bd537e9d76aa492dab87422257286816 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:37:44.076436 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-b8f42064-d8f1-4463-bff5-5ef3e73630bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:37:44.077086 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-b8f42064-d8f1-4463-bff5-5ef3e73630bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:37:44.078649 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1453/2897] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:37:43 2022] DELETE /identity/v3/projects/bd537e9d76aa492dab87422257286816 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:37:53.512562 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=53,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:37:54.073080 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:37:55.146352 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5907e2b-89f2-4cd4-b6ca-023ccb76b65e admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:37:55.147776 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-d5907e2b-89f2-4cd4-b6ca-023ccb76b65e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:37:55.210868 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5907e2b-89f2-4cd4-b6ca-023ccb76b65e admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:37:55.263044 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6157c-4109-4711-ac69-20c6ee7c4173 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:37:55.263616 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6157c-4109-4711-ac69-20c6ee7c4173 service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:37:55.263903 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6157c-4109-4711-ac69-20c6ee7c4173 service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:37:55.264217 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6157c-4109-4711-ac69-20c6ee7c4173 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:37:55.265993 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-dea6157c-4109-4711-ac69-20c6ee7c4173 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:37:55.275415 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6157c-4109-4711-ac69-20c6ee7c4173 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:37:55.277393 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6157c-4109-4711-ac69-20c6ee7c4173 service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:37:55.285605 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1445/2898] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:37:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:38:05.281938 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=46 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:38:27.026319 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f42064-d8f1-4463-bff5-5ef3e73630bf admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:38:27.027744 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-b8f42064-d8f1-4463-bff5-5ef3e73630bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:38:27.040587 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f42064-d8f1-4463-bff5-5ef3e73630bf admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:38:27.044048 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432ac67-efdd-4d63-8554-ac7ba9aeee77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:38:27.044712 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432ac67-efdd-4d63-8554-ac7ba9aeee77 service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:38:27.044995 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432ac67-efdd-4d63-8554-ac7ba9aeee77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:38:27.045271 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432ac67-efdd-4d63-8554-ac7ba9aeee77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:38:27.047074 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-2432ac67-efdd-4d63-8554-ac7ba9aeee77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:38:27.105210 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432ac67-efdd-4d63-8554-ac7ba9aeee77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:38:27.106648 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432ac67-efdd-4d63-8554-ac7ba9aeee77 service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:38:27.115551 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1454/2899] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:38:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:38:28.598526 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6157c-4109-4711-ac69-20c6ee7c4173 service neutron] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:38:28.607590 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6157c-4109-4711-ac69-20c6ee7c4173 service neutron] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:38:28.611789 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c6d90a-fe84-45f9-97fe-d6eb10f99b4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:38:28.612471 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6d90a-fe84-45f9-97fe-d6eb10f99b4c service neutron] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:38:28.612783 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6d90a-fe84-45f9-97fe-d6eb10f99b4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:38:28.613297 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6d90a-fe84-45f9-97fe-d6eb10f99b4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:38:28.615123 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-47c6d90a-fe84-45f9-97fe-d6eb10f99b4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:38:28.689205 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c6d90a-fe84-45f9-97fe-d6eb10f99b4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:38:28.690833 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c6d90a-fe84-45f9-97fe-d6eb10f99b4c service neutron] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:38:28.702224 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1446/2900] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:38:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:38:29.892513 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432ac67-efdd-4d63-8554-ac7ba9aeee77 service neutron] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:38:29.894015 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-2432ac67-efdd-4d63-8554-ac7ba9aeee77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:38:29.904979 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432ac67-efdd-4d63-8554-ac7ba9aeee77 service neutron] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:38:29.914220 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb6c4b-9a53-4295-bb84-530434a105bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:38:29.914220 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb6c4b-9a53-4295-bb84-530434a105bc service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:38:29.914220 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb6c4b-9a53-4295-bb84-530434a105bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:38:29.914220 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb6c4b-9a53-4295-bb84-530434a105bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:38:29.914618 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-8ebb6c4b-9a53-4295-bb84-530434a105bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:38:29.926729 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb6c4b-9a53-4295-bb84-530434a105bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:38:29.928161 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb6c4b-9a53-4295-bb84-530434a105bc service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:38:29.939204 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1455/2901] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:38:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:38:30.882390 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c6d90a-fe84-45f9-97fe-d6eb10f99b4c service neutron] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:38:30.884531 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-47c6d90a-fe84-45f9-97fe-d6eb10f99b4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:38:30.898520 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c6d90a-fe84-45f9-97fe-d6eb10f99b4c service neutron] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:38:30.903941 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be64bf-143a-4de4-a869-8294ddee5155 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '066aaba3e9af4f85ab0cba89a3d32e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:38:30.904612 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be64bf-143a-4de4-a869-8294ddee5155 service nova] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:38:30.904896 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be64bf-143a-4de4-a869-8294ddee5155 service nova] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:38:30.905174 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be64bf-143a-4de4-a869-8294ddee5155 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:38:30.906886 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-88be64bf-143a-4de4-a869-8294ddee5155 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:38:30.918830 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be64bf-143a-4de4-a869-8294ddee5155 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:38:30.920446 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be64bf-143a-4de4-a869-8294ddee5155 service nova] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:38:30.931605 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1447/2902] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:38:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:38:34.623560 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb6c4b-9a53-4295-bb84-530434a105bc service neutron] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:38:34.635229 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb6c4b-9a53-4295-bb84-530434a105bc service neutron] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:38:34.643258 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccaea2d-9863-497d-b3c1-4f02bc414617 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb5b24bd01c405c93e32ab4b329bcf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:38:34.643905 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccaea2d-9863-497d-b3c1-4f02bc414617 service neutron] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:38:34.644529 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccaea2d-9863-497d-b3c1-4f02bc414617 service neutron] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:38:34.644718 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccaea2d-9863-497d-b3c1-4f02bc414617 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:38:34.646527 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-6ccaea2d-9863-497d-b3c1-4f02bc414617 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:38:34.724230 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccaea2d-9863-497d-b3c1-4f02bc414617 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:38:34.725684 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccaea2d-9863-497d-b3c1-4f02bc414617 service neutron] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:38:34.735371 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1456/2903] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:38:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:38:40.927653 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=40 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:38:41.433487 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be64bf-143a-4de4-a869-8294ddee5155 service nova] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:38:41.435293 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-88be64bf-143a-4de4-a869-8294ddee5155 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:38:41.514443 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be64bf-143a-4de4-a869-8294ddee5155 service nova] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:38:41.520120 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74515b3e-dde0-48e8-9353-d42eea5151f7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5c4ad16c9454b74ae8445b115cf0af4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:38:41.520782 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74515b3e-dde0-48e8-9353-d42eea5151f7 service placement] REQUEST_METHOD: `GET` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:38:41.521060 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74515b3e-dde0-48e8-9353-d42eea5151f7 service placement] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:38:41.521330 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74515b3e-dde0-48e8-9353-d42eea5151f7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:38:41.523069 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-74515b3e-dde0-48e8-9353-d42eea5151f7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:38:41.534776 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74515b3e-dde0-48e8-9353-d42eea5151f7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:38:41.536375 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74515b3e-dde0-48e8-9353-d42eea5151f7 service placement] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:38:41.546044 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1448/2904] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:38:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:38:41.557114 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccaea2d-9863-497d-b3c1-4f02bc414617 service neutron] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:38:41.559750 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-6ccaea2d-9863-497d-b3c1-4f02bc414617 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:38:41.573240 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccaea2d-9863-497d-b3c1-4f02bc414617 service neutron] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:38:41.578238 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b8480-e8e8-4415-848f-d287f947348c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:38:41.579870 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b8480-e8e8-4415-848f-d287f947348c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:38:41.580397 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b8480-e8e8-4415-848f-d287f947348c admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:38:41.580686 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b8480-e8e8-4415-848f-d287f947348c admin admin] PATH_INFO: `/v3/users/a7da9a3f3e5f4eb4b1a01d33dcdb4bf2` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:38:41.581992 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130b8480-e8e8-4415-848f-d287f947348c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7da9a3f3e5f4eb4b1a01d33dcdb4bf2)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:38:41.584172 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130b8480-e8e8-4415-848f-d287f947348c admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:38:41.744128 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-130b8480-e8e8-4415-848f-d287f947348c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:38:41.757294 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-130b8480-e8e8-4415-848f-d287f947348c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:38:41.758042 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-130b8480-e8e8-4415-848f-d287f947348c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:38:41.765266 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-130b8480-e8e8-4415-848f-d287f947348c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:38:41.766104 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-130b8480-e8e8-4415-848f-d287f947348c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7da9a3f3e5f4eb4b1a01d33dcdb4bf2'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:38:41.768512 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:38:41.859233 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1457/2905] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:38:41 2022] DELETE /identity/v3/users/a7da9a3f3e5f4eb4b1a01d33dcdb4bf2 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:38:42.100112 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74515b3e-dde0-48e8-9353-d42eea5151f7 service placement] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:38:42.111868 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74515b3e-dde0-48e8-9353-d42eea5151f7 service placement] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:38:42.171125 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e613a39-b15d-4bec-90db-d05b8992c5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:38:42.172065 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e613a39-b15d-4bec-90db-d05b8992c5ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:38:42.172919 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e613a39-b15d-4bec-90db-d05b8992c5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:38:42.173225 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e613a39-b15d-4bec-90db-d05b8992c5ea admin admin] PATH_INFO: `/v3/projects/225191825c1d49c795151c7bedf35d97` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:38:42.174465 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e613a39-b15d-4bec-90db-d05b8992c5ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=225191825c1d49c795151c7bedf35d97)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:38:42.176464 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e613a39-b15d-4bec-90db-d05b8992c5ea admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:38:42.283895 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-4e613a39-b15d-4bec-90db-d05b8992c5ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '225191825c1d49c795151c7bedf35d97', 'request_id': 'req-4e613a39-b15d-4bec-90db-d05b8992c5ea'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:38:42.362053 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-4e613a39-b15d-4bec-90db-d05b8992c5ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '225191825c1d49c795151c7bedf35d97', 'request_id': 'req-4e613a39-b15d-4bec-90db-d05b8992c5ea'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:38:42.367904 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-4e613a39-b15d-4bec-90db-d05b8992c5ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '225191825c1d49c795151c7bedf35d97', 'request_id': 'req-4e613a39-b15d-4bec-90db-d05b8992c5ea'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:38:42.380003 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-4e613a39-b15d-4bec-90db-d05b8992c5ea admin admin] The token cache is being invalidate because project 225191825c1d49c795151c7bedf35d97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:38:42.380338 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-4e613a39-b15d-4bec-90db-d05b8992c5ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:38:42.380963 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-4e613a39-b15d-4bec-90db-d05b8992c5ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:38:42.382493 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1449/2906] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:38:42 2022] DELETE /identity/v3/projects/225191825c1d49c795151c7bedf35d97 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:38:42.386941 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b8480-e8e8-4415-848f-d287f947348c admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:38:42.388383 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-130b8480-e8e8-4415-848f-d287f947348c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:38:42.402416 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b8480-e8e8-4415-848f-d287f947348c admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:38:42.458719 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95891c-fd70-4202-a920-fb4e3c55f14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:38:42.459586 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95891c-fd70-4202-a920-fb4e3c55f14f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:38:42.459866 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95891c-fd70-4202-a920-fb4e3c55f14f admin admin] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:38:42.460139 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95891c-fd70-4202-a920-fb4e3c55f14f admin admin] PATH_INFO: `/v3/users/ec6c189d0fac4aa39ea320ab2c00f913` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:38:42.461324 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c95891c-fd70-4202-a920-fb4e3c55f14f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec6c189d0fac4aa39ea320ab2c00f913)` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:38:42.463244 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c95891c-fd70-4202-a920-fb4e3c55f14f admin admin] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:38:42.665783 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-6c95891c-fd70-4202-a920-fb4e3c55f14f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec6c189d0fac4aa39ea320ab2c00f913'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:38:42.678293 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-6c95891c-fd70-4202-a920-fb4e3c55f14f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec6c189d0fac4aa39ea320ab2c00f913'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:38:42.679001 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-6c95891c-fd70-4202-a920-fb4e3c55f14f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec6c189d0fac4aa39ea320ab2c00f913'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:38:42.685913 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-6c95891c-fd70-4202-a920-fb4e3c55f14f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec6c189d0fac4aa39ea320ab2c00f913'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:38:42.686618 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.notifications [None req-6c95891c-fd70-4202-a920-fb4e3c55f14f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec6c189d0fac4aa39ea320ab2c00f913'} {{(pid=80572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:38:42.750041 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1458/2907] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jun 3 13:38:42 2022] DELETE /identity/v3/users/ec6c189d0fac4aa39ea320ab2c00f913 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:38:42.997822 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e613a39-b15d-4bec-90db-d05b8992c5ea admin admin] Authenticating user token {{(pid=80571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:38:42.999815 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.fernet_utils [None req-4e613a39-b15d-4bec-90db-d05b8992c5ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:38:43.018558 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e613a39-b15d-4bec-90db-d05b8992c5ea admin admin] Validating token access rules against request {{(pid=80571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:38:43.036566 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:38:43.077004 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e3679-de8a-48a8-b3dd-207b278625ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e8e6595d7242a98c3388e4c3784e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade16b49bacd4a0789895b9341a45a4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:38:43.077864 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e3679-de8a-48a8-b3dd-207b278625ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:38:43.078145 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e3679-de8a-48a8-b3dd-207b278625ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:38:43.078417 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e3679-de8a-48a8-b3dd-207b278625ba admin admin] PATH_INFO: `/v3/projects/8621790ad7ad4af5bcab94c4013a159b` {{(pid=80571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:38:43.079747 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16e3679-de8a-48a8-b3dd-207b278625ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=8621790ad7ad4af5bcab94c4013a159b)` {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:38:43.081686 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16e3679-de8a-48a8-b3dd-207b278625ba admin admin] RBAC: Authorization granted {{(pid=80571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:38:43.211541 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-e16e3679-de8a-48a8-b3dd-207b278625ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8621790ad7ad4af5bcab94c4013a159b', 'request_id': 'req-e16e3679-de8a-48a8-b3dd-207b278625ba'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:38:43.286242 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-e16e3679-de8a-48a8-b3dd-207b278625ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8621790ad7ad4af5bcab94c4013a159b', 'request_id': 'req-e16e3679-de8a-48a8-b3dd-207b278625ba'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:38:43.291992 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-e16e3679-de8a-48a8-b3dd-207b278625ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8621790ad7ad4af5bcab94c4013a159b', 'request_id': 'req-e16e3679-de8a-48a8-b3dd-207b278625ba'} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:38:43.303230 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-e16e3679-de8a-48a8-b3dd-207b278625ba admin admin] The token cache is being invalidate because project 8621790ad7ad4af5bcab94c4013a159b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 13:38:43.305794 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-e16e3679-de8a-48a8-b3dd-207b278625ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:38:43.305794 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG keystone.notifications [None req-e16e3679-de8a-48a8-b3dd-207b278625ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 13:38:43.305794 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: [pid: 80571|app: 0|req: 1450/2908] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jun 3 13:38:42 2022] DELETE /identity/v3/projects/8621790ad7ad4af5bcab94c4013a159b => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 13:38:52.746421 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=55 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:38:53.300349 dv-cinder-801354-5-iscsi devstack@keystone.service[80571]: DEBUG dbcounter [-] [80571] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:41:06.762847 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95891c-fd70-4202-a920-fb4e3c55f14f admin admin] Authenticating user token {{(pid=80572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 13:41:06.764269 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-6c95891c-fd70-4202-a920-fb4e3c55f14f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:41:06.832988 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95891c-fd70-4202-a920-fb4e3c55f14f admin admin] Validating token access rules against request {{(pid=80572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 13:41:06.891376 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b93fbe-b47a-4f48-8f67-9656c3ea918c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5c4ad16c9454b74ae8445b115cf0af4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c0bf799c9f451b8167a646a5c82eda', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 13:41:06.892022 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b93fbe-b47a-4f48-8f67-9656c3ea918c service placement] REQUEST_METHOD: `GET` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 13:41:06.892332 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b93fbe-b47a-4f48-8f67-9656c3ea918c service placement] SCRIPT_NAME: `/identity` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 13:41:06.892608 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b93fbe-b47a-4f48-8f67-9656c3ea918c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 13:41:06.894358 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.fernet_utils [None req-c7b93fbe-b47a-4f48-8f67-9656c3ea918c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 13:41:06.905583 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b93fbe-b47a-4f48-8f67-9656c3ea918c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 13:41:06.907170 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b93fbe-b47a-4f48-8f67-9656c3ea918c service placement] RBAC: Authorization granted {{(pid=80572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 13:41:06.917465 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: [pid: 80572|app: 0|req: 1459/2909] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jun 3 13:41:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 13:41:16.912778 dv-cinder-801354-5-iscsi devstack@keystone.service[80572]: DEBUG dbcounter [-] [80572] Writing DB stats keystone:SELECT=58 {{(pid=80572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}